Dec 01 17:01:32 user nova-compute[75745]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75745) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Dec 01 17:01:32 user nova-compute[75745]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75745) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Dec 01 17:01:32 user nova-compute[75745]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75745) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Dec 01 17:01:32 user nova-compute[75745]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Dec 01 17:01:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:01:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:01:32 user nova-compute[75745]: INFO nova.virt.driver [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] Loading compute driver 'libvirt.LibvirtDriver'
Dec 01 17:01:33 user nova-compute[75745]: INFO nova.compute.provider_config [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] Acquiring lock "singleton_lock" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] Acquired lock "singleton_lock" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] Releasing lock "singleton_lock" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] Full set of CONF: {{(pid=75745) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] ******************************************************************************** {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] Configuration options gathered from: {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] ================================================================================ {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] allow_resize_to_same_host      = True {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] arq_binding_timeout            = 300 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] backdoor_port                  = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] backdoor_socket                = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] block_device_allocate_retries  = 300 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] block_device_allocate_retries_interval = 5 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cert                           = self.pem {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] compute_monitors               = [] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] config_dir                     = [] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] config_drive_format            = iso9660 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] config_source                  = [] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] console_host                   = user {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] control_exchange               = nova {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cpu_allocation_ratio           = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] daemon                         = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] debug                          = True {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] default_access_ip_network_name = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] default_availability_zone      = nova {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] default_ephemeral_format       = ext4 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] default_green_pool_size        = 1000 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] default_schedule_zone          = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] disk_allocation_ratio          = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] enable_new_services            = True {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] enabled_apis                   = ['osapi_compute'] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] enabled_ssl_apis               = [] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] flat_injected                  = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] force_config_drive             = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] force_raw_images               = True {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] graceful_shutdown_timeout      = 5 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] heal_instance_info_cache_interval = 60 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] host                           = user {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] instance_build_timeout         = 0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] instance_delete_interval       = 300 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] instance_format                = [instance: %(uuid)s]  {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] instance_name_template         = instance-%08x {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] instance_usage_audit           = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] instance_usage_audit_period    = month {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] internal_service_availability_zone = internal {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] key                            = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] live_migration_retry_count     = 30 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] log_config_append              = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] log_dir                        = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] log_file                       = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] log_options                    = True {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] log_rotate_interval            = 1 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] log_rotate_interval_type       = days {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] log_rotation_type              = none {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] long_rpc_timeout               = 1800 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] max_concurrent_builds          = 10 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] max_concurrent_live_migrations = 1 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] max_concurrent_snapshots       = 5 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] max_local_block_devices        = 3 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] max_logfile_count              = 30 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] max_logfile_size_mb            = 200 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] maximum_instance_delete_attempts = 5 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] metadata_listen                = 0.0.0.0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] metadata_listen_port           = 8775 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] metadata_workers               = 3 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] migrate_max_retries            = -1 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] mkisofs_cmd                    = genisoimage {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] my_ip                          = 10.0.0.210 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] network_allocate_retries       = 0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] osapi_compute_listen_port      = 8774 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] osapi_compute_unique_server_name_scope =  {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] osapi_compute_workers          = 3 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] password_length                = 12 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] periodic_enable                = True {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] periodic_fuzzy_delay           = 60 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] pointer_model                  = ps2mouse {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] preallocate_images             = none {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] publish_errors                 = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] pybasedir                      = /opt/stack/nova {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] ram_allocation_ratio           = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] rate_limit_burst               = 0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] rate_limit_except_level        = CRITICAL {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] rate_limit_interval            = 0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] reboot_timeout                 = 0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] reclaim_instance_interval      = 0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] record                         = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] reimage_timeout_per_gb         = 60 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] report_interval                = 120 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] rescue_timeout                 = 0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] reserved_host_cpus             = 0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] reserved_host_disk_mb          = 0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] reserved_host_memory_mb        = 512 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] reserved_huge_pages            = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] resize_confirm_window          = 0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] resize_fs_using_block_device   = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] resume_guests_state_on_host_boot = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] rpc_response_timeout           = 60 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] run_external_periodic_tasks    = True {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] running_deleted_instance_action = reap {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] running_deleted_instance_poll_interval = 1800 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] running_deleted_instance_timeout = 0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] scheduler_instance_sync_interval = 120 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] service_down_time              = 720 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] servicegroup_driver            = db {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] shelved_offload_time           = 0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] shelved_poll_interval          = 3600 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] shutdown_timeout               = 0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] source_is_ipv6                 = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] ssl_only                       = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] state_path                     = /opt/stack/data/nova {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] sync_power_state_interval      = 600 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] sync_power_state_pool_size     = 1000 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] syslog_log_facility            = LOG_USER {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] tempdir                        = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] timeout_nbd                    = 10 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] transport_url                  = **** {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] update_resources_interval      = 0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] use_cow_images                 = True {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] use_eventlog                   = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] use_journal                    = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] use_json                       = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] use_rootwrap_daemon            = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] use_stderr                     = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] use_syslog                     = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vcpu_pin_set                   = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vif_plugging_is_fatal          = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vif_plugging_timeout           = 0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] virt_mkfs                      = [] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] volume_usage_poll_interval     = 0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] watch_log_file                 = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] web                            = /usr/share/spice-html5 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_concurrency.disable_process_locking = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api.auth_strategy              = keystone {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api.compute_link_prefix        = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api.dhcp_domain                = novalocal {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api.enable_instance_password   = True {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api.glance_link_prefix         = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api.instance_list_per_project_cells = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api.list_records_by_skipping_down_cells = True {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api.local_metadata_per_cell    = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api.max_limit                  = 1000 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api.metadata_cache_expiration  = 15 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api.neutron_default_tenant_id  = default {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api.use_forwarded_for          = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api.use_neutron_default_nets   = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api.vendordata_dynamic_targets = [] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api.vendordata_jsonfile_path   = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cache.backend                  = dogpile.cache.memcached {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cache.backend_argument         = **** {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cache.config_prefix            = cache.oslo {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cache.dead_timeout             = 60.0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cache.debug_cache_backend      = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cache.enable_retry_client      = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cache.enable_socket_keepalive  = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cache.enabled                  = True {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cache.expiration_time          = 600 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cache.hashclient_retry_attempts = 2 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cache.memcache_dead_retry      = 300 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cache.memcache_password        =  {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cache.memcache_pool_maxsize    = 10 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cache.memcache_sasl_enabled    = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cache.memcache_username        =  {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cache.proxies                  = [] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cache.retry_attempts           = 2 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cache.retry_delay              = 0.0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cache.socket_keepalive_count   = 1 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cache.socket_keepalive_idle    = 1 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cache.socket_keepalive_interval = 1 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cache.tls_allowed_ciphers      = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cache.tls_cafile               = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cache.tls_certfile             = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cache.tls_enabled              = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cache.tls_keyfile              = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cinder.auth_section            = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cinder.auth_type               = password {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cinder.cafile                  = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cinder.certfile                = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cinder.collect_timing          = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cinder.cross_az_attach         = True {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cinder.debug                   = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cinder.endpoint_template       = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cinder.http_retries            = 3 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cinder.insecure                = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cinder.keyfile                 = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cinder.os_region_name          = RegionOne {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cinder.split_loggers           = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cinder.timeout                 = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] compute.cpu_dedicated_set      = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] compute.cpu_shared_set         = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] compute.image_type_exclude_list = [] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] compute.max_concurrent_disk_ops = 0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] compute.max_disk_devices_to_attach = -1 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] compute.resource_provider_association_refresh = 300 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] compute.shutdown_retry_interval = 10 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] conductor.workers              = 3 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] console.allowed_origins        = [] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] console.ssl_ciphers            = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] console.ssl_minimum_version    = default {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] consoleauth.token_ttl          = 600 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cyborg.cafile                  = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cyborg.certfile                = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cyborg.collect_timing          = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cyborg.connect_retries         = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cyborg.connect_retry_delay     = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cyborg.endpoint_override       = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cyborg.insecure                = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cyborg.keyfile                 = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cyborg.max_version             = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cyborg.min_version             = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cyborg.region_name             = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cyborg.service_name            = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cyborg.service_type            = accelerator {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cyborg.split_loggers           = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cyborg.status_code_retries     = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cyborg.status_code_retry_delay = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cyborg.timeout                 = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] cyborg.version                 = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] database.backend               = sqlalchemy {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] database.connection            = **** {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] database.connection_debug      = 0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] database.connection_parameters =  {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] database.connection_recycle_time = 3600 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] database.connection_trace      = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] database.db_inc_retry_interval = True {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] database.db_max_retries        = 20 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] database.db_max_retry_interval = 10 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] database.db_retry_interval     = 1 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] database.max_overflow          = 50 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] database.max_pool_size         = 5 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] database.max_retries           = 10 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] database.mysql_wsrep_sync_wait = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] database.pool_timeout          = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] database.retry_interval        = 10 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] database.slave_connection      = **** {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] database.sqlite_synchronous    = True {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api_database.backend           = sqlalchemy {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api_database.connection        = **** {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api_database.connection_debug  = 0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api_database.connection_parameters =  {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api_database.connection_recycle_time = 3600 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api_database.connection_trace  = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api_database.db_inc_retry_interval = True {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api_database.db_max_retries    = 20 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api_database.db_max_retry_interval = 10 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api_database.db_retry_interval = 1 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api_database.max_overflow      = 50 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api_database.max_pool_size     = 5 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api_database.max_retries       = 10 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api_database.pool_timeout      = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api_database.retry_interval    = 10 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api_database.slave_connection  = **** {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] api_database.sqlite_synchronous = True {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] devices.enabled_mdev_types     = [] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] ephemeral_storage_encryption.enabled = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] glance.api_servers             = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] glance.cafile                  = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] glance.certfile                = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] glance.collect_timing          = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] glance.connect_retries         = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] glance.connect_retry_delay     = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] glance.debug                   = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] glance.default_trusted_certificate_ids = [] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] glance.enable_certificate_validation = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] glance.enable_rbd_download     = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] glance.endpoint_override       = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] glance.insecure                = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] glance.keyfile                 = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] glance.max_version             = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] glance.min_version             = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] glance.num_retries             = 3 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] glance.rbd_ceph_conf           =  {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] glance.rbd_connect_timeout     = 5 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] glance.rbd_pool                =  {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] glance.rbd_user                =  {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] glance.region_name             = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] glance.service_name            = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] glance.service_type            = image {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] glance.split_loggers           = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] glance.status_code_retries     = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] glance.status_code_retry_delay = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] glance.timeout                 = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] glance.verify_glance_signatures = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] glance.version                 = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] guestfs.debug                  = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] hyperv.config_drive_cdrom      = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] hyperv.config_drive_inject_password = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] hyperv.enable_instance_metrics_collection = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] hyperv.enable_remotefx         = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] hyperv.instances_path_share    =  {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] hyperv.iscsi_initiator_list    = [] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] hyperv.limit_cpu_features      = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] hyperv.power_state_check_timeframe = 60 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] hyperv.use_multipath_io        = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] hyperv.volume_attach_retry_count = 10 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] hyperv.vswitch_name            = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] mks.enabled                    = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] image_cache.manager_interval   = 2400 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] image_cache.precache_concurrency = 1 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] image_cache.remove_unused_base_images = True {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] image_cache.subdirectory_name  = _base {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] ironic.api_max_retries         = 60 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] ironic.api_retry_interval      = 2 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] ironic.auth_section            = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] ironic.auth_type               = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] ironic.cafile                  = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] ironic.certfile                = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] ironic.collect_timing          = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] ironic.conductor_group         = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] ironic.connect_retries         = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] ironic.connect_retry_delay     = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] ironic.endpoint_override       = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] ironic.insecure                = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] ironic.keyfile                 = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] ironic.max_version             = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] ironic.min_version             = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] ironic.peer_list               = [] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] ironic.region_name             = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] ironic.serial_console_state_timeout = 10 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] ironic.service_name            = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] ironic.service_type            = baremetal {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] ironic.split_loggers           = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] ironic.status_code_retries     = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] ironic.status_code_retry_delay = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] ironic.timeout                 = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] ironic.version                 = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] key_manager.fixed_key          = **** {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] barbican.barbican_api_version  = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] barbican.barbican_endpoint     = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] barbican.barbican_endpoint_type = public {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] barbican.barbican_region_name  = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] barbican.cafile                = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] barbican.certfile              = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] barbican.collect_timing        = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] barbican.insecure              = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] barbican.keyfile               = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] barbican.number_of_retries     = 60 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] barbican.retry_delay           = 1 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] barbican.send_service_user_token = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] barbican.split_loggers         = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] barbican.timeout               = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] barbican.verify_ssl            = True {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] barbican.verify_ssl_path       = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] barbican_service_user.auth_section = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] barbican_service_user.auth_type = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] barbican_service_user.cafile   = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] barbican_service_user.certfile = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] barbican_service_user.collect_timing = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] barbican_service_user.insecure = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] barbican_service_user.keyfile  = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] barbican_service_user.split_loggers = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] barbican_service_user.timeout  = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vault.approle_role_id          = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vault.approle_secret_id        = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vault.cafile                   = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vault.certfile                 = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vault.collect_timing           = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vault.insecure                 = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vault.keyfile                  = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vault.kv_mountpoint            = secret {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vault.kv_path                  = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vault.kv_version               = 2 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vault.namespace                = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vault.root_token_id            = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vault.split_loggers            = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vault.ssl_ca_crt_file          = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vault.timeout                  = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vault.use_ssl                  = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] keystone.auth_section          = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] keystone.auth_type             = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] keystone.cafile                = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] keystone.certfile              = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] keystone.collect_timing        = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] keystone.connect_retries       = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] keystone.connect_retry_delay   = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] keystone.endpoint_override     = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] keystone.insecure              = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] keystone.keyfile               = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] keystone.max_version           = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] keystone.min_version           = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] keystone.region_name           = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] keystone.service_name          = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] keystone.service_type          = identity {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] keystone.split_loggers         = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] keystone.status_code_retries   = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] keystone.status_code_retry_delay = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] keystone.timeout               = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] keystone.version               = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.connection_uri         =  {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.cpu_mode               = custom {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: WARNING oslo_config.cfg [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.cpu_power_governor_high = performance {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.cpu_power_governor_low = powersave {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.cpu_power_management   = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.device_detach_attempts = 8 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.device_detach_timeout  = 20 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.disk_cachemodes        = [] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.disk_prefix            = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.enabled_perf_events    = [] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.file_backed_memory     = 0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.gid_maps               = [] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.hw_disk_discard        = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.hw_machine_type        = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.images_rbd_glance_store_name =  {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.images_rbd_pool        = rbd {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.images_type            = default {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.images_volume_group    = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.inject_key             = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.inject_partition       = -2 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.inject_password        = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.iscsi_iface            = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.iser_use_multipath     = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.live_migration_bandwidth = 0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.live_migration_downtime = 500 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.live_migration_inbound_addr = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.live_migration_permit_post_copy = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.live_migration_scheme  = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.live_migration_timeout_action = abort {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.live_migration_tunnelled = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: WARNING oslo_config.cfg [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Dec 01 17:01:33 user nova-compute[75745]: live_migration_uri is deprecated for removal in favor of two other options that
Dec 01 17:01:33 user nova-compute[75745]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Dec 01 17:01:33 user nova-compute[75745]: and ``live_migration_inbound_addr`` respectively.
Dec 01 17:01:33 user nova-compute[75745]: ).  Its value may be silently ignored in the future.
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.live_migration_with_native_tls = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.max_queues             = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.nfs_mount_options      = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.num_memory_encrypted_guests = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.num_pcie_ports         = 0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.pmem_namespaces        = [] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.quobyte_client_cfg     = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.rbd_secret_uuid        = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.rbd_user               = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.remote_filesystem_transport = ssh {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.rescue_image_id        = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.rescue_kernel_id       = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.rescue_ramdisk_id      = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.rx_queue_size          = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.smbfs_mount_options    =  {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.snapshot_compression   = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.snapshot_image_format  = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.sparse_logical_volumes = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.swtpm_enabled          = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.swtpm_group            = tss {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.swtpm_user             = tss {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.sysinfo_serial         = unique {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.tb_cache_size          = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.tx_queue_size          = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.uid_maps               = [] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.use_virtio_for_bridges = True {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.virt_type              = kvm {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.volume_clear           = zero {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.volume_clear_size      = 0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.volume_use_multipath   = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.vzstorage_cache_path   = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.vzstorage_mount_user   = stack {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] neutron.auth_section           = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] neutron.auth_type              = password {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] neutron.cafile                 = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] neutron.certfile               = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] neutron.collect_timing         = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] neutron.connect_retries        = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] neutron.connect_retry_delay    = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] neutron.default_floating_pool  = public {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] neutron.endpoint_override      = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] neutron.extension_sync_interval = 600 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] neutron.http_retries           = 3 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] neutron.insecure               = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] neutron.keyfile                = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] neutron.max_version            = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] neutron.min_version            = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] neutron.ovs_bridge             = br-int {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] neutron.physnets               = [] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] neutron.region_name            = RegionOne {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] neutron.service_metadata_proxy = True {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] neutron.service_name           = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] neutron.service_type           = network {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] neutron.split_loggers          = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] neutron.status_code_retries    = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] neutron.status_code_retry_delay = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] neutron.timeout                = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] neutron.version                = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] notifications.bdms_in_notifications = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] notifications.default_level    = INFO {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] notifications.notification_format = unversioned {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] notifications.notify_on_state_change = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] pci.alias                      = [] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] pci.device_spec                = [] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] pci.report_in_placement        = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.auth_section         = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.auth_type            = password {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.cafile               = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.certfile             = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.collect_timing       = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.connect_retries      = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.connect_retry_delay  = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.default_domain_id    = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.default_domain_name  = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.domain_id            = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.domain_name          = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.endpoint_override    = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.insecure             = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.keyfile              = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.max_version          = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.min_version          = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.password             = **** {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.project_domain_id    = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.project_domain_name  = Default {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.project_id           = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.project_name         = service {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.region_name          = RegionOne {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.service_name         = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.service_type         = placement {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.split_loggers        = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.status_code_retries  = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.status_code_retry_delay = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.system_scope         = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.timeout              = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.trust_id             = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.user_domain_id       = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.user_domain_name     = Default {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.user_id              = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.username             = placement {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] placement.version              = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] quota.cores                    = 20 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] quota.count_usage_from_placement = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] quota.injected_file_content_bytes = 10240 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] quota.injected_file_path_length = 255 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] quota.injected_files           = 5 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] quota.instances                = 10 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] quota.key_pairs                = 100 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] quota.metadata_items           = 128 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] quota.ram                      = 51200 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] quota.recheck_quota            = True {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] quota.server_group_members     = 10 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] quota.server_groups            = 10 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] rdp.enabled                    = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] scheduler.image_metadata_prefilter = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] scheduler.max_attempts         = 3 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] scheduler.max_placement_results = 1000 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] scheduler.query_placement_for_image_type_support = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] scheduler.workers              = 3 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] filter_scheduler.host_subset_size = 1 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] filter_scheduler.isolated_hosts = [] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] filter_scheduler.isolated_images = [] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] filter_scheduler.pci_in_placement = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] filter_scheduler.track_instance_changes = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] metrics.required               = True {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] metrics.weight_multiplier      = 1.0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] metrics.weight_setting         = [] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] serial_console.enabled         = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] serial_console.port_range      = 10000:20000 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] serial_console.serialproxy_port = 6083 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] service_user.auth_section      = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] service_user.auth_type         = password {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] service_user.cafile            = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] service_user.certfile          = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] service_user.collect_timing    = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] service_user.insecure          = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] service_user.keyfile           = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] service_user.send_service_user_token = True {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] service_user.split_loggers     = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] service_user.timeout           = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] spice.agent_enabled            = True {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] spice.enabled                  = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] spice.html5proxy_port          = 6082 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] spice.image_compression        = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] spice.jpeg_compression         = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] spice.playback_compression     = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] spice.server_listen            = 127.0.0.1 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] spice.streaming_mode           = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] spice.zlib_compression         = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] upgrade_levels.baseapi         = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] upgrade_levels.compute         = auto {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] upgrade_levels.conductor       = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] upgrade_levels.scheduler       = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vendordata_dynamic_auth.auth_section = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vendordata_dynamic_auth.auth_type = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vendordata_dynamic_auth.cafile = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vendordata_dynamic_auth.certfile = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vendordata_dynamic_auth.insecure = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vendordata_dynamic_auth.keyfile = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vendordata_dynamic_auth.timeout = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vmware.api_retry_count         = 10 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vmware.ca_file                 = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vmware.cache_prefix            = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vmware.cluster_name            = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vmware.connection_pool_size    = 10 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vmware.console_delay_seconds   = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vmware.datastore_regex         = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vmware.host_ip                 = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vmware.host_password           = **** {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vmware.host_port               = 443 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vmware.host_username           = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vmware.insecure                = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vmware.integration_bridge      = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vmware.maximum_objects         = 100 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vmware.pbm_default_policy      = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vmware.pbm_enabled             = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vmware.pbm_wsdl_location       = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vmware.serial_port_proxy_uri   = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vmware.serial_port_service_uri = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vmware.task_poll_interval      = 0.5 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vmware.use_linked_clone        = True {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vmware.vnc_keymap              = en-us {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vmware.vnc_port                = 5900 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vmware.vnc_port_total          = 10000 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vnc.auth_schemes               = ['none'] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vnc.enabled                    = True {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vnc.novncproxy_port            = 6080 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vnc.server_listen              = 0.0.0.0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vnc.vencrypt_ca_certs          = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vnc.vencrypt_client_cert       = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vnc.vencrypt_client_key        = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] workarounds.disable_rootwrap   = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] workarounds.enable_numa_live_migration = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] workarounds.libvirt_disable_apic = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] wsgi.client_socket_timeout     = 900 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] wsgi.default_pool_size         = 1000 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] wsgi.keep_alive                = True {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] wsgi.max_header_line           = 16384 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] wsgi.ssl_ca_file               = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] wsgi.ssl_cert_file             = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] wsgi.ssl_key_file              = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] wsgi.tcp_keepidle              = 600 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] zvm.ca_file                    = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] zvm.cloud_connector_url        = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] zvm.reachable_timeout          = 300 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_policy.enforce_new_defaults = True {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_policy.enforce_scope      = True {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_policy.policy_default_rule = default {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_policy.policy_file        = policy.yaml {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] profiler.connection_string     = messaging:// {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] profiler.enabled               = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] profiler.es_doc_type           = notification {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] profiler.es_scroll_size        = 10000 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] profiler.es_scroll_time        = 2m {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] profiler.filter_error_trace    = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] profiler.hmac_keys             = **** {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] profiler.sentinel_service_name = mymaster {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] profiler.socket_timeout        = 0.1 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] profiler.trace_requests        = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] profiler.trace_sqlalchemy      = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] profiler_jaeger.process_tags   = {} {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] profiler_jaeger.service_name_prefix = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] profiler_otlp.service_name_prefix = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] remote_debug.host              = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] remote_debug.port              = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_rabbit.ssl      = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_notifications.retry = -1 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_messaging_notifications.transport_url = **** {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_limit.auth_section        = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_limit.auth_type           = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_limit.cafile              = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_limit.certfile            = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_limit.collect_timing      = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_limit.connect_retries     = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_limit.connect_retry_delay = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_limit.endpoint_id         = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_limit.endpoint_override   = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_limit.insecure            = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_limit.keyfile             = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_limit.max_version         = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_limit.min_version         = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_limit.region_name         = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_limit.service_name        = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_limit.service_type        = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_limit.split_loggers       = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_limit.status_code_retries = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_limit.status_code_retry_delay = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_limit.timeout             = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_limit.valid_interfaces    = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_limit.version             = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_reports.file_event_handler = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] oslo_reports.log_dir           = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vif_plug_ovs_privileged.group  = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] vif_plug_ovs_privileged.user   = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] os_vif_linux_bridge.flat_interface = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] os_vif_ovs.isolate_vif         = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] os_vif_ovs.per_port_bridge     = False {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] os_brick.lock_path             = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] privsep_osbrick.capabilities   = [21] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] privsep_osbrick.group          = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] privsep_osbrick.helper_command = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] privsep_osbrick.user           = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] nova_sys_admin.group           = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] nova_sys_admin.helper_command  = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] nova_sys_admin.user            = None {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG oslo_service.service [None req-b665758a-fbd6-4fb9-8bba-6142bee598bd None None] ******************************************************************************** {{(pid=75745) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Dec 01 17:01:33 user nova-compute[75745]: INFO nova.service [-] Starting compute node (version 0.0.0)
Dec 01 17:01:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Connecting to libvirt: qemu:///system {{(pid=75745) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f24dbdf25c0> {{(pid=75745) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Dec 01 17:01:33 user nova-compute[75745]: libvirt:  error : internal error: could not initialize domain event timer
Dec 01 17:01:33 user nova-compute[75745]: WARNING nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Dec 01 17:01:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f24dbdf25c0> {{(pid=75745) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Starting native event thread {{(pid=75745) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Starting green dispatch thread {{(pid=75745) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Dec 01 17:01:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Starting connection event dispatch thread {{(pid=75745) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Dec 01 17:01:33 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Connection event '1' reason 'None'
Dec 01 17:01:33 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Dec 01 17:01:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.mount [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Initialising _HostMountState generation 0 {{(pid=75745) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Dec 01 17:01:40 user nova-compute[75745]: INFO nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Libvirt host capabilities <capabilities>
Dec 01 17:01:40 user nova-compute[75745]:   <host>
Dec 01 17:01:40 user nova-compute[75745]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Dec 01 17:01:40 user nova-compute[75745]:     <cpu>
Dec 01 17:01:40 user nova-compute[75745]:       <arch>x86_64</arch>
Dec 01 17:01:40 user nova-compute[75745]:       <model>IvyBridge-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <vendor>Intel</vendor>
Dec 01 17:01:40 user nova-compute[75745]:       <microcode version='1070'/>
Dec 01 17:01:40 user nova-compute[75745]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Dec 01 17:01:40 user nova-compute[75745]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature name='ss'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature name='vmx'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature name='pcid'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature name='osxsave'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature name='hypervisor'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature name='arat'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature name='tsc_adjust'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature name='md-clear'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature name='stibp'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature name='arch-capabilities'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature name='ssbd'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature name='invtsc'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature name='rsba'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature name='skip-l1dfl-vmentry'/>
Dec 01 17:01:40 user nova-compute[75745]:       <pages unit='KiB' size='4'/>
Dec 01 17:01:40 user nova-compute[75745]:       <pages unit='KiB' size='2048'/>
Dec 01 17:01:40 user nova-compute[75745]:     </cpu>
Dec 01 17:01:40 user nova-compute[75745]:     <power_management>
Dec 01 17:01:40 user nova-compute[75745]:       <suspend_mem/>
Dec 01 17:01:40 user nova-compute[75745]:       <suspend_disk/>
Dec 01 17:01:40 user nova-compute[75745]:       <suspend_hybrid/>
Dec 01 17:01:40 user nova-compute[75745]:     </power_management>
Dec 01 17:01:40 user nova-compute[75745]:     <iommu support='no'/>
Dec 01 17:01:40 user nova-compute[75745]:     <migration_features>
Dec 01 17:01:40 user nova-compute[75745]:       <live/>
Dec 01 17:01:40 user nova-compute[75745]:       <uri_transports>
Dec 01 17:01:40 user nova-compute[75745]:         <uri_transport>tcp</uri_transport>
Dec 01 17:01:40 user nova-compute[75745]:         <uri_transport>rdma</uri_transport>
Dec 01 17:01:40 user nova-compute[75745]:       </uri_transports>
Dec 01 17:01:40 user nova-compute[75745]:     </migration_features>
Dec 01 17:01:40 user nova-compute[75745]:     <topology>
Dec 01 17:01:40 user nova-compute[75745]:       <cells num='2'>
Dec 01 17:01:40 user nova-compute[75745]:         <cell id='0'>
Dec 01 17:01:40 user nova-compute[75745]:           <memory unit='KiB'>8189224</memory>
Dec 01 17:01:40 user nova-compute[75745]:           <pages unit='KiB' size='4'>2047306</pages>
Dec 01 17:01:40 user nova-compute[75745]:           <pages unit='KiB' size='2048'>0</pages>
Dec 01 17:01:40 user nova-compute[75745]:           <distances>
Dec 01 17:01:40 user nova-compute[75745]:             <sibling id='0' value='10'/>
Dec 01 17:01:40 user nova-compute[75745]:             <sibling id='1' value='20'/>
Dec 01 17:01:40 user nova-compute[75745]:           </distances>
Dec 01 17:01:40 user nova-compute[75745]:           <cpus num='6'>
Dec 01 17:01:40 user nova-compute[75745]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Dec 01 17:01:40 user nova-compute[75745]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Dec 01 17:01:40 user nova-compute[75745]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Dec 01 17:01:40 user nova-compute[75745]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Dec 01 17:01:40 user nova-compute[75745]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Dec 01 17:01:40 user nova-compute[75745]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Dec 01 17:01:40 user nova-compute[75745]:           </cpus>
Dec 01 17:01:40 user nova-compute[75745]:         </cell>
Dec 01 17:01:40 user nova-compute[75745]:         <cell id='1'>
Dec 01 17:01:40 user nova-compute[75745]:           <memory unit='KiB'>8206460</memory>
Dec 01 17:01:40 user nova-compute[75745]:           <pages unit='KiB' size='4'>2051615</pages>
Dec 01 17:01:40 user nova-compute[75745]:           <pages unit='KiB' size='2048'>0</pages>
Dec 01 17:01:40 user nova-compute[75745]:           <distances>
Dec 01 17:01:40 user nova-compute[75745]:             <sibling id='0' value='20'/>
Dec 01 17:01:40 user nova-compute[75745]:             <sibling id='1' value='10'/>
Dec 01 17:01:40 user nova-compute[75745]:           </distances>
Dec 01 17:01:40 user nova-compute[75745]:           <cpus num='6'>
Dec 01 17:01:40 user nova-compute[75745]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Dec 01 17:01:40 user nova-compute[75745]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Dec 01 17:01:40 user nova-compute[75745]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Dec 01 17:01:40 user nova-compute[75745]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Dec 01 17:01:40 user nova-compute[75745]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Dec 01 17:01:40 user nova-compute[75745]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Dec 01 17:01:40 user nova-compute[75745]:           </cpus>
Dec 01 17:01:40 user nova-compute[75745]:         </cell>
Dec 01 17:01:40 user nova-compute[75745]:       </cells>
Dec 01 17:01:40 user nova-compute[75745]:     </topology>
Dec 01 17:01:40 user nova-compute[75745]:     <cache>
Dec 01 17:01:40 user nova-compute[75745]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Dec 01 17:01:40 user nova-compute[75745]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Dec 01 17:01:40 user nova-compute[75745]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Dec 01 17:01:40 user nova-compute[75745]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Dec 01 17:01:40 user nova-compute[75745]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Dec 01 17:01:40 user nova-compute[75745]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Dec 01 17:01:40 user nova-compute[75745]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Dec 01 17:01:40 user nova-compute[75745]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Dec 01 17:01:40 user nova-compute[75745]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Dec 01 17:01:40 user nova-compute[75745]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Dec 01 17:01:40 user nova-compute[75745]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Dec 01 17:01:40 user nova-compute[75745]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Dec 01 17:01:40 user nova-compute[75745]:     </cache>
Dec 01 17:01:40 user nova-compute[75745]:     <secmodel>
Dec 01 17:01:40 user nova-compute[75745]:       <model>apparmor</model>
Dec 01 17:01:40 user nova-compute[75745]:       <doi>0</doi>
Dec 01 17:01:40 user nova-compute[75745]:     </secmodel>
Dec 01 17:01:40 user nova-compute[75745]:     <secmodel>
Dec 01 17:01:40 user nova-compute[75745]:       <model>dac</model>
Dec 01 17:01:40 user nova-compute[75745]:       <doi>0</doi>
Dec 01 17:01:40 user nova-compute[75745]:       <baselabel type='kvm'>+64055:+108</baselabel>
Dec 01 17:01:40 user nova-compute[75745]:       <baselabel type='qemu'>+64055:+108</baselabel>
Dec 01 17:01:40 user nova-compute[75745]:     </secmodel>
Dec 01 17:01:40 user nova-compute[75745]:   </host>
Dec 01 17:01:40 user nova-compute[75745]:   <guest>
Dec 01 17:01:40 user nova-compute[75745]:     <os_type>hvm</os_type>
Dec 01 17:01:40 user nova-compute[75745]:     <arch name='alpha'>
Dec 01 17:01:40 user nova-compute[75745]:       <wordsize>64</wordsize>
Dec 01 17:01:40 user nova-compute[75745]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='4'>clipper</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <domain type='qemu'/>
Dec 01 17:01:40 user nova-compute[75745]:     </arch>
Dec 01 17:01:40 user nova-compute[75745]:     <features>
Dec 01 17:01:40 user nova-compute[75745]:       <cpuselection/>
Dec 01 17:01:40 user nova-compute[75745]:       <deviceboot/>
Dec 01 17:01:40 user nova-compute[75745]:       <disksnapshot default='on' toggle='no'/>
Dec 01 17:01:40 user nova-compute[75745]:     </features>
Dec 01 17:01:40 user nova-compute[75745]:   </guest>
Dec 01 17:01:40 user nova-compute[75745]:   <guest>
Dec 01 17:01:40 user nova-compute[75745]:     <os_type>hvm</os_type>
Dec 01 17:01:40 user nova-compute[75745]:     <arch name='armv6l'>
Dec 01 17:01:40 user nova-compute[75745]:       <wordsize>32</wordsize>
Dec 01 17:01:40 user nova-compute[75745]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>integratorcp</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>ast2600-evb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>borzoi</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>spitz</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>virt-2.7</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>nuri</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>romulus-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='512'>virt-3.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='512'>virt-5.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>npcm750-evb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>virt-2.10</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>rainier-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>mps3-an547</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>musca-b1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>versatileab</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>kzm</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>virt-2.8</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>musca-a</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='512'>virt-3.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='512'>virt-5.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>smdkc210</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>sx1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>virt-2.11</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>imx25-pdk</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>virt-2.9</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='4'>orangepi-pc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>z2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='512'>virt-5.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>tosa</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>mps2-an500</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>virt-2.12</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>mps2-an521</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='4'>sabrelite</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>mps2-an511</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>canon-a1100</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>realview-eb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>emcraft-sf2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>realview-pb-a8</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='512'>virt-4.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>raspi1ap</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>palmetto-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>sx1-v1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>n810</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>g220a-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>n800</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>tacoma-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='512'>virt-4.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>quanta-gsj</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>versatilepb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>terrier</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>mainstone</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='512'>virt-4.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>mps3-an524</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>kudo-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='4'>vexpress-a9</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='4'>midway</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>musicpal</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>lm3s811evb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>lm3s6965evb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>microbit</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>mps2-an505</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>mps2-an385</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='512'>virt-6.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>cubieboard</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>verdex</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>netduino2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>mps2-an386</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='512'>virt-6.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='4'>raspi2b</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='4'>vexpress-a15</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>fuji-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='512'>virt-6.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>cheetah</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>virt-2.6</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>ast2500-evb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='4'>highbank</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>akita</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>connex</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>netduinoplus2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>collie</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>raspi0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <domain type='qemu'/>
Dec 01 17:01:40 user nova-compute[75745]:     </arch>
Dec 01 17:01:40 user nova-compute[75745]:     <features>
Dec 01 17:01:40 user nova-compute[75745]:       <cpuselection/>
Dec 01 17:01:40 user nova-compute[75745]:       <deviceboot/>
Dec 01 17:01:40 user nova-compute[75745]:       <disksnapshot default='on' toggle='no'/>
Dec 01 17:01:40 user nova-compute[75745]:     </features>
Dec 01 17:01:40 user nova-compute[75745]:   </guest>
Dec 01 17:01:40 user nova-compute[75745]:   <guest>
Dec 01 17:01:40 user nova-compute[75745]:     <os_type>hvm</os_type>
Dec 01 17:01:40 user nova-compute[75745]:     <arch name='armv7l'>
Dec 01 17:01:40 user nova-compute[75745]:       <wordsize>32</wordsize>
Dec 01 17:01:40 user nova-compute[75745]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>integratorcp</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>ast2600-evb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>borzoi</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>spitz</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>virt-2.7</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>nuri</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>romulus-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='512'>virt-3.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='512'>virt-5.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>npcm750-evb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>virt-2.10</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>rainier-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>mps3-an547</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>musca-b1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>versatileab</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>kzm</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>virt-2.8</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>musca-a</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='512'>virt-3.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='512'>virt-5.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>smdkc210</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>sx1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>virt-2.11</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>imx25-pdk</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>virt-2.9</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='4'>orangepi-pc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>z2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='512'>virt-5.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>tosa</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>mps2-an500</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>virt-2.12</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>mps2-an521</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='4'>sabrelite</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>mps2-an511</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>canon-a1100</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>realview-eb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>emcraft-sf2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>realview-pb-a8</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='512'>virt-4.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>raspi1ap</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>palmetto-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>sx1-v1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>n810</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>g220a-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>n800</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>tacoma-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='512'>virt-4.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>quanta-gsj</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>versatilepb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>terrier</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>mainstone</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='512'>virt-4.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>mps3-an524</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>kudo-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='4'>vexpress-a9</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='4'>midway</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>musicpal</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>lm3s811evb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>lm3s6965evb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>microbit</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>mps2-an505</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>mps2-an385</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='512'>virt-6.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>cubieboard</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>verdex</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>netduino2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>mps2-an386</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='512'>virt-6.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='4'>raspi2b</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='4'>vexpress-a15</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>fuji-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='512'>virt-6.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>cheetah</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>virt-2.6</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>ast2500-evb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='4'>highbank</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>akita</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>connex</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>netduinoplus2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>collie</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>raspi0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <domain type='qemu'/>
Dec 01 17:01:40 user nova-compute[75745]:     </arch>
Dec 01 17:01:40 user nova-compute[75745]:     <features>
Dec 01 17:01:40 user nova-compute[75745]:       <cpuselection/>
Dec 01 17:01:40 user nova-compute[75745]:       <deviceboot/>
Dec 01 17:01:40 user nova-compute[75745]:       <disksnapshot default='on' toggle='no'/>
Dec 01 17:01:40 user nova-compute[75745]:     </features>
Dec 01 17:01:40 user nova-compute[75745]:   </guest>
Dec 01 17:01:40 user nova-compute[75745]:   <guest>
Dec 01 17:01:40 user nova-compute[75745]:     <os_type>hvm</os_type>
Dec 01 17:01:40 user nova-compute[75745]:     <arch name='aarch64'>
Dec 01 17:01:40 user nova-compute[75745]:       <wordsize>64</wordsize>
Dec 01 17:01:40 user nova-compute[75745]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>integratorcp</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>ast2600-evb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>borzoi</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>spitz</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>virt-2.7</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>nuri</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>romulus-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='512'>virt-3.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='512'>virt-5.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>npcm750-evb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>virt-2.10</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>rainier-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>mps3-an547</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>virt-2.8</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>musca-b1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>versatileab</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>kzm</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>musca-a</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='512'>virt-3.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='512'>virt-5.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>smdkc210</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>sx1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>virt-2.11</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>imx25-pdk</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>virt-2.9</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='4'>orangepi-pc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>z2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='512'>virt-5.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>tosa</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>mps2-an500</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>virt-2.12</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>mps2-an521</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='4'>sabrelite</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>mps2-an511</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>canon-a1100</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>realview-eb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>emcraft-sf2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>realview-pb-a8</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='512'>sbsa-ref</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='512'>virt-4.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>raspi1ap</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>palmetto-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>sx1-v1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>n810</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>g220a-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>n800</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>tacoma-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='512'>virt-4.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>quanta-gsj</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>versatilepb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>terrier</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>mainstone</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='512'>virt-4.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>mps3-an524</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>kudo-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='4'>vexpress-a9</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='4'>midway</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>musicpal</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>lm3s811evb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>lm3s6965evb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>microbit</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>mps2-an505</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>mps2-an385</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='512'>virt-6.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='4'>raspi3ap</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>cubieboard</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>verdex</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>netduino2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>mps2-an386</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='512'>virt-6.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='4'>raspi3b</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='4'>raspi2b</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='4'>vexpress-a15</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2'>fuji-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='512'>virt-6.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>cheetah</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>virt-2.6</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>ast2500-evb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='4'>highbank</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>akita</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>connex</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>netduinoplus2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>collie</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>raspi0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <domain type='qemu'/>
Dec 01 17:01:40 user nova-compute[75745]:     </arch>
Dec 01 17:01:40 user nova-compute[75745]:     <features>
Dec 01 17:01:40 user nova-compute[75745]:       <acpi default='on' toggle='yes'/>
Dec 01 17:01:40 user nova-compute[75745]:       <cpuselection/>
Dec 01 17:01:40 user nova-compute[75745]:       <deviceboot/>
Dec 01 17:01:40 user nova-compute[75745]:       <disksnapshot default='on' toggle='no'/>
Dec 01 17:01:40 user nova-compute[75745]:     </features>
Dec 01 17:01:40 user nova-compute[75745]:   </guest>
Dec 01 17:01:40 user nova-compute[75745]:   <guest>
Dec 01 17:01:40 user nova-compute[75745]:     <os_type>hvm</os_type>
Dec 01 17:01:40 user nova-compute[75745]:     <arch name='cris'>
Dec 01 17:01:40 user nova-compute[75745]:       <wordsize>32</wordsize>
Dec 01 17:01:40 user nova-compute[75745]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>axis-dev88</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <domain type='qemu'/>
Dec 01 17:01:40 user nova-compute[75745]:     </arch>
Dec 01 17:01:40 user nova-compute[75745]:     <features>
Dec 01 17:01:40 user nova-compute[75745]:       <cpuselection/>
Dec 01 17:01:40 user nova-compute[75745]:       <deviceboot/>
Dec 01 17:01:40 user nova-compute[75745]:       <disksnapshot default='on' toggle='no'/>
Dec 01 17:01:40 user nova-compute[75745]:     </features>
Dec 01 17:01:40 user nova-compute[75745]:   </guest>
Dec 01 17:01:40 user nova-compute[75745]:   <guest>
Dec 01 17:01:40 user nova-compute[75745]:     <os_type>hvm</os_type>
Dec 01 17:01:40 user nova-compute[75745]:     <arch name='i686'>
Dec 01 17:01:40 user nova-compute[75745]:       <wordsize>32</wordsize>
Dec 01 17:01:40 user nova-compute[75745]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-artful</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>x-remote</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>isapc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-disco</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-impish</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-focal</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>microvm</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <domain type='qemu'/>
Dec 01 17:01:40 user nova-compute[75745]:       <domain type='kvm'/>
Dec 01 17:01:40 user nova-compute[75745]:     </arch>
Dec 01 17:01:40 user nova-compute[75745]:     <features>
Dec 01 17:01:40 user nova-compute[75745]:       <pae/>
Dec 01 17:01:40 user nova-compute[75745]:       <nonpae/>
Dec 01 17:01:40 user nova-compute[75745]:       <acpi default='on' toggle='yes'/>
Dec 01 17:01:40 user nova-compute[75745]:       <apic default='on' toggle='no'/>
Dec 01 17:01:40 user nova-compute[75745]:       <cpuselection/>
Dec 01 17:01:40 user nova-compute[75745]:       <deviceboot/>
Dec 01 17:01:40 user nova-compute[75745]:       <disksnapshot default='on' toggle='no'/>
Dec 01 17:01:40 user nova-compute[75745]:     </features>
Dec 01 17:01:40 user nova-compute[75745]:   </guest>
Dec 01 17:01:40 user nova-compute[75745]:   <guest>
Dec 01 17:01:40 user nova-compute[75745]:     <os_type>hvm</os_type>
Dec 01 17:01:40 user nova-compute[75745]:     <arch name='m68k'>
Dec 01 17:01:40 user nova-compute[75745]:       <wordsize>32</wordsize>
Dec 01 17:01:40 user nova-compute[75745]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>mcf5208evb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>an5206</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>virt-6.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>q800</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>virt-6.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>next-cube</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>virt-6.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <domain type='qemu'/>
Dec 01 17:01:40 user nova-compute[75745]:     </arch>
Dec 01 17:01:40 user nova-compute[75745]:     <features>
Dec 01 17:01:40 user nova-compute[75745]:       <cpuselection/>
Dec 01 17:01:40 user nova-compute[75745]:       <deviceboot/>
Dec 01 17:01:40 user nova-compute[75745]:       <disksnapshot default='on' toggle='no'/>
Dec 01 17:01:40 user nova-compute[75745]:     </features>
Dec 01 17:01:40 user nova-compute[75745]:   </guest>
Dec 01 17:01:40 user nova-compute[75745]:   <guest>
Dec 01 17:01:40 user nova-compute[75745]:     <os_type>hvm</os_type>
Dec 01 17:01:40 user nova-compute[75745]:     <arch name='microblaze'>
Dec 01 17:01:40 user nova-compute[75745]:       <wordsize>32</wordsize>
Dec 01 17:01:40 user nova-compute[75745]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>petalogix-ml605</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <domain type='qemu'/>
Dec 01 17:01:40 user nova-compute[75745]:     </arch>
Dec 01 17:01:40 user nova-compute[75745]:     <features>
Dec 01 17:01:40 user nova-compute[75745]:       <cpuselection/>
Dec 01 17:01:40 user nova-compute[75745]:       <deviceboot/>
Dec 01 17:01:40 user nova-compute[75745]:       <disksnapshot default='on' toggle='no'/>
Dec 01 17:01:40 user nova-compute[75745]:     </features>
Dec 01 17:01:40 user nova-compute[75745]:   </guest>
Dec 01 17:01:40 user nova-compute[75745]:   <guest>
Dec 01 17:01:40 user nova-compute[75745]:     <os_type>hvm</os_type>
Dec 01 17:01:40 user nova-compute[75745]:     <arch name='microblazeel'>
Dec 01 17:01:40 user nova-compute[75745]:       <wordsize>32</wordsize>
Dec 01 17:01:40 user nova-compute[75745]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>petalogix-ml605</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <domain type='qemu'/>
Dec 01 17:01:40 user nova-compute[75745]:     </arch>
Dec 01 17:01:40 user nova-compute[75745]:     <features>
Dec 01 17:01:40 user nova-compute[75745]:       <cpuselection/>
Dec 01 17:01:40 user nova-compute[75745]:       <deviceboot/>
Dec 01 17:01:40 user nova-compute[75745]:       <disksnapshot default='on' toggle='no'/>
Dec 01 17:01:40 user nova-compute[75745]:     </features>
Dec 01 17:01:40 user nova-compute[75745]:   </guest>
Dec 01 17:01:40 user nova-compute[75745]:   <guest>
Dec 01 17:01:40 user nova-compute[75745]:     <os_type>hvm</os_type>
Dec 01 17:01:40 user nova-compute[75745]:     <arch name='mips'>
Dec 01 17:01:40 user nova-compute[75745]:       <wordsize>32</wordsize>
Dec 01 17:01:40 user nova-compute[75745]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='16'>malta</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>mipssim</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <domain type='qemu'/>
Dec 01 17:01:40 user nova-compute[75745]:     </arch>
Dec 01 17:01:40 user nova-compute[75745]:     <features>
Dec 01 17:01:40 user nova-compute[75745]:       <cpuselection/>
Dec 01 17:01:40 user nova-compute[75745]:       <deviceboot/>
Dec 01 17:01:40 user nova-compute[75745]:       <disksnapshot default='on' toggle='no'/>
Dec 01 17:01:40 user nova-compute[75745]:     </features>
Dec 01 17:01:40 user nova-compute[75745]:   </guest>
Dec 01 17:01:40 user nova-compute[75745]:   <guest>
Dec 01 17:01:40 user nova-compute[75745]:     <os_type>hvm</os_type>
Dec 01 17:01:40 user nova-compute[75745]:     <arch name='mipsel'>
Dec 01 17:01:40 user nova-compute[75745]:       <wordsize>32</wordsize>
Dec 01 17:01:40 user nova-compute[75745]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='16'>malta</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>mipssim</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <domain type='qemu'/>
Dec 01 17:01:40 user nova-compute[75745]:     </arch>
Dec 01 17:01:40 user nova-compute[75745]:     <features>
Dec 01 17:01:40 user nova-compute[75745]:       <cpuselection/>
Dec 01 17:01:40 user nova-compute[75745]:       <deviceboot/>
Dec 01 17:01:40 user nova-compute[75745]:       <disksnapshot default='on' toggle='no'/>
Dec 01 17:01:40 user nova-compute[75745]:     </features>
Dec 01 17:01:40 user nova-compute[75745]:   </guest>
Dec 01 17:01:40 user nova-compute[75745]:   <guest>
Dec 01 17:01:40 user nova-compute[75745]:     <os_type>hvm</os_type>
Dec 01 17:01:40 user nova-compute[75745]:     <arch name='mips64'>
Dec 01 17:01:40 user nova-compute[75745]:       <wordsize>64</wordsize>
Dec 01 17:01:40 user nova-compute[75745]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='16'>malta</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>mipssim</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>pica61</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>magnum</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <domain type='qemu'/>
Dec 01 17:01:40 user nova-compute[75745]:     </arch>
Dec 01 17:01:40 user nova-compute[75745]:     <features>
Dec 01 17:01:40 user nova-compute[75745]:       <cpuselection/>
Dec 01 17:01:40 user nova-compute[75745]:       <deviceboot/>
Dec 01 17:01:40 user nova-compute[75745]:       <disksnapshot default='on' toggle='no'/>
Dec 01 17:01:40 user nova-compute[75745]:     </features>
Dec 01 17:01:40 user nova-compute[75745]:   </guest>
Dec 01 17:01:40 user nova-compute[75745]:   <guest>
Dec 01 17:01:40 user nova-compute[75745]:     <os_type>hvm</os_type>
Dec 01 17:01:40 user nova-compute[75745]:     <arch name='mips64el'>
Dec 01 17:01:40 user nova-compute[75745]:       <wordsize>64</wordsize>
Dec 01 17:01:40 user nova-compute[75745]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='16'>malta</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='16'>loongson3-virt</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>mipssim</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>pica61</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>magnum</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='16'>boston</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>fuloong2e</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <domain type='qemu'/>
Dec 01 17:01:40 user nova-compute[75745]:     </arch>
Dec 01 17:01:40 user nova-compute[75745]:     <features>
Dec 01 17:01:40 user nova-compute[75745]:       <cpuselection/>
Dec 01 17:01:40 user nova-compute[75745]:       <deviceboot/>
Dec 01 17:01:40 user nova-compute[75745]:       <disksnapshot default='on' toggle='no'/>
Dec 01 17:01:40 user nova-compute[75745]:     </features>
Dec 01 17:01:40 user nova-compute[75745]:   </guest>
Dec 01 17:01:40 user nova-compute[75745]:   <guest>
Dec 01 17:01:40 user nova-compute[75745]:     <os_type>hvm</os_type>
Dec 01 17:01:40 user nova-compute[75745]:     <arch name='ppc'>
Dec 01 17:01:40 user nova-compute[75745]:       <wordsize>32</wordsize>
Dec 01 17:01:40 user nova-compute[75745]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>g3beige</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>virtex-ml507</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>mac99</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='32'>ppce500</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>pegasos2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>sam460ex</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>bamboo</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>40p</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>ref405ep</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='15'>mpc8544ds</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>taihu</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <domain type='qemu'/>
Dec 01 17:01:40 user nova-compute[75745]:     </arch>
Dec 01 17:01:40 user nova-compute[75745]:     <features>
Dec 01 17:01:40 user nova-compute[75745]:       <cpuselection/>
Dec 01 17:01:40 user nova-compute[75745]:       <deviceboot/>
Dec 01 17:01:40 user nova-compute[75745]:       <disksnapshot default='on' toggle='no'/>
Dec 01 17:01:40 user nova-compute[75745]:     </features>
Dec 01 17:01:40 user nova-compute[75745]:   </guest>
Dec 01 17:01:40 user nova-compute[75745]:   <guest>
Dec 01 17:01:40 user nova-compute[75745]:     <os_type>hvm</os_type>
Dec 01 17:01:40 user nova-compute[75745]:     <arch name='ppc64'>
Dec 01 17:01:40 user nova-compute[75745]:       <wordsize>64</wordsize>
Dec 01 17:01:40 user nova-compute[75745]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2048'>powernv9</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>taihu</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='15'>mpc8544ds</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2048'>powernv10</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='32'>ppce500</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>40p</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>pegasos2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>bamboo</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>g3beige</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>virtex-ml507</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>mac99</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>sam460ex</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>ref405ep</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2048'>powernv8</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <domain type='qemu'/>
Dec 01 17:01:40 user nova-compute[75745]:     </arch>
Dec 01 17:01:40 user nova-compute[75745]:     <features>
Dec 01 17:01:40 user nova-compute[75745]:       <cpuselection/>
Dec 01 17:01:40 user nova-compute[75745]:       <deviceboot/>
Dec 01 17:01:40 user nova-compute[75745]:       <disksnapshot default='on' toggle='no'/>
Dec 01 17:01:40 user nova-compute[75745]:     </features>
Dec 01 17:01:40 user nova-compute[75745]:   </guest>
Dec 01 17:01:40 user nova-compute[75745]:   <guest>
Dec 01 17:01:40 user nova-compute[75745]:     <os_type>hvm</os_type>
Dec 01 17:01:40 user nova-compute[75745]:     <arch name='ppc64le'>
Dec 01 17:01:40 user nova-compute[75745]:       <wordsize>64</wordsize>
Dec 01 17:01:40 user nova-compute[75745]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2048'>powernv9</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>taihu</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='15'>mpc8544ds</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2048'>powernv10</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='32'>ppce500</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>40p</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>pegasos2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>bamboo</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>g3beige</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>virtex-ml507</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>mac99</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>sam460ex</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>ref405ep</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2048'>powernv8</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <domain type='qemu'/>
Dec 01 17:01:40 user nova-compute[75745]:     </arch>
Dec 01 17:01:40 user nova-compute[75745]:     <features>
Dec 01 17:01:40 user nova-compute[75745]:       <cpuselection/>
Dec 01 17:01:40 user nova-compute[75745]:       <deviceboot/>
Dec 01 17:01:40 user nova-compute[75745]:       <disksnapshot default='on' toggle='no'/>
Dec 01 17:01:40 user nova-compute[75745]:     </features>
Dec 01 17:01:40 user nova-compute[75745]:   </guest>
Dec 01 17:01:40 user nova-compute[75745]:   <guest>
Dec 01 17:01:40 user nova-compute[75745]:     <os_type>hvm</os_type>
Dec 01 17:01:40 user nova-compute[75745]:     <arch name='riscv32'>
Dec 01 17:01:40 user nova-compute[75745]:       <wordsize>32</wordsize>
Dec 01 17:01:40 user nova-compute[75745]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='8'>spike</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>opentitan</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='5'>sifive_u</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>sifive_e</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='8'>virt</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <domain type='qemu'/>
Dec 01 17:01:40 user nova-compute[75745]:     </arch>
Dec 01 17:01:40 user nova-compute[75745]:     <features>
Dec 01 17:01:40 user nova-compute[75745]:       <cpuselection/>
Dec 01 17:01:40 user nova-compute[75745]:       <deviceboot/>
Dec 01 17:01:40 user nova-compute[75745]:       <disksnapshot default='on' toggle='no'/>
Dec 01 17:01:40 user nova-compute[75745]:     </features>
Dec 01 17:01:40 user nova-compute[75745]:   </guest>
Dec 01 17:01:40 user nova-compute[75745]:   <guest>
Dec 01 17:01:40 user nova-compute[75745]:     <os_type>hvm</os_type>
Dec 01 17:01:40 user nova-compute[75745]:     <arch name='riscv64'>
Dec 01 17:01:40 user nova-compute[75745]:       <wordsize>64</wordsize>
Dec 01 17:01:40 user nova-compute[75745]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='8'>spike</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='5'>sifive_u</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>shakti_c</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>sifive_e</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='8'>virt</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <domain type='qemu'/>
Dec 01 17:01:40 user nova-compute[75745]:     </arch>
Dec 01 17:01:40 user nova-compute[75745]:     <features>
Dec 01 17:01:40 user nova-compute[75745]:       <cpuselection/>
Dec 01 17:01:40 user nova-compute[75745]:       <deviceboot/>
Dec 01 17:01:40 user nova-compute[75745]:       <disksnapshot default='on' toggle='no'/>
Dec 01 17:01:40 user nova-compute[75745]:     </features>
Dec 01 17:01:40 user nova-compute[75745]:   </guest>
Dec 01 17:01:40 user nova-compute[75745]:   <guest>
Dec 01 17:01:40 user nova-compute[75745]:     <os_type>hvm</os_type>
Dec 01 17:01:40 user nova-compute[75745]:     <arch name='s390x'>
Dec 01 17:01:40 user nova-compute[75745]:       <wordsize>64</wordsize>
Dec 01 17:01:40 user nova-compute[75745]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <domain type='qemu'/>
Dec 01 17:01:40 user nova-compute[75745]:     </arch>
Dec 01 17:01:40 user nova-compute[75745]:     <features>
Dec 01 17:01:40 user nova-compute[75745]:       <cpuselection/>
Dec 01 17:01:40 user nova-compute[75745]:       <deviceboot/>
Dec 01 17:01:40 user nova-compute[75745]:       <disksnapshot default='on' toggle='no'/>
Dec 01 17:01:40 user nova-compute[75745]:     </features>
Dec 01 17:01:40 user nova-compute[75745]:   </guest>
Dec 01 17:01:40 user nova-compute[75745]:   <guest>
Dec 01 17:01:40 user nova-compute[75745]:     <os_type>hvm</os_type>
Dec 01 17:01:40 user nova-compute[75745]:     <arch name='sh4'>
Dec 01 17:01:40 user nova-compute[75745]:       <wordsize>32</wordsize>
Dec 01 17:01:40 user nova-compute[75745]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>shix</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>r2d</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <domain type='qemu'/>
Dec 01 17:01:40 user nova-compute[75745]:     </arch>
Dec 01 17:01:40 user nova-compute[75745]:     <features>
Dec 01 17:01:40 user nova-compute[75745]:       <cpuselection/>
Dec 01 17:01:40 user nova-compute[75745]:       <deviceboot/>
Dec 01 17:01:40 user nova-compute[75745]:       <disksnapshot default='on' toggle='no'/>
Dec 01 17:01:40 user nova-compute[75745]:     </features>
Dec 01 17:01:40 user nova-compute[75745]:   </guest>
Dec 01 17:01:40 user nova-compute[75745]:   <guest>
Dec 01 17:01:40 user nova-compute[75745]:     <os_type>hvm</os_type>
Dec 01 17:01:40 user nova-compute[75745]:     <arch name='sh4eb'>
Dec 01 17:01:40 user nova-compute[75745]:       <wordsize>64</wordsize>
Dec 01 17:01:40 user nova-compute[75745]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>shix</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>r2d</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <domain type='qemu'/>
Dec 01 17:01:40 user nova-compute[75745]:     </arch>
Dec 01 17:01:40 user nova-compute[75745]:     <features>
Dec 01 17:01:40 user nova-compute[75745]:       <cpuselection/>
Dec 01 17:01:40 user nova-compute[75745]:       <deviceboot/>
Dec 01 17:01:40 user nova-compute[75745]:       <disksnapshot default='on' toggle='no'/>
Dec 01 17:01:40 user nova-compute[75745]:     </features>
Dec 01 17:01:40 user nova-compute[75745]:   </guest>
Dec 01 17:01:40 user nova-compute[75745]:   <guest>
Dec 01 17:01:40 user nova-compute[75745]:     <os_type>hvm</os_type>
Dec 01 17:01:40 user nova-compute[75745]:     <arch name='sparc'>
Dec 01 17:01:40 user nova-compute[75745]:       <wordsize>32</wordsize>
Dec 01 17:01:40 user nova-compute[75745]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>SS-5</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='4'>SS-20</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>LX</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>SPARCClassic</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>leon3_generic</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>SPARCbook</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>SS-4</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='4'>SS-600MP</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='4'>SS-10</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>Voyager</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <domain type='qemu'/>
Dec 01 17:01:40 user nova-compute[75745]:     </arch>
Dec 01 17:01:40 user nova-compute[75745]:     <features>
Dec 01 17:01:40 user nova-compute[75745]:       <cpuselection/>
Dec 01 17:01:40 user nova-compute[75745]:       <deviceboot/>
Dec 01 17:01:40 user nova-compute[75745]:       <disksnapshot default='on' toggle='no'/>
Dec 01 17:01:40 user nova-compute[75745]:     </features>
Dec 01 17:01:40 user nova-compute[75745]:   </guest>
Dec 01 17:01:40 user nova-compute[75745]:   <guest>
Dec 01 17:01:40 user nova-compute[75745]:     <os_type>hvm</os_type>
Dec 01 17:01:40 user nova-compute[75745]:     <arch name='sparc64'>
Dec 01 17:01:40 user nova-compute[75745]:       <wordsize>64</wordsize>
Dec 01 17:01:40 user nova-compute[75745]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>sun4u</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>niagara</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>sun4v</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <domain type='qemu'/>
Dec 01 17:01:40 user nova-compute[75745]:     </arch>
Dec 01 17:01:40 user nova-compute[75745]:     <features>
Dec 01 17:01:40 user nova-compute[75745]:       <cpuselection/>
Dec 01 17:01:40 user nova-compute[75745]:       <deviceboot/>
Dec 01 17:01:40 user nova-compute[75745]:       <disksnapshot default='on' toggle='no'/>
Dec 01 17:01:40 user nova-compute[75745]:     </features>
Dec 01 17:01:40 user nova-compute[75745]:   </guest>
Dec 01 17:01:40 user nova-compute[75745]:   <guest>
Dec 01 17:01:40 user nova-compute[75745]:     <os_type>hvm</os_type>
Dec 01 17:01:40 user nova-compute[75745]:     <arch name='x86_64'>
Dec 01 17:01:40 user nova-compute[75745]:       <wordsize>64</wordsize>
Dec 01 17:01:40 user nova-compute[75745]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-artful</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>x-remote</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='1'>isapc</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-disco</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-impish</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-focal</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>microvm</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <domain type='qemu'/>
Dec 01 17:01:40 user nova-compute[75745]:       <domain type='kvm'/>
Dec 01 17:01:40 user nova-compute[75745]:     </arch>
Dec 01 17:01:40 user nova-compute[75745]:     <features>
Dec 01 17:01:40 user nova-compute[75745]:       <acpi default='on' toggle='yes'/>
Dec 01 17:01:40 user nova-compute[75745]:       <apic default='on' toggle='no'/>
Dec 01 17:01:40 user nova-compute[75745]:       <cpuselection/>
Dec 01 17:01:40 user nova-compute[75745]:       <deviceboot/>
Dec 01 17:01:40 user nova-compute[75745]:       <disksnapshot default='on' toggle='no'/>
Dec 01 17:01:40 user nova-compute[75745]:     </features>
Dec 01 17:01:40 user nova-compute[75745]:   </guest>
Dec 01 17:01:40 user nova-compute[75745]:   <guest>
Dec 01 17:01:40 user nova-compute[75745]:     <os_type>hvm</os_type>
Dec 01 17:01:40 user nova-compute[75745]:     <arch name='xtensa'>
Dec 01 17:01:40 user nova-compute[75745]:       <wordsize>32</wordsize>
Dec 01 17:01:40 user nova-compute[75745]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='4'>sim</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='32'>kc705</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='32'>ml605</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='32'>ml605-nommu</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='32'>virt</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='32'>lx60-nommu</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='32'>lx200</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='32'>lx200-nommu</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='32'>lx60</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='32'>kc705-nommu</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <domain type='qemu'/>
Dec 01 17:01:40 user nova-compute[75745]:     </arch>
Dec 01 17:01:40 user nova-compute[75745]:     <features>
Dec 01 17:01:40 user nova-compute[75745]:       <cpuselection/>
Dec 01 17:01:40 user nova-compute[75745]:       <deviceboot/>
Dec 01 17:01:40 user nova-compute[75745]:       <disksnapshot default='on' toggle='no'/>
Dec 01 17:01:40 user nova-compute[75745]:     </features>
Dec 01 17:01:40 user nova-compute[75745]:   </guest>
Dec 01 17:01:40 user nova-compute[75745]:   <guest>
Dec 01 17:01:40 user nova-compute[75745]:     <os_type>hvm</os_type>
Dec 01 17:01:40 user nova-compute[75745]:     <arch name='xtensaeb'>
Dec 01 17:01:40 user nova-compute[75745]:       <wordsize>32</wordsize>
Dec 01 17:01:40 user nova-compute[75745]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='4'>sim</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='32'>kc705</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='32'>ml605</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='32'>ml605-nommu</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='32'>virt</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='32'>lx60-nommu</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='32'>lx200</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='32'>lx200-nommu</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='32'>lx60</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <machine maxCpus='32'>kc705-nommu</machine>
Dec 01 17:01:40 user nova-compute[75745]:       <domain type='qemu'/>
Dec 01 17:01:40 user nova-compute[75745]:     </arch>
Dec 01 17:01:40 user nova-compute[75745]:     <features>
Dec 01 17:01:40 user nova-compute[75745]:       <cpuselection/>
Dec 01 17:01:40 user nova-compute[75745]:       <deviceboot/>
Dec 01 17:01:40 user nova-compute[75745]:       <disksnapshot default='on' toggle='no'/>
Dec 01 17:01:40 user nova-compute[75745]:     </features>
Dec 01 17:01:40 user nova-compute[75745]:   </guest>
Dec 01 17:01:40 user nova-compute[75745]: </capabilities>
Dec 01 17:01:40 user nova-compute[75745]: 
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75745) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75745) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75745) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75745) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75745) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75745) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75745) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75745) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75745) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75745) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75745) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Getting domain capabilities for i686 via machine types: {'pc', 'q35', 'ubuntu', 'ubuntu-q35'} {{(pid=75745) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Dec 01 17:01:40 user nova-compute[75745]: <domainCapabilities>
Dec 01 17:01:40 user nova-compute[75745]:   <path>/usr/bin/qemu-system-i386</path>
Dec 01 17:01:40 user nova-compute[75745]:   <domain>kvm</domain>
Dec 01 17:01:40 user nova-compute[75745]:   <machine>pc-i440fx-6.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:   <arch>i686</arch>
Dec 01 17:01:40 user nova-compute[75745]:   <vcpu max='255'/>
Dec 01 17:01:40 user nova-compute[75745]:   <iothreads supported='yes'/>
Dec 01 17:01:40 user nova-compute[75745]:   <os supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:     <enum name='firmware'/>
Dec 01 17:01:40 user nova-compute[75745]:     <loader supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Dec 01 17:01:40 user nova-compute[75745]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Dec 01 17:01:40 user nova-compute[75745]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Dec 01 17:01:40 user nova-compute[75745]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Dec 01 17:01:40 user nova-compute[75745]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='type'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>rom</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>pflash</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='readonly'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>yes</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>no</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='secure'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>no</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </loader>
Dec 01 17:01:40 user nova-compute[75745]:   </os>
Dec 01 17:01:40 user nova-compute[75745]:   <cpu>
Dec 01 17:01:40 user nova-compute[75745]:     <mode name='host-passthrough' supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='hostPassthroughMigratable'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>off</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </mode>
Dec 01 17:01:40 user nova-compute[75745]:     <mode name='maximum' supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='maximumMigratable'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>on</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>off</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </mode>
Dec 01 17:01:40 user nova-compute[75745]:     <mode name='host-model' supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <vendor>Intel</vendor>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='ss'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='vmx'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='pcid'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='hypervisor'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='arat'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='tsc_adjust'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='umip'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='md-clear'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='stibp'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='arch-capabilities'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='ssbd'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='ibpb'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='ibrs'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='amd-stibp'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='amd-ssbd'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='disable' name='erms'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='disable' name='xsaveopt'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='disable' name='lm'/>
Dec 01 17:01:40 user nova-compute[75745]:     </mode>
Dec 01 17:01:40 user nova-compute[75745]:     <mode name='custom' supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>qemu64</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>qemu32</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>phenom</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>pentium3</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>pentium2</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>pentium</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>n270</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>kvm64</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>kvm32</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>coreduo</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>core2duo</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>athlon</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Westmere-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Westmere</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Snowridge</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Skylake-Server</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Skylake-Client</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>SandyBridge</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Penryn</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Opteron_G5</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Opteron_G4</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Opteron_G3</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Opteron_G2</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Opteron_G1</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Nehalem-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Nehalem</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>IvyBridge</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Icelake-Server</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Haswell-noTSX</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Haswell-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Haswell</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>EPYC-Rome</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>EPYC-Milan</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>EPYC-IBPB</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>EPYC</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Dhyana</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Cooperlake</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Conroe</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Cascadelake-Server</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Broadwell-noTSX</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Broadwell-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Broadwell</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>486</model>
Dec 01 17:01:40 user nova-compute[75745]:     </mode>
Dec 01 17:01:40 user nova-compute[75745]:   </cpu>
Dec 01 17:01:40 user nova-compute[75745]:   <memoryBacking supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:     <enum name='sourceType'>
Dec 01 17:01:40 user nova-compute[75745]:       <value>file</value>
Dec 01 17:01:40 user nova-compute[75745]:       <value>anonymous</value>
Dec 01 17:01:40 user nova-compute[75745]:       <value>memfd</value>
Dec 01 17:01:40 user nova-compute[75745]:     </enum>
Dec 01 17:01:40 user nova-compute[75745]:   </memoryBacking>
Dec 01 17:01:40 user nova-compute[75745]:   <devices>
Dec 01 17:01:40 user nova-compute[75745]:     <disk supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='diskDevice'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>disk</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>cdrom</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>floppy</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>lun</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='bus'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>ide</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>fdc</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>scsi</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>usb</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>sata</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='model'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio-transitional</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio-non-transitional</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </disk>
Dec 01 17:01:40 user nova-compute[75745]:     <graphics supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='type'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>sdl</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>vnc</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>spice</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>egl-headless</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </graphics>
Dec 01 17:01:40 user nova-compute[75745]:     <video supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='modelType'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>vga</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>cirrus</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>vmvga</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>qxl</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>none</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>bochs</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>ramfb</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </video>
Dec 01 17:01:40 user nova-compute[75745]:     <hostdev supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='mode'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>subsystem</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='startupPolicy'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>default</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>mandatory</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>requisite</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>optional</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='subsysType'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>usb</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>pci</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>scsi</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='capsType'/>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='pciBackend'/>
Dec 01 17:01:40 user nova-compute[75745]:     </hostdev>
Dec 01 17:01:40 user nova-compute[75745]:     <rng supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='model'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio-transitional</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio-non-transitional</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='backendModel'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>random</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>egd</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>builtin</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </rng>
Dec 01 17:01:40 user nova-compute[75745]:     <filesystem supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='driverType'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>path</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>handle</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtiofs</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </filesystem>
Dec 01 17:01:40 user nova-compute[75745]:     <tpm supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='model'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>tpm-tis</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>tpm-crb</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='backendModel'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>passthrough</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>emulator</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </tpm>
Dec 01 17:01:40 user nova-compute[75745]:   </devices>
Dec 01 17:01:40 user nova-compute[75745]:   <features>
Dec 01 17:01:40 user nova-compute[75745]:     <gic supported='no'/>
Dec 01 17:01:40 user nova-compute[75745]:     <vmcoreinfo supported='yes'/>
Dec 01 17:01:40 user nova-compute[75745]:     <genid supported='yes'/>
Dec 01 17:01:40 user nova-compute[75745]:     <backingStoreInput supported='yes'/>
Dec 01 17:01:40 user nova-compute[75745]:     <backup supported='yes'/>
Dec 01 17:01:40 user nova-compute[75745]:     <sev supported='no'/>
Dec 01 17:01:40 user nova-compute[75745]:   </features>
Dec 01 17:01:40 user nova-compute[75745]: </domainCapabilities>
Dec 01 17:01:40 user nova-compute[75745]:  {{(pid=75745) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Dec 01 17:01:40 user nova-compute[75745]: <domainCapabilities>
Dec 01 17:01:40 user nova-compute[75745]:   <path>/usr/bin/qemu-system-i386</path>
Dec 01 17:01:40 user nova-compute[75745]:   <domain>kvm</domain>
Dec 01 17:01:40 user nova-compute[75745]:   <machine>pc-q35-6.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:   <arch>i686</arch>
Dec 01 17:01:40 user nova-compute[75745]:   <vcpu max='288'/>
Dec 01 17:01:40 user nova-compute[75745]:   <iothreads supported='yes'/>
Dec 01 17:01:40 user nova-compute[75745]:   <os supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:     <enum name='firmware'/>
Dec 01 17:01:40 user nova-compute[75745]:     <loader supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Dec 01 17:01:40 user nova-compute[75745]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Dec 01 17:01:40 user nova-compute[75745]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Dec 01 17:01:40 user nova-compute[75745]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Dec 01 17:01:40 user nova-compute[75745]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='type'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>rom</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>pflash</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='readonly'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>yes</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>no</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='secure'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>no</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </loader>
Dec 01 17:01:40 user nova-compute[75745]:   </os>
Dec 01 17:01:40 user nova-compute[75745]:   <cpu>
Dec 01 17:01:40 user nova-compute[75745]:     <mode name='host-passthrough' supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='hostPassthroughMigratable'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>off</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </mode>
Dec 01 17:01:40 user nova-compute[75745]:     <mode name='maximum' supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='maximumMigratable'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>on</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>off</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </mode>
Dec 01 17:01:40 user nova-compute[75745]:     <mode name='host-model' supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <vendor>Intel</vendor>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='ss'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='vmx'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='pcid'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='hypervisor'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='arat'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='tsc_adjust'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='umip'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='md-clear'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='stibp'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='arch-capabilities'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='ssbd'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='ibpb'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='ibrs'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='amd-stibp'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='amd-ssbd'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='disable' name='erms'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='disable' name='xsaveopt'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='disable' name='lm'/>
Dec 01 17:01:40 user nova-compute[75745]:     </mode>
Dec 01 17:01:40 user nova-compute[75745]:     <mode name='custom' supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>qemu64</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>qemu32</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>phenom</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>pentium3</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>pentium2</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>pentium</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>n270</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>kvm64</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>kvm32</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>coreduo</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>core2duo</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>athlon</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Westmere-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Westmere</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Snowridge</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Skylake-Server</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Skylake-Client</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>SandyBridge</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Penryn</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Opteron_G5</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Opteron_G4</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Opteron_G3</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Opteron_G2</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Opteron_G1</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Nehalem-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Nehalem</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>IvyBridge</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Icelake-Server</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Haswell-noTSX</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Haswell-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Haswell</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>EPYC-Rome</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>EPYC-Milan</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>EPYC-IBPB</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>EPYC</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Dhyana</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Cooperlake</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Conroe</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Cascadelake-Server</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Broadwell-noTSX</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Broadwell-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Broadwell</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>486</model>
Dec 01 17:01:40 user nova-compute[75745]:     </mode>
Dec 01 17:01:40 user nova-compute[75745]:   </cpu>
Dec 01 17:01:40 user nova-compute[75745]:   <memoryBacking supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:     <enum name='sourceType'>
Dec 01 17:01:40 user nova-compute[75745]:       <value>file</value>
Dec 01 17:01:40 user nova-compute[75745]:       <value>anonymous</value>
Dec 01 17:01:40 user nova-compute[75745]:       <value>memfd</value>
Dec 01 17:01:40 user nova-compute[75745]:     </enum>
Dec 01 17:01:40 user nova-compute[75745]:   </memoryBacking>
Dec 01 17:01:40 user nova-compute[75745]:   <devices>
Dec 01 17:01:40 user nova-compute[75745]:     <disk supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='diskDevice'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>disk</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>cdrom</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>floppy</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>lun</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='bus'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>fdc</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>scsi</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>usb</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>sata</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='model'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio-transitional</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio-non-transitional</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </disk>
Dec 01 17:01:40 user nova-compute[75745]:     <graphics supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='type'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>sdl</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>vnc</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>spice</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>egl-headless</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </graphics>
Dec 01 17:01:40 user nova-compute[75745]:     <video supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='modelType'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>vga</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>cirrus</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>vmvga</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>qxl</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>none</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>bochs</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>ramfb</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </video>
Dec 01 17:01:40 user nova-compute[75745]:     <hostdev supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='mode'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>subsystem</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='startupPolicy'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>default</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>mandatory</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>requisite</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>optional</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='subsysType'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>usb</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>pci</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>scsi</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='capsType'/>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='pciBackend'/>
Dec 01 17:01:40 user nova-compute[75745]:     </hostdev>
Dec 01 17:01:40 user nova-compute[75745]:     <rng supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='model'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio-transitional</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio-non-transitional</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='backendModel'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>random</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>egd</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>builtin</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </rng>
Dec 01 17:01:40 user nova-compute[75745]:     <filesystem supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='driverType'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>path</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>handle</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtiofs</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </filesystem>
Dec 01 17:01:40 user nova-compute[75745]:     <tpm supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='model'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>tpm-tis</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>tpm-crb</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='backendModel'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>passthrough</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>emulator</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </tpm>
Dec 01 17:01:40 user nova-compute[75745]:   </devices>
Dec 01 17:01:40 user nova-compute[75745]:   <features>
Dec 01 17:01:40 user nova-compute[75745]:     <gic supported='no'/>
Dec 01 17:01:40 user nova-compute[75745]:     <vmcoreinfo supported='yes'/>
Dec 01 17:01:40 user nova-compute[75745]:     <genid supported='yes'/>
Dec 01 17:01:40 user nova-compute[75745]:     <backingStoreInput supported='yes'/>
Dec 01 17:01:40 user nova-compute[75745]:     <backup supported='yes'/>
Dec 01 17:01:40 user nova-compute[75745]:     <sev supported='no'/>
Dec 01 17:01:40 user nova-compute[75745]:   </features>
Dec 01 17:01:40 user nova-compute[75745]: </domainCapabilities>
Dec 01 17:01:40 user nova-compute[75745]:  {{(pid=75745) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Dec 01 17:01:40 user nova-compute[75745]: <domainCapabilities>
Dec 01 17:01:40 user nova-compute[75745]:   <path>/usr/bin/qemu-system-i386</path>
Dec 01 17:01:40 user nova-compute[75745]:   <domain>kvm</domain>
Dec 01 17:01:40 user nova-compute[75745]:   <machine>pc-i440fx-jammy</machine>
Dec 01 17:01:40 user nova-compute[75745]:   <arch>i686</arch>
Dec 01 17:01:40 user nova-compute[75745]:   <vcpu max='255'/>
Dec 01 17:01:40 user nova-compute[75745]:   <iothreads supported='yes'/>
Dec 01 17:01:40 user nova-compute[75745]:   <os supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:     <enum name='firmware'/>
Dec 01 17:01:40 user nova-compute[75745]:     <loader supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Dec 01 17:01:40 user nova-compute[75745]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Dec 01 17:01:40 user nova-compute[75745]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Dec 01 17:01:40 user nova-compute[75745]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Dec 01 17:01:40 user nova-compute[75745]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='type'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>rom</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>pflash</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='readonly'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>yes</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>no</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='secure'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>no</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </loader>
Dec 01 17:01:40 user nova-compute[75745]:   </os>
Dec 01 17:01:40 user nova-compute[75745]:   <cpu>
Dec 01 17:01:40 user nova-compute[75745]:     <mode name='host-passthrough' supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='hostPassthroughMigratable'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>off</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </mode>
Dec 01 17:01:40 user nova-compute[75745]:     <mode name='maximum' supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='maximumMigratable'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>on</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>off</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </mode>
Dec 01 17:01:40 user nova-compute[75745]:     <mode name='host-model' supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <vendor>Intel</vendor>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='ss'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='vmx'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='pcid'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='hypervisor'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='arat'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='tsc_adjust'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='umip'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='md-clear'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='stibp'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='arch-capabilities'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='ssbd'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='ibpb'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='ibrs'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='amd-stibp'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='amd-ssbd'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='disable' name='erms'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='disable' name='xsaveopt'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='disable' name='lm'/>
Dec 01 17:01:40 user nova-compute[75745]:     </mode>
Dec 01 17:01:40 user nova-compute[75745]:     <mode name='custom' supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>qemu64</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>qemu32</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>phenom</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>pentium3</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>pentium2</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>pentium</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>n270</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>kvm64</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>kvm32</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>coreduo</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>core2duo</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>athlon</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Westmere-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Westmere</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Snowridge</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Skylake-Server</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Skylake-Client</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>SandyBridge</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Penryn</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Opteron_G5</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Opteron_G4</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Opteron_G3</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Opteron_G2</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Opteron_G1</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Nehalem-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Nehalem</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>IvyBridge</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Icelake-Server</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Haswell-noTSX</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Haswell-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Haswell</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>EPYC-Rome</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>EPYC-Milan</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>EPYC-IBPB</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>EPYC</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Dhyana</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Cooperlake</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Conroe</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Cascadelake-Server</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Broadwell-noTSX</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Broadwell-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Broadwell</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>486</model>
Dec 01 17:01:40 user nova-compute[75745]:     </mode>
Dec 01 17:01:40 user nova-compute[75745]:   </cpu>
Dec 01 17:01:40 user nova-compute[75745]:   <memoryBacking supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:     <enum name='sourceType'>
Dec 01 17:01:40 user nova-compute[75745]:       <value>file</value>
Dec 01 17:01:40 user nova-compute[75745]:       <value>anonymous</value>
Dec 01 17:01:40 user nova-compute[75745]:       <value>memfd</value>
Dec 01 17:01:40 user nova-compute[75745]:     </enum>
Dec 01 17:01:40 user nova-compute[75745]:   </memoryBacking>
Dec 01 17:01:40 user nova-compute[75745]:   <devices>
Dec 01 17:01:40 user nova-compute[75745]:     <disk supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='diskDevice'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>disk</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>cdrom</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>floppy</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>lun</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='bus'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>ide</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>fdc</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>scsi</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>usb</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>sata</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='model'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio-transitional</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio-non-transitional</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </disk>
Dec 01 17:01:40 user nova-compute[75745]:     <graphics supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='type'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>sdl</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>vnc</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>spice</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>egl-headless</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </graphics>
Dec 01 17:01:40 user nova-compute[75745]:     <video supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='modelType'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>vga</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>cirrus</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>vmvga</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>qxl</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>none</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>bochs</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>ramfb</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </video>
Dec 01 17:01:40 user nova-compute[75745]:     <hostdev supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='mode'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>subsystem</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='startupPolicy'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>default</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>mandatory</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>requisite</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>optional</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='subsysType'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>usb</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>pci</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>scsi</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='capsType'/>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='pciBackend'/>
Dec 01 17:01:40 user nova-compute[75745]:     </hostdev>
Dec 01 17:01:40 user nova-compute[75745]:     <rng supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='model'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio-transitional</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio-non-transitional</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='backendModel'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>random</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>egd</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>builtin</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </rng>
Dec 01 17:01:40 user nova-compute[75745]:     <filesystem supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='driverType'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>path</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>handle</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtiofs</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </filesystem>
Dec 01 17:01:40 user nova-compute[75745]:     <tpm supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='model'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>tpm-tis</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>tpm-crb</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='backendModel'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>passthrough</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>emulator</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </tpm>
Dec 01 17:01:40 user nova-compute[75745]:   </devices>
Dec 01 17:01:40 user nova-compute[75745]:   <features>
Dec 01 17:01:40 user nova-compute[75745]:     <gic supported='no'/>
Dec 01 17:01:40 user nova-compute[75745]:     <vmcoreinfo supported='yes'/>
Dec 01 17:01:40 user nova-compute[75745]:     <genid supported='yes'/>
Dec 01 17:01:40 user nova-compute[75745]:     <backingStoreInput supported='yes'/>
Dec 01 17:01:40 user nova-compute[75745]:     <backup supported='yes'/>
Dec 01 17:01:40 user nova-compute[75745]:     <sev supported='no'/>
Dec 01 17:01:40 user nova-compute[75745]:   </features>
Dec 01 17:01:40 user nova-compute[75745]: </domainCapabilities>
Dec 01 17:01:40 user nova-compute[75745]:  {{(pid=75745) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Dec 01 17:01:40 user nova-compute[75745]: <domainCapabilities>
Dec 01 17:01:40 user nova-compute[75745]:   <path>/usr/bin/qemu-system-i386</path>
Dec 01 17:01:40 user nova-compute[75745]:   <domain>kvm</domain>
Dec 01 17:01:40 user nova-compute[75745]:   <machine>pc-q35-jammy</machine>
Dec 01 17:01:40 user nova-compute[75745]:   <arch>i686</arch>
Dec 01 17:01:40 user nova-compute[75745]:   <vcpu max='288'/>
Dec 01 17:01:40 user nova-compute[75745]:   <iothreads supported='yes'/>
Dec 01 17:01:40 user nova-compute[75745]:   <os supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:     <enum name='firmware'/>
Dec 01 17:01:40 user nova-compute[75745]:     <loader supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Dec 01 17:01:40 user nova-compute[75745]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Dec 01 17:01:40 user nova-compute[75745]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Dec 01 17:01:40 user nova-compute[75745]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Dec 01 17:01:40 user nova-compute[75745]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='type'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>rom</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>pflash</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='readonly'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>yes</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>no</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='secure'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>no</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </loader>
Dec 01 17:01:40 user nova-compute[75745]:   </os>
Dec 01 17:01:40 user nova-compute[75745]:   <cpu>
Dec 01 17:01:40 user nova-compute[75745]:     <mode name='host-passthrough' supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='hostPassthroughMigratable'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>off</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </mode>
Dec 01 17:01:40 user nova-compute[75745]:     <mode name='maximum' supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='maximumMigratable'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>on</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>off</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </mode>
Dec 01 17:01:40 user nova-compute[75745]:     <mode name='host-model' supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <vendor>Intel</vendor>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='ss'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='vmx'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='pcid'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='hypervisor'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='arat'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='tsc_adjust'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='umip'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='md-clear'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='stibp'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='arch-capabilities'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='ssbd'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='ibpb'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='ibrs'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='amd-stibp'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='amd-ssbd'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='disable' name='erms'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='disable' name='xsaveopt'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='disable' name='lm'/>
Dec 01 17:01:40 user nova-compute[75745]:     </mode>
Dec 01 17:01:40 user nova-compute[75745]:     <mode name='custom' supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>qemu64</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>qemu32</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>phenom</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>pentium3</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>pentium2</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>pentium</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>n270</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>kvm64</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>kvm32</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>coreduo</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>core2duo</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>athlon</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Westmere-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Westmere</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Snowridge</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Skylake-Server</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Skylake-Client</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>SandyBridge</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Penryn</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Opteron_G5</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Opteron_G4</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Opteron_G3</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Opteron_G2</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Opteron_G1</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Nehalem-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Nehalem</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>IvyBridge</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Icelake-Server</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Haswell-noTSX</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Haswell-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Haswell</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>EPYC-Rome</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>EPYC-Milan</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>EPYC-IBPB</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>EPYC</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Dhyana</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Cooperlake</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Conroe</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Cascadelake-Server</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Broadwell-noTSX</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Broadwell-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Broadwell</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>486</model>
Dec 01 17:01:40 user nova-compute[75745]:     </mode>
Dec 01 17:01:40 user nova-compute[75745]:   </cpu>
Dec 01 17:01:40 user nova-compute[75745]:   <memoryBacking supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:     <enum name='sourceType'>
Dec 01 17:01:40 user nova-compute[75745]:       <value>file</value>
Dec 01 17:01:40 user nova-compute[75745]:       <value>anonymous</value>
Dec 01 17:01:40 user nova-compute[75745]:       <value>memfd</value>
Dec 01 17:01:40 user nova-compute[75745]:     </enum>
Dec 01 17:01:40 user nova-compute[75745]:   </memoryBacking>
Dec 01 17:01:40 user nova-compute[75745]:   <devices>
Dec 01 17:01:40 user nova-compute[75745]:     <disk supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='diskDevice'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>disk</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>cdrom</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>floppy</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>lun</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='bus'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>fdc</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>scsi</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>usb</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>sata</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='model'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio-transitional</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio-non-transitional</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </disk>
Dec 01 17:01:40 user nova-compute[75745]:     <graphics supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='type'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>sdl</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>vnc</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>spice</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>egl-headless</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </graphics>
Dec 01 17:01:40 user nova-compute[75745]:     <video supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='modelType'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>vga</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>cirrus</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>vmvga</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>qxl</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>none</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>bochs</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>ramfb</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </video>
Dec 01 17:01:40 user nova-compute[75745]:     <hostdev supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='mode'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>subsystem</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='startupPolicy'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>default</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>mandatory</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>requisite</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>optional</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='subsysType'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>usb</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>pci</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>scsi</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='capsType'/>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='pciBackend'/>
Dec 01 17:01:40 user nova-compute[75745]:     </hostdev>
Dec 01 17:01:40 user nova-compute[75745]:     <rng supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='model'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio-transitional</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio-non-transitional</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='backendModel'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>random</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>egd</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>builtin</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </rng>
Dec 01 17:01:40 user nova-compute[75745]:     <filesystem supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='driverType'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>path</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>handle</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtiofs</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </filesystem>
Dec 01 17:01:40 user nova-compute[75745]:     <tpm supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='model'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>tpm-tis</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>tpm-crb</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='backendModel'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>passthrough</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>emulator</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </tpm>
Dec 01 17:01:40 user nova-compute[75745]:   </devices>
Dec 01 17:01:40 user nova-compute[75745]:   <features>
Dec 01 17:01:40 user nova-compute[75745]:     <gic supported='no'/>
Dec 01 17:01:40 user nova-compute[75745]:     <vmcoreinfo supported='yes'/>
Dec 01 17:01:40 user nova-compute[75745]:     <genid supported='yes'/>
Dec 01 17:01:40 user nova-compute[75745]:     <backingStoreInput supported='yes'/>
Dec 01 17:01:40 user nova-compute[75745]:     <backup supported='yes'/>
Dec 01 17:01:40 user nova-compute[75745]:     <sev supported='no'/>
Dec 01 17:01:40 user nova-compute[75745]:   </features>
Dec 01 17:01:40 user nova-compute[75745]: </domainCapabilities>
Dec 01 17:01:40 user nova-compute[75745]:  {{(pid=75745) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75745) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75745) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75745) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75745) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75745) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75745) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75745) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75745) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75745) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75745) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75745) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75745) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75745) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75745) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75745) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75745) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75745) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=75745) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75745) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75745) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75745) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75745) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75745) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75745) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75745) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75745) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75745) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75745) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75745) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75745) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75745) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75745) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75745) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75745) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75745) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75745) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75745) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75745) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'q35', 'ubuntu', 'ubuntu-q35'} {{(pid=75745) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Dec 01 17:01:40 user nova-compute[75745]: <domainCapabilities>
Dec 01 17:01:40 user nova-compute[75745]:   <path>/usr/bin/qemu-system-x86_64</path>
Dec 01 17:01:40 user nova-compute[75745]:   <domain>kvm</domain>
Dec 01 17:01:40 user nova-compute[75745]:   <machine>pc-i440fx-6.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:   <arch>x86_64</arch>
Dec 01 17:01:40 user nova-compute[75745]:   <vcpu max='255'/>
Dec 01 17:01:40 user nova-compute[75745]:   <iothreads supported='yes'/>
Dec 01 17:01:40 user nova-compute[75745]:   <os supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:     <enum name='firmware'>
Dec 01 17:01:40 user nova-compute[75745]:       <value>efi</value>
Dec 01 17:01:40 user nova-compute[75745]:     </enum>
Dec 01 17:01:40 user nova-compute[75745]:     <loader supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='type'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>rom</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>pflash</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='readonly'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>yes</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>no</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='secure'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>no</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </loader>
Dec 01 17:01:40 user nova-compute[75745]:   </os>
Dec 01 17:01:40 user nova-compute[75745]:   <cpu>
Dec 01 17:01:40 user nova-compute[75745]:     <mode name='host-passthrough' supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='hostPassthroughMigratable'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>on</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>off</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </mode>
Dec 01 17:01:40 user nova-compute[75745]:     <mode name='maximum' supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='maximumMigratable'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>on</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>off</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </mode>
Dec 01 17:01:40 user nova-compute[75745]:     <mode name='host-model' supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <vendor>Intel</vendor>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='ss'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='vmx'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='pcid'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='hypervisor'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='arat'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='tsc_adjust'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='umip'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='md-clear'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='stibp'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='arch-capabilities'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='ssbd'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='invtsc'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='ibpb'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='ibrs'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='amd-stibp'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='amd-ssbd'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='rsba'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='pschange-mc-no'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='disable' name='erms'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='disable' name='xsaveopt'/>
Dec 01 17:01:40 user nova-compute[75745]:     </mode>
Dec 01 17:01:40 user nova-compute[75745]:     <mode name='custom' supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>qemu64</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>qemu32</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>phenom</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>pentium3</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>pentium2</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>pentium</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>n270</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>kvm64</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>kvm32</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>coreduo</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>core2duo</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>athlon</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>Westmere-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>Westmere</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Snowridge</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Skylake-Server</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Skylake-Client</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>SandyBridge</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>Penryn</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Opteron_G5</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Opteron_G4</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Opteron_G3</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Opteron_G2</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>Opteron_G1</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>Nehalem-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>Nehalem</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>IvyBridge</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Icelake-Server</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Haswell-noTSX</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Haswell-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Haswell</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>EPYC-Rome</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>EPYC-Milan</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>EPYC-IBPB</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>EPYC</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Dhyana</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Cooperlake</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>Conroe</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Cascadelake-Server</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Broadwell-noTSX</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Broadwell-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='no'>Broadwell</model>
Dec 01 17:01:40 user nova-compute[75745]:       <model usable='yes'>486</model>
Dec 01 17:01:40 user nova-compute[75745]:     </mode>
Dec 01 17:01:40 user nova-compute[75745]:   </cpu>
Dec 01 17:01:40 user nova-compute[75745]:   <memoryBacking supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:     <enum name='sourceType'>
Dec 01 17:01:40 user nova-compute[75745]:       <value>file</value>
Dec 01 17:01:40 user nova-compute[75745]:       <value>anonymous</value>
Dec 01 17:01:40 user nova-compute[75745]:       <value>memfd</value>
Dec 01 17:01:40 user nova-compute[75745]:     </enum>
Dec 01 17:01:40 user nova-compute[75745]:   </memoryBacking>
Dec 01 17:01:40 user nova-compute[75745]:   <devices>
Dec 01 17:01:40 user nova-compute[75745]:     <disk supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='diskDevice'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>disk</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>cdrom</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>floppy</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>lun</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='bus'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>ide</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>fdc</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>scsi</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>usb</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>sata</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='model'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio-transitional</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio-non-transitional</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </disk>
Dec 01 17:01:40 user nova-compute[75745]:     <graphics supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='type'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>sdl</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>vnc</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>spice</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>egl-headless</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </graphics>
Dec 01 17:01:40 user nova-compute[75745]:     <video supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='modelType'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>vga</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>cirrus</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>vmvga</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>qxl</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>none</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>bochs</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>ramfb</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </video>
Dec 01 17:01:40 user nova-compute[75745]:     <hostdev supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='mode'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>subsystem</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='startupPolicy'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>default</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>mandatory</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>requisite</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>optional</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='subsysType'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>usb</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>pci</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>scsi</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='capsType'/>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='pciBackend'/>
Dec 01 17:01:40 user nova-compute[75745]:     </hostdev>
Dec 01 17:01:40 user nova-compute[75745]:     <rng supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='model'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio-transitional</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtio-non-transitional</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='backendModel'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>random</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>egd</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>builtin</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </rng>
Dec 01 17:01:40 user nova-compute[75745]:     <filesystem supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='driverType'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>path</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>handle</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>virtiofs</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </filesystem>
Dec 01 17:01:40 user nova-compute[75745]:     <tpm supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='model'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>tpm-tis</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>tpm-crb</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='backendModel'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>passthrough</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>emulator</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </tpm>
Dec 01 17:01:40 user nova-compute[75745]:   </devices>
Dec 01 17:01:40 user nova-compute[75745]:   <features>
Dec 01 17:01:40 user nova-compute[75745]:     <gic supported='no'/>
Dec 01 17:01:40 user nova-compute[75745]:     <vmcoreinfo supported='yes'/>
Dec 01 17:01:40 user nova-compute[75745]:     <genid supported='yes'/>
Dec 01 17:01:40 user nova-compute[75745]:     <backingStoreInput supported='yes'/>
Dec 01 17:01:40 user nova-compute[75745]:     <backup supported='yes'/>
Dec 01 17:01:40 user nova-compute[75745]:     <sev supported='no'/>
Dec 01 17:01:40 user nova-compute[75745]:   </features>
Dec 01 17:01:40 user nova-compute[75745]: </domainCapabilities>
Dec 01 17:01:40 user nova-compute[75745]:  {{(pid=75745) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 01 17:01:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Dec 01 17:01:40 user nova-compute[75745]: <domainCapabilities>
Dec 01 17:01:40 user nova-compute[75745]:   <path>/usr/bin/qemu-system-x86_64</path>
Dec 01 17:01:40 user nova-compute[75745]:   <domain>kvm</domain>
Dec 01 17:01:40 user nova-compute[75745]:   <machine>pc-q35-6.2</machine>
Dec 01 17:01:40 user nova-compute[75745]:   <arch>x86_64</arch>
Dec 01 17:01:40 user nova-compute[75745]:   <vcpu max='288'/>
Dec 01 17:01:40 user nova-compute[75745]:   <iothreads supported='yes'/>
Dec 01 17:01:40 user nova-compute[75745]:   <os supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:     <enum name='firmware'>
Dec 01 17:01:40 user nova-compute[75745]:       <value>efi</value>
Dec 01 17:01:40 user nova-compute[75745]:     </enum>
Dec 01 17:01:40 user nova-compute[75745]:     <loader supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Dec 01 17:01:40 user nova-compute[75745]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Dec 01 17:01:40 user nova-compute[75745]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='type'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>rom</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>pflash</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='readonly'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>yes</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>no</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='secure'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>yes</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>no</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </loader>
Dec 01 17:01:40 user nova-compute[75745]:   </os>
Dec 01 17:01:40 user nova-compute[75745]:   <cpu>
Dec 01 17:01:40 user nova-compute[75745]:     <mode name='host-passthrough' supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='hostPassthroughMigratable'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>on</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>off</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </mode>
Dec 01 17:01:40 user nova-compute[75745]:     <mode name='maximum' supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <enum name='maximumMigratable'>
Dec 01 17:01:40 user nova-compute[75745]:         <value>on</value>
Dec 01 17:01:40 user nova-compute[75745]:         <value>off</value>
Dec 01 17:01:40 user nova-compute[75745]:       </enum>
Dec 01 17:01:40 user nova-compute[75745]:     </mode>
Dec 01 17:01:40 user nova-compute[75745]:     <mode name='host-model' supported='yes'>
Dec 01 17:01:40 user nova-compute[75745]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 01 17:01:40 user nova-compute[75745]:       <vendor>Intel</vendor>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='ss'/>
Dec 01 17:01:40 user nova-compute[75745]:       <feature policy='require' name='vmx'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='pcid'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='hypervisor'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='arat'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='tsc_adjust'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='umip'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='md-clear'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='stibp'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='arch-capabilities'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='ssbd'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='invtsc'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='ibpb'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='ibrs'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='amd-stibp'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='amd-ssbd'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='rsba'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='pschange-mc-no'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='disable' name='erms'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='disable' name='xsaveopt'/>
Dec 01 17:01:41 user nova-compute[75745]:     </mode>
Dec 01 17:01:41 user nova-compute[75745]:     <mode name='custom' supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>qemu64</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>qemu32</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>phenom</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>pentium3</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>pentium2</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>pentium</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>n270</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>kvm64</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>kvm32</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>coreduo</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>core2duo</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>athlon</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>Westmere-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>Westmere</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Snowridge</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Skylake-Server</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Skylake-Client</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>SandyBridge</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>Penryn</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Opteron_G5</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Opteron_G4</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Opteron_G3</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Opteron_G2</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>Opteron_G1</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>Nehalem-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>Nehalem</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>IvyBridge</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Icelake-Server</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Haswell-noTSX</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Haswell-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Haswell</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>EPYC-Rome</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>EPYC-Milan</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>EPYC-IBPB</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>EPYC</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Dhyana</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Cooperlake</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>Conroe</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Cascadelake-Server</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Broadwell-noTSX</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Broadwell-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Broadwell</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>486</model>
Dec 01 17:01:41 user nova-compute[75745]:     </mode>
Dec 01 17:01:41 user nova-compute[75745]:   </cpu>
Dec 01 17:01:41 user nova-compute[75745]:   <memoryBacking supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:     <enum name='sourceType'>
Dec 01 17:01:41 user nova-compute[75745]:       <value>file</value>
Dec 01 17:01:41 user nova-compute[75745]:       <value>anonymous</value>
Dec 01 17:01:41 user nova-compute[75745]:       <value>memfd</value>
Dec 01 17:01:41 user nova-compute[75745]:     </enum>
Dec 01 17:01:41 user nova-compute[75745]:   </memoryBacking>
Dec 01 17:01:41 user nova-compute[75745]:   <devices>
Dec 01 17:01:41 user nova-compute[75745]:     <disk supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='diskDevice'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>disk</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>cdrom</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>floppy</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>lun</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='bus'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>fdc</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>scsi</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>virtio</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>usb</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>sata</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='model'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>virtio</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>virtio-transitional</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>virtio-non-transitional</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:     </disk>
Dec 01 17:01:41 user nova-compute[75745]:     <graphics supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='type'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>sdl</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>vnc</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>spice</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>egl-headless</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:     </graphics>
Dec 01 17:01:41 user nova-compute[75745]:     <video supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='modelType'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>vga</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>cirrus</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>vmvga</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>qxl</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>virtio</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>none</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>bochs</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>ramfb</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:     </video>
Dec 01 17:01:41 user nova-compute[75745]:     <hostdev supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='mode'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>subsystem</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='startupPolicy'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>default</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>mandatory</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>requisite</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>optional</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='subsysType'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>usb</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>pci</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>scsi</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='capsType'/>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='pciBackend'/>
Dec 01 17:01:41 user nova-compute[75745]:     </hostdev>
Dec 01 17:01:41 user nova-compute[75745]:     <rng supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='model'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>virtio</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>virtio-transitional</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>virtio-non-transitional</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='backendModel'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>random</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>egd</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>builtin</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:     </rng>
Dec 01 17:01:41 user nova-compute[75745]:     <filesystem supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='driverType'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>path</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>handle</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>virtiofs</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:     </filesystem>
Dec 01 17:01:41 user nova-compute[75745]:     <tpm supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='model'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>tpm-tis</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>tpm-crb</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='backendModel'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>passthrough</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>emulator</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:     </tpm>
Dec 01 17:01:41 user nova-compute[75745]:   </devices>
Dec 01 17:01:41 user nova-compute[75745]:   <features>
Dec 01 17:01:41 user nova-compute[75745]:     <gic supported='no'/>
Dec 01 17:01:41 user nova-compute[75745]:     <vmcoreinfo supported='yes'/>
Dec 01 17:01:41 user nova-compute[75745]:     <genid supported='yes'/>
Dec 01 17:01:41 user nova-compute[75745]:     <backingStoreInput supported='yes'/>
Dec 01 17:01:41 user nova-compute[75745]:     <backup supported='yes'/>
Dec 01 17:01:41 user nova-compute[75745]:     <sev supported='no'/>
Dec 01 17:01:41 user nova-compute[75745]:   </features>
Dec 01 17:01:41 user nova-compute[75745]: </domainCapabilities>
Dec 01 17:01:41 user nova-compute[75745]:  {{(pid=75745) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 01 17:01:41 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Dec 01 17:01:41 user nova-compute[75745]: <domainCapabilities>
Dec 01 17:01:41 user nova-compute[75745]:   <path>/usr/bin/qemu-system-x86_64</path>
Dec 01 17:01:41 user nova-compute[75745]:   <domain>kvm</domain>
Dec 01 17:01:41 user nova-compute[75745]:   <machine>pc-i440fx-jammy</machine>
Dec 01 17:01:41 user nova-compute[75745]:   <arch>x86_64</arch>
Dec 01 17:01:41 user nova-compute[75745]:   <vcpu max='255'/>
Dec 01 17:01:41 user nova-compute[75745]:   <iothreads supported='yes'/>
Dec 01 17:01:41 user nova-compute[75745]:   <os supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:     <enum name='firmware'>
Dec 01 17:01:41 user nova-compute[75745]:       <value>efi</value>
Dec 01 17:01:41 user nova-compute[75745]:     </enum>
Dec 01 17:01:41 user nova-compute[75745]:     <loader supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='type'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>rom</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>pflash</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='readonly'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>yes</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>no</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='secure'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>no</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:     </loader>
Dec 01 17:01:41 user nova-compute[75745]:   </os>
Dec 01 17:01:41 user nova-compute[75745]:   <cpu>
Dec 01 17:01:41 user nova-compute[75745]:     <mode name='host-passthrough' supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='hostPassthroughMigratable'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>on</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>off</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:     </mode>
Dec 01 17:01:41 user nova-compute[75745]:     <mode name='maximum' supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='maximumMigratable'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>on</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>off</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:     </mode>
Dec 01 17:01:41 user nova-compute[75745]:     <mode name='host-model' supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <vendor>Intel</vendor>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='ss'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='vmx'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='pcid'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='hypervisor'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='arat'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='tsc_adjust'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='umip'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='md-clear'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='stibp'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='arch-capabilities'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='ssbd'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='invtsc'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='ibpb'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='ibrs'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='amd-stibp'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='amd-ssbd'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='rsba'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='pschange-mc-no'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='disable' name='erms'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='disable' name='xsaveopt'/>
Dec 01 17:01:41 user nova-compute[75745]:     </mode>
Dec 01 17:01:41 user nova-compute[75745]:     <mode name='custom' supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>qemu64</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>qemu32</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>phenom</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>pentium3</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>pentium2</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>pentium</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>n270</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>kvm64</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>kvm32</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>coreduo</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>core2duo</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>athlon</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>Westmere-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>Westmere</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Snowridge</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Skylake-Server</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Skylake-Client</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>SandyBridge</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>Penryn</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Opteron_G5</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Opteron_G4</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Opteron_G3</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Opteron_G2</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>Opteron_G1</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>Nehalem-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>Nehalem</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>IvyBridge</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Icelake-Server</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Haswell-noTSX</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Haswell-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Haswell</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>EPYC-Rome</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>EPYC-Milan</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>EPYC-IBPB</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>EPYC</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Dhyana</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Cooperlake</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>Conroe</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Cascadelake-Server</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Broadwell-noTSX</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Broadwell-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Broadwell</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>486</model>
Dec 01 17:01:41 user nova-compute[75745]:     </mode>
Dec 01 17:01:41 user nova-compute[75745]:   </cpu>
Dec 01 17:01:41 user nova-compute[75745]:   <memoryBacking supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:     <enum name='sourceType'>
Dec 01 17:01:41 user nova-compute[75745]:       <value>file</value>
Dec 01 17:01:41 user nova-compute[75745]:       <value>anonymous</value>
Dec 01 17:01:41 user nova-compute[75745]:       <value>memfd</value>
Dec 01 17:01:41 user nova-compute[75745]:     </enum>
Dec 01 17:01:41 user nova-compute[75745]:   </memoryBacking>
Dec 01 17:01:41 user nova-compute[75745]:   <devices>
Dec 01 17:01:41 user nova-compute[75745]:     <disk supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='diskDevice'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>disk</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>cdrom</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>floppy</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>lun</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='bus'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>ide</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>fdc</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>scsi</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>virtio</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>usb</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>sata</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='model'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>virtio</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>virtio-transitional</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>virtio-non-transitional</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:     </disk>
Dec 01 17:01:41 user nova-compute[75745]:     <graphics supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='type'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>sdl</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>vnc</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>spice</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>egl-headless</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:     </graphics>
Dec 01 17:01:41 user nova-compute[75745]:     <video supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='modelType'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>vga</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>cirrus</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>vmvga</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>qxl</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>virtio</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>none</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>bochs</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>ramfb</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:     </video>
Dec 01 17:01:41 user nova-compute[75745]:     <hostdev supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='mode'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>subsystem</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='startupPolicy'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>default</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>mandatory</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>requisite</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>optional</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='subsysType'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>usb</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>pci</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>scsi</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='capsType'/>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='pciBackend'/>
Dec 01 17:01:41 user nova-compute[75745]:     </hostdev>
Dec 01 17:01:41 user nova-compute[75745]:     <rng supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='model'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>virtio</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>virtio-transitional</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>virtio-non-transitional</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='backendModel'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>random</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>egd</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>builtin</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:     </rng>
Dec 01 17:01:41 user nova-compute[75745]:     <filesystem supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='driverType'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>path</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>handle</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>virtiofs</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:     </filesystem>
Dec 01 17:01:41 user nova-compute[75745]:     <tpm supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='model'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>tpm-tis</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>tpm-crb</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='backendModel'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>passthrough</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>emulator</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:     </tpm>
Dec 01 17:01:41 user nova-compute[75745]:   </devices>
Dec 01 17:01:41 user nova-compute[75745]:   <features>
Dec 01 17:01:41 user nova-compute[75745]:     <gic supported='no'/>
Dec 01 17:01:41 user nova-compute[75745]:     <vmcoreinfo supported='yes'/>
Dec 01 17:01:41 user nova-compute[75745]:     <genid supported='yes'/>
Dec 01 17:01:41 user nova-compute[75745]:     <backingStoreInput supported='yes'/>
Dec 01 17:01:41 user nova-compute[75745]:     <backup supported='yes'/>
Dec 01 17:01:41 user nova-compute[75745]:     <sev supported='no'/>
Dec 01 17:01:41 user nova-compute[75745]:   </features>
Dec 01 17:01:41 user nova-compute[75745]: </domainCapabilities>
Dec 01 17:01:41 user nova-compute[75745]:  {{(pid=75745) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 01 17:01:41 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Dec 01 17:01:41 user nova-compute[75745]: <domainCapabilities>
Dec 01 17:01:41 user nova-compute[75745]:   <path>/usr/bin/qemu-system-x86_64</path>
Dec 01 17:01:41 user nova-compute[75745]:   <domain>kvm</domain>
Dec 01 17:01:41 user nova-compute[75745]:   <machine>pc-q35-jammy</machine>
Dec 01 17:01:41 user nova-compute[75745]:   <arch>x86_64</arch>
Dec 01 17:01:41 user nova-compute[75745]:   <vcpu max='288'/>
Dec 01 17:01:41 user nova-compute[75745]:   <iothreads supported='yes'/>
Dec 01 17:01:41 user nova-compute[75745]:   <os supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:     <enum name='firmware'>
Dec 01 17:01:41 user nova-compute[75745]:       <value>efi</value>
Dec 01 17:01:41 user nova-compute[75745]:     </enum>
Dec 01 17:01:41 user nova-compute[75745]:     <loader supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Dec 01 17:01:41 user nova-compute[75745]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Dec 01 17:01:41 user nova-compute[75745]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='type'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>rom</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>pflash</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='readonly'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>yes</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>no</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='secure'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>yes</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>no</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:     </loader>
Dec 01 17:01:41 user nova-compute[75745]:   </os>
Dec 01 17:01:41 user nova-compute[75745]:   <cpu>
Dec 01 17:01:41 user nova-compute[75745]:     <mode name='host-passthrough' supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='hostPassthroughMigratable'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>on</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>off</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:     </mode>
Dec 01 17:01:41 user nova-compute[75745]:     <mode name='maximum' supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='maximumMigratable'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>on</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>off</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:     </mode>
Dec 01 17:01:41 user nova-compute[75745]:     <mode name='host-model' supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <vendor>Intel</vendor>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='ss'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='vmx'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='pcid'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='hypervisor'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='arat'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='tsc_adjust'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='umip'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='md-clear'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='stibp'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='arch-capabilities'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='ssbd'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='invtsc'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='ibpb'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='ibrs'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='amd-stibp'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='amd-ssbd'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='rsba'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='require' name='pschange-mc-no'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='disable' name='erms'/>
Dec 01 17:01:41 user nova-compute[75745]:       <feature policy='disable' name='xsaveopt'/>
Dec 01 17:01:41 user nova-compute[75745]:     </mode>
Dec 01 17:01:41 user nova-compute[75745]:     <mode name='custom' supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>qemu64</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>qemu32</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>phenom</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>pentium3</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>pentium2</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>pentium</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>n270</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>kvm64</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>kvm32</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>coreduo</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>core2duo</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>athlon</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>Westmere-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>Westmere</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Snowridge</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Skylake-Server</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Skylake-Client</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>SandyBridge</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>Penryn</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Opteron_G5</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Opteron_G4</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Opteron_G3</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Opteron_G2</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>Opteron_G1</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>Nehalem-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>Nehalem</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>IvyBridge</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Icelake-Server</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Haswell-noTSX</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Haswell-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Haswell</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>EPYC-Rome</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>EPYC-Milan</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>EPYC-IBPB</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>EPYC</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Dhyana</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Cooperlake</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>Conroe</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Cascadelake-Server</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Broadwell-noTSX</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Broadwell-IBRS</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='no'>Broadwell</model>
Dec 01 17:01:41 user nova-compute[75745]:       <model usable='yes'>486</model>
Dec 01 17:01:41 user nova-compute[75745]:     </mode>
Dec 01 17:01:41 user nova-compute[75745]:   </cpu>
Dec 01 17:01:41 user nova-compute[75745]:   <memoryBacking supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:     <enum name='sourceType'>
Dec 01 17:01:41 user nova-compute[75745]:       <value>file</value>
Dec 01 17:01:41 user nova-compute[75745]:       <value>anonymous</value>
Dec 01 17:01:41 user nova-compute[75745]:       <value>memfd</value>
Dec 01 17:01:41 user nova-compute[75745]:     </enum>
Dec 01 17:01:41 user nova-compute[75745]:   </memoryBacking>
Dec 01 17:01:41 user nova-compute[75745]:   <devices>
Dec 01 17:01:41 user nova-compute[75745]:     <disk supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='diskDevice'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>disk</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>cdrom</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>floppy</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>lun</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='bus'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>fdc</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>scsi</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>virtio</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>usb</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>sata</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='model'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>virtio</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>virtio-transitional</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>virtio-non-transitional</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:     </disk>
Dec 01 17:01:41 user nova-compute[75745]:     <graphics supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='type'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>sdl</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>vnc</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>spice</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>egl-headless</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:     </graphics>
Dec 01 17:01:41 user nova-compute[75745]:     <video supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='modelType'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>vga</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>cirrus</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>vmvga</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>qxl</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>virtio</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>none</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>bochs</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>ramfb</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:     </video>
Dec 01 17:01:41 user nova-compute[75745]:     <hostdev supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='mode'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>subsystem</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='startupPolicy'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>default</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>mandatory</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>requisite</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>optional</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='subsysType'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>usb</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>pci</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>scsi</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='capsType'/>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='pciBackend'/>
Dec 01 17:01:41 user nova-compute[75745]:     </hostdev>
Dec 01 17:01:41 user nova-compute[75745]:     <rng supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='model'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>virtio</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>virtio-transitional</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>virtio-non-transitional</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='backendModel'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>random</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>egd</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>builtin</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:     </rng>
Dec 01 17:01:41 user nova-compute[75745]:     <filesystem supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='driverType'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>path</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>handle</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>virtiofs</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:     </filesystem>
Dec 01 17:01:41 user nova-compute[75745]:     <tpm supported='yes'>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='model'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>tpm-tis</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>tpm-crb</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:       <enum name='backendModel'>
Dec 01 17:01:41 user nova-compute[75745]:         <value>passthrough</value>
Dec 01 17:01:41 user nova-compute[75745]:         <value>emulator</value>
Dec 01 17:01:41 user nova-compute[75745]:       </enum>
Dec 01 17:01:41 user nova-compute[75745]:     </tpm>
Dec 01 17:01:41 user nova-compute[75745]:   </devices>
Dec 01 17:01:41 user nova-compute[75745]:   <features>
Dec 01 17:01:41 user nova-compute[75745]:     <gic supported='no'/>
Dec 01 17:01:41 user nova-compute[75745]:     <vmcoreinfo supported='yes'/>
Dec 01 17:01:41 user nova-compute[75745]:     <genid supported='yes'/>
Dec 01 17:01:41 user nova-compute[75745]:     <backingStoreInput supported='yes'/>
Dec 01 17:01:41 user nova-compute[75745]:     <backup supported='yes'/>
Dec 01 17:01:41 user nova-compute[75745]:     <sev supported='no'/>
Dec 01 17:01:41 user nova-compute[75745]:   </features>
Dec 01 17:01:41 user nova-compute[75745]: </domainCapabilities>
Dec 01 17:01:41 user nova-compute[75745]:  {{(pid=75745) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 01 17:01:41 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75745) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 17:01:41 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75745) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 17:01:41 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75745) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 17:01:41 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75745) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 17:01:41 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Checking secure boot support for host arch (x86_64) {{(pid=75745) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Dec 01 17:01:41 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Checking secure boot support for host arch (x86_64) {{(pid=75745) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Dec 01 17:01:41 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Checking secure boot support for host arch (x86_64) {{(pid=75745) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Dec 01 17:01:41 user nova-compute[75745]: INFO nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Secure Boot support detected
Dec 01 17:01:41 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] cpu compare xml: <cpu match="exact">
Dec 01 17:01:41 user nova-compute[75745]:   <model>Nehalem</model>
Dec 01 17:01:41 user nova-compute[75745]: </cpu>
Dec 01 17:01:41 user nova-compute[75745]:  {{(pid=75745) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10017}}
Dec 01 17:01:41 user nova-compute[75745]: INFO nova.virt.node [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Generated node identity 33987d7e-4951-418c-ad82-d4ed37170ed9
Dec 01 17:01:41 user nova-compute[75745]: INFO nova.virt.node [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Wrote node identity 33987d7e-4951-418c-ad82-d4ed37170ed9 to /opt/stack/data/nova/compute_id
Dec 01 17:01:41 user nova-compute[75745]: WARNING nova.compute.manager [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Compute nodes ['33987d7e-4951-418c-ad82-d4ed37170ed9'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Dec 01 17:01:41 user nova-compute[75745]: INFO nova.compute.manager [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Dec 01 17:01:41 user nova-compute[75745]: WARNING nova.compute.manager [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Dec 01 17:01:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:01:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:01:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:01:41 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:01:41 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:01:41 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:01:41 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Hypervisor/Node resource view: name=user free_ram=10971MB free_disk=26.188701629638672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:01:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:01:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:01:41 user nova-compute[75745]: WARNING nova.compute.resource_tracker [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] No compute node record for user:33987d7e-4951-418c-ad82-d4ed37170ed9: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 33987d7e-4951-418c-ad82-d4ed37170ed9 could not be found.
Dec 01 17:01:41 user nova-compute[75745]: INFO nova.compute.resource_tracker [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Compute node record created for user:user with uuid: 33987d7e-4951-418c-ad82-d4ed37170ed9
Dec 01 17:01:41 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:01:41 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:01:41 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] [req-02c1ef43-6215-40a5-aa6e-f04344c448dd] Created resource provider record via placement API for resource provider with UUID 33987d7e-4951-418c-ad82-d4ed37170ed9 and name user.
Dec 01 17:01:41 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75745) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Dec 01 17:01:41 user nova-compute[75745]: INFO nova.virt.libvirt.host [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] kernel doesn't support AMD SEV
Dec 01 17:01:41 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Updating inventory in ProviderTree for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 01 17:01:41 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:01:41 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Libvirt baseline CPU <cpu>
Dec 01 17:01:41 user nova-compute[75745]:   <arch>x86_64</arch>
Dec 01 17:01:41 user nova-compute[75745]:   <model>Nehalem</model>
Dec 01 17:01:41 user nova-compute[75745]:   <vendor>Intel</vendor>
Dec 01 17:01:41 user nova-compute[75745]:   <topology sockets="6" cores="1" threads="1"/>
Dec 01 17:01:41 user nova-compute[75745]: </cpu>
Dec 01 17:01:41 user nova-compute[75745]:  {{(pid=75745) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12515}}
Dec 01 17:01:41 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Updated inventory for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Dec 01 17:01:41 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Updating resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9 generation from 0 to 1 during operation: update_inventory {{(pid=75745) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Dec 01 17:01:41 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Updating inventory in ProviderTree for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 01 17:01:42 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Updating resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9 generation from 1 to 2 during operation: update_traits {{(pid=75745) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Dec 01 17:01:42 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:01:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.660s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:01:42 user nova-compute[75745]: DEBUG nova.service [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Creating RPC server for service compute {{(pid=75745) start /opt/stack/nova/nova/service.py:182}}
Dec 01 17:01:42 user nova-compute[75745]: DEBUG nova.service [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] Join ServiceGroup membership for this service compute {{(pid=75745) start /opt/stack/nova/nova/service.py:199}}
Dec 01 17:01:42 user nova-compute[75745]: DEBUG nova.servicegroup.drivers.db [None req-c795decb-13b0-4b59-afa2-34243dbdec1e None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75745) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Dec 01 17:02:18 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:02:18 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:02:32 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:02:32 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:02:32 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:02:32 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Rebuilding the list of instances to heal {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 17:02:32 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Didn't find any instances for network info cache update. {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 17:02:32 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:02:32 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:02:32 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:02:32 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:02:32 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:02:32 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:02:32 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:02:32 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:02:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:02:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:02:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:02:32 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:02:33 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:02:33 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:02:33 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=10405MB free_disk=26.092418670654297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:02:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:02:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:02:33 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:02:33 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:02:33 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:02:33 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:02:33 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:02:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:03:33 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:03:33 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:03:33 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:03:33 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:03:33 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Rebuilding the list of instances to heal {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 17:03:33 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Didn't find any instances for network info cache update. {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 17:03:33 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:03:33 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:03:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:03:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:03:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:03:33 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:03:33 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:03:33 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:03:33 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=10314MB free_disk=26.156856536865234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:03:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:03:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:03:33 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:03:33 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:03:33 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:03:33 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:03:33 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:03:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.109s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:03:34 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:03:34 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:03:34 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:03:34 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:03:34 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:03:34 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:04:32 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:04:32 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:04:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:04:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:04:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:04:32 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:04:33 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:04:33 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:04:33 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=10291MB free_disk=25.909217834472656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:04:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:04:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:04:33 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:04:33 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:04:33 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:04:33 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:04:33 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:04:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.358s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:04:34 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:04:34 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:04:34 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Rebuilding the list of instances to heal {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 17:04:34 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Didn't find any instances for network info cache update. {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 17:04:34 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:04:34 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:04:35 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:04:35 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:04:35 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:04:35 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:04:35 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:05:32 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:05:34 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:05:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:05:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:05:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:05:34 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:05:35 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:05:35 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:05:35 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=9619MB free_disk=25.93002700805664GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:05:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:05:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:05:35 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:05:35 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:05:35 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:05:35 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:05:35 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:05:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:05:36 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:05:36 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:05:36 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Rebuilding the list of instances to heal {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 17:05:36 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Didn't find any instances for network info cache update. {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 17:05:36 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:05:36 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:05:36 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:05:36 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:05:36 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:05:36 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:05:37 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:05:37 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:05:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "dc78dcf1-f005-415c-ac27-798cab8f52fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:05:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "dc78dcf1-f005-415c-ac27-798cab8f52fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:05:43 user nova-compute[75745]: DEBUG nova.compute.manager [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:05:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:05:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:05:43 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:05:43 user nova-compute[75745]: INFO nova.compute.claims [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Claim successful on node user
Dec 01 17:05:44 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:05:44 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:05:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.333s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:05:44 user nova-compute[75745]: DEBUG nova.compute.manager [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:05:44 user nova-compute[75745]: DEBUG nova.compute.manager [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:05:44 user nova-compute[75745]: DEBUG nova.network.neutron [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:05:44 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:05:44 user nova-compute[75745]: DEBUG nova.compute.manager [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:05:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Acquiring lock "b566a6fd-2ea6-4df7-8866-eab5b4d398a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:05:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Lock "b566a6fd-2ea6-4df7-8866-eab5b4d398a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:05:44 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:05:44 user nova-compute[75745]: DEBUG nova.compute.manager [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:05:44 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:05:44 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Creating image(s)
Dec 01 17:05:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "/opt/stack/data/nova/instances/dc78dcf1-f005-415c-ac27-798cab8f52fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:05:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "/opt/stack/data/nova/instances/dc78dcf1-f005-415c-ac27-798cab8f52fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:05:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "/opt/stack/data/nova/instances/dc78dcf1-f005-415c-ac27-798cab8f52fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:05:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:05:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:05:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:05:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:05:44 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:05:44 user nova-compute[75745]: INFO nova.compute.claims [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Claim successful on node user
Dec 01 17:05:45 user nova-compute[75745]: DEBUG nova.policy [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76845c98f91449df9196e19187b1b786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1730419061445f98680b8c81753a4f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:05:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf.part --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:05:45 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:05:45 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:05:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf.part --force-share --output=json" returned: 0 in 0.417s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:05:45 user nova-compute[75745]: DEBUG nova.virt.images [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] 695c84b8-d08d-488d-9841-cc1da92fb985 was qcow2, converting to raw {{(pid=75745) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 01 17:05:45 user nova-compute[75745]: DEBUG nova.privsep.utils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75745) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 17:05:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf.part /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf.converted {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:05:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.870s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:05:45 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:05:45 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:05:45 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:05:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf.part /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf.converted" returned: 0 in 0.262s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:05:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf.converted --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:05:46 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:05:46 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:05:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf.converted --force-share --output=json" returned: 0 in 0.248s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:05:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.532s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:05:46 user nova-compute[75745]: INFO oslo.privsep.daemon [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpvc9wsc4p/privsep.sock']
Dec 01 17:05:46 user sudo[85003]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpvc9wsc4p/privsep.sock
Dec 01 17:05:46 user sudo[85003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Dec 01 17:05:46 user nova-compute[75745]: DEBUG nova.policy [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ad569596dc749f1a20e0bd4a1594a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08f6fe2b83b488ca3febd45986ed592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:05:46 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:05:46 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:05:46 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Creating image(s)
Dec 01 17:05:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Acquiring lock "/opt/stack/data/nova/instances/b566a6fd-2ea6-4df7-8866-eab5b4d398a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:05:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Lock "/opt/stack/data/nova/instances/b566a6fd-2ea6-4df7-8866-eab5b4d398a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:05:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Lock "/opt/stack/data/nova/instances/b566a6fd-2ea6-4df7-8866-eab5b4d398a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:05:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:05:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:05:46 user nova-compute[75745]: DEBUG nova.compute.manager [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:05:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:05:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:05:46 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:05:46 user nova-compute[75745]: INFO nova.compute.claims [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Claim successful on node user
Dec 01 17:05:47 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:05:47 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:05:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:05:47 user nova-compute[75745]: DEBUG nova.compute.manager [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:05:47 user nova-compute[75745]: DEBUG nova.compute.manager [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:05:47 user nova-compute[75745]: DEBUG nova.network.neutron [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:05:47 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:05:47 user nova-compute[75745]: DEBUG nova.compute.manager [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:05:47 user nova-compute[75745]: DEBUG nova.compute.manager [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:05:47 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:05:47 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Creating image(s)
Dec 01 17:05:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:05:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "/opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:05:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "/opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:05:47 user nova-compute[75745]: DEBUG nova.policy [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e92e1fa18cc4bdaa17afd2b2db97259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4e507763844b67b588fa2509ec3aff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:05:48 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Successfully created port: ea70774b-9342-49b5-b596-1da083140c0a {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:05:48 user sudo[85003]: pam_unix(sudo:session): session closed for user root
Dec 01 17:05:48 user nova-compute[75745]: INFO oslo.privsep.daemon [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Spawned new privsep daemon via rootwrap
Dec 01 17:05:48 user nova-compute[75745]: INFO oslo.privsep.daemon [-] privsep daemon starting
Dec 01 17:05:48 user nova-compute[75745]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Dec 01 17:05:48 user nova-compute[75745]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Dec 01 17:05:48 user nova-compute[75745]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85007
Dec 01 17:05:48 user nova-compute[75745]: WARNING oslo_privsep.priv_context [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] privsep daemon already running
Dec 01 17:05:48 user nova-compute[75745]: WARNING oslo_privsep.priv_context [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] privsep daemon already running
Dec 01 17:05:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:05:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:05:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:05:48 user nova-compute[75745]: DEBUG nova.network.neutron [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Successfully created port: 7b52d740-f797-4bc8-9e0c-d9f4744e4a4f {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:05:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.203s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:05:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:05:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:05:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:05:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.213s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:05:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:05:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.217s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:05:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:05:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.218s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:05:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/b566a6fd-2ea6-4df7-8866-eab5b4d398a7/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:05:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/b566a6fd-2ea6-4df7-8866-eab5b4d398a7/disk 1073741824" returned: 0 in 0.042s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:05:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:05:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:05:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.261s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:05:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:05:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.182s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:05:48 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b566a6fd-2ea6-4df7-8866-eab5b4d398a7/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:05:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b566a6fd-2ea6-4df7-8866-eab5b4d398a7/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:05:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.210s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:05:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/dc78dcf1-f005-415c-ac27-798cab8f52fb/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:05:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/dc78dcf1-f005-415c-ac27-798cab8f52fb/disk 1073741824" returned: 0 in 0.040s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:05:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:05:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:05:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.520s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:05:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:05:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b566a6fd-2ea6-4df7-8866-eab5b4d398a7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:05:49 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Cannot resize image /opt/stack/data/nova/instances/b566a6fd-2ea6-4df7-8866-eab5b4d398a7/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:05:49 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:05:49 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Ensure instance console log exists: /opt/stack/data/nova/instances/b566a6fd-2ea6-4df7-8866-eab5b4d398a7/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:05:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:05:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:05:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:05:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.172s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:05:49 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dc78dcf1-f005-415c-ac27-798cab8f52fb/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:05:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc78dcf1-f005-415c-ac27-798cab8f52fb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:05:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.204s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:05:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:05:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk 1073741824" returned: 0 in 0.050s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:05:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:05:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:05:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc78dcf1-f005-415c-ac27-798cab8f52fb/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:05:49 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Cannot resize image /opt/stack/data/nova/instances/dc78dcf1-f005-415c-ac27-798cab8f52fb/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:05:49 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:05:49 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Ensure instance console log exists: /opt/stack/data/nova/instances/dc78dcf1-f005-415c-ac27-798cab8f52fb/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:05:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:05:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:05:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:05:49 user nova-compute[75745]: DEBUG nova.network.neutron [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Successfully created port: b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:05:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.220s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:05:49 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:05:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:05:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:05:49 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Cannot resize image /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:05:49 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:05:49 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Ensure instance console log exists: /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:05:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:05:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:05:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:05:50 user nova-compute[75745]: DEBUG nova.network.neutron [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Successfully updated port: 7b52d740-f797-4bc8-9e0c-d9f4744e4a4f {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:05:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "refresh_cache-dc78dcf1-f005-415c-ac27-798cab8f52fb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:05:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquired lock "refresh_cache-dc78dcf1-f005-415c-ac27-798cab8f52fb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:05:50 user nova-compute[75745]: DEBUG nova.network.neutron [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:05:50 user nova-compute[75745]: DEBUG nova.network.neutron [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:05:50 user nova-compute[75745]: DEBUG nova.compute.manager [req-ea59cbc7-5f58-4f85-8ec4-bf889f3f28bf req-4da49e6d-7a9d-4836-b6e0-d33881577bdd service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Received event network-changed-7b52d740-f797-4bc8-9e0c-d9f4744e4a4f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:05:50 user nova-compute[75745]: DEBUG nova.compute.manager [req-ea59cbc7-5f58-4f85-8ec4-bf889f3f28bf req-4da49e6d-7a9d-4836-b6e0-d33881577bdd service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Refreshing instance network info cache due to event network-changed-7b52d740-f797-4bc8-9e0c-d9f4744e4a4f. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:05:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ea59cbc7-5f58-4f85-8ec4-bf889f3f28bf req-4da49e6d-7a9d-4836-b6e0-d33881577bdd service nova] Acquiring lock "refresh_cache-dc78dcf1-f005-415c-ac27-798cab8f52fb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Successfully updated port: ea70774b-9342-49b5-b596-1da083140c0a {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Acquiring lock "refresh_cache-b566a6fd-2ea6-4df7-8866-eab5b4d398a7" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Acquired lock "refresh_cache-b566a6fd-2ea6-4df7-8866-eab5b4d398a7" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG nova.network.neutron [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Updating instance_info_cache with network_info: [{"id": "7b52d740-f797-4bc8-9e0c-d9f4744e4a4f", "address": "fa:16:3e:9e:67:88", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b52d740-f7", "ovs_interfaceid": "7b52d740-f797-4bc8-9e0c-d9f4744e4a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Releasing lock "refresh_cache-dc78dcf1-f005-415c-ac27-798cab8f52fb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG nova.compute.manager [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Instance network_info: |[{"id": "7b52d740-f797-4bc8-9e0c-d9f4744e4a4f", "address": "fa:16:3e:9e:67:88", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b52d740-f7", "ovs_interfaceid": "7b52d740-f797-4bc8-9e0c-d9f4744e4a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ea59cbc7-5f58-4f85-8ec4-bf889f3f28bf req-4da49e6d-7a9d-4836-b6e0-d33881577bdd service nova] Acquired lock "refresh_cache-dc78dcf1-f005-415c-ac27-798cab8f52fb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG nova.network.neutron [req-ea59cbc7-5f58-4f85-8ec4-bf889f3f28bf req-4da49e6d-7a9d-4836-b6e0-d33881577bdd service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Refreshing network info cache for port 7b52d740-f797-4bc8-9e0c-d9f4744e4a4f {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Start _get_guest_xml network_info=[{"id": "7b52d740-f797-4bc8-9e0c-d9f4744e4a4f", "address": "fa:16:3e:9e:67:88", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b52d740-f7", "ovs_interfaceid": "7b52d740-f797-4bc8-9e0c-d9f4744e4a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:05:51 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:05:51 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:05:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG nova.privsep.utils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75745) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:05:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-74686175',display_name='tempest-AttachVolumeNegativeTest-server-74686175',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-74686175',id=1,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxQbuZ6pL9AzqfCKdlXIwkonW0IJbt9/C8QwCaZVeyx0x4cqEOzW4mO6odh6GxveZ4byoy5iZhwSMd/SnUAcabevk5ic2Y34hOncfMv36jTBNq1XsSiYMc90xrJ52koZQ==',key_name='tempest-keypair-374482113',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1730419061445f98680b8c81753a4f3',ramdisk_id='',reservation_id='r-bnbil0hz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1227943771',owner_user_name='tempest-AttachVolumeNegativeTest-1227943771-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:05:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76845c98f91449df9196e19187b1b786',uuid=dc78dcf1-f005-415c-ac27-798cab8f52fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b52d740-f797-4bc8-9e0c-d9f4744e4a4f", "address": "fa:16:3e:9e:67:88", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b52d740-f7", "ovs_interfaceid": "7b52d740-f797-4bc8-9e0c-d9f4744e4a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Converting VIF {"id": "7b52d740-f797-4bc8-9e0c-d9f4744e4a4f", "address": "fa:16:3e:9e:67:88", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b52d740-f7", "ovs_interfaceid": "7b52d740-f797-4bc8-9e0c-d9f4744e4a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:67:88,bridge_name='br-int',has_traffic_filtering=True,id=7b52d740-f797-4bc8-9e0c-d9f4744e4a4f,network=Network(8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b52d740-f7') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG nova.objects.instance [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lazy-loading 'pci_devices' on Instance uuid dc78dcf1-f005-415c-ac27-798cab8f52fb {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Acquiring lock "2abc6436-bf45-497a-acd2-47d43d5e158c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:05:51 user nova-compute[75745]:   <uuid>dc78dcf1-f005-415c-ac27-798cab8f52fb</uuid>
Dec 01 17:05:51 user nova-compute[75745]:   <name>instance-00000001</name>
Dec 01 17:05:51 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:05:51 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:05:51 user nova-compute[75745]:   <metadata>
Dec 01 17:05:51 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:05:51 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:05:51 user nova-compute[75745]:       <nova:name>tempest-AttachVolumeNegativeTest-server-74686175</nova:name>
Dec 01 17:05:51 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:05:51</nova:creationTime>
Dec 01 17:05:51 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:05:51 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:05:51 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:05:51 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:05:51 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:05:51 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:05:51 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:05:51 user nova-compute[75745]:       <nova:owner>
Dec 01 17:05:51 user nova-compute[75745]:         <nova:user uuid="76845c98f91449df9196e19187b1b786">tempest-AttachVolumeNegativeTest-1227943771-project-member</nova:user>
Dec 01 17:05:51 user nova-compute[75745]:         <nova:project uuid="c1730419061445f98680b8c81753a4f3">tempest-AttachVolumeNegativeTest-1227943771</nova:project>
Dec 01 17:05:51 user nova-compute[75745]:       </nova:owner>
Dec 01 17:05:51 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:05:51 user nova-compute[75745]:       <nova:ports>
Dec 01 17:05:51 user nova-compute[75745]:         <nova:port uuid="7b52d740-f797-4bc8-9e0c-d9f4744e4a4f">
Dec 01 17:05:51 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 01 17:05:51 user nova-compute[75745]:         </nova:port>
Dec 01 17:05:51 user nova-compute[75745]:       </nova:ports>
Dec 01 17:05:51 user nova-compute[75745]:     </nova:instance>
Dec 01 17:05:51 user nova-compute[75745]:   </metadata>
Dec 01 17:05:51 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:05:51 user nova-compute[75745]:     <system>
Dec 01 17:05:51 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:05:51 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:05:51 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:05:51 user nova-compute[75745]:       <entry name="serial">dc78dcf1-f005-415c-ac27-798cab8f52fb</entry>
Dec 01 17:05:51 user nova-compute[75745]:       <entry name="uuid">dc78dcf1-f005-415c-ac27-798cab8f52fb</entry>
Dec 01 17:05:51 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:05:51 user nova-compute[75745]:     </system>
Dec 01 17:05:51 user nova-compute[75745]:   </sysinfo>
Dec 01 17:05:51 user nova-compute[75745]:   <os>
Dec 01 17:05:51 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:05:51 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:05:51 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:05:51 user nova-compute[75745]:   </os>
Dec 01 17:05:51 user nova-compute[75745]:   <features>
Dec 01 17:05:51 user nova-compute[75745]:     <acpi/>
Dec 01 17:05:51 user nova-compute[75745]:     <apic/>
Dec 01 17:05:51 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:05:51 user nova-compute[75745]:   </features>
Dec 01 17:05:51 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:05:51 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:05:51 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:05:51 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:05:51 user nova-compute[75745]:   </clock>
Dec 01 17:05:51 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:05:51 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:05:51 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:05:51 user nova-compute[75745]:   </cpu>
Dec 01 17:05:51 user nova-compute[75745]:   <devices>
Dec 01 17:05:51 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:05:51 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:05:51 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/dc78dcf1-f005-415c-ac27-798cab8f52fb/disk"/>
Dec 01 17:05:51 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:05:51 user nova-compute[75745]:     </disk>
Dec 01 17:05:51 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:05:51 user nova-compute[75745]:       <mac address="fa:16:3e:9e:67:88"/>
Dec 01 17:05:51 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:05:51 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:05:51 user nova-compute[75745]:       <target dev="tap7b52d740-f7"/>
Dec 01 17:05:51 user nova-compute[75745]:     </interface>
Dec 01 17:05:51 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:05:51 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/dc78dcf1-f005-415c-ac27-798cab8f52fb/console.log" append="off"/>
Dec 01 17:05:51 user nova-compute[75745]:     </serial>
Dec 01 17:05:51 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:05:51 user nova-compute[75745]:     <video>
Dec 01 17:05:51 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:05:51 user nova-compute[75745]:     </video>
Dec 01 17:05:51 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:05:51 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:05:51 user nova-compute[75745]:     </rng>
Dec 01 17:05:51 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:05:51 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:05:51 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:05:51 user nova-compute[75745]:     </memballoon>
Dec 01 17:05:51 user nova-compute[75745]:   </devices>
Dec 01 17:05:51 user nova-compute[75745]: </domain>
Dec 01 17:05:51 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:05:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-74686175',display_name='tempest-AttachVolumeNegativeTest-server-74686175',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-74686175',id=1,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxQbuZ6pL9AzqfCKdlXIwkonW0IJbt9/C8QwCaZVeyx0x4cqEOzW4mO6odh6GxveZ4byoy5iZhwSMd/SnUAcabevk5ic2Y34hOncfMv36jTBNq1XsSiYMc90xrJ52koZQ==',key_name='tempest-keypair-374482113',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1730419061445f98680b8c81753a4f3',ramdisk_id='',reservation_id='r-bnbil0hz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1227943771',owner_user_name='tempest-AttachVolumeNegativeTest-1227943771-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:05:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76845c98f91449df9196e19187b1b786',uuid=dc78dcf1-f005-415c-ac27-798cab8f52fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b52d740-f797-4bc8-9e0c-d9f4744e4a4f", "address": "fa:16:3e:9e:67:88", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b52d740-f7", "ovs_interfaceid": "7b52d740-f797-4bc8-9e0c-d9f4744e4a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Converting VIF {"id": "7b52d740-f797-4bc8-9e0c-d9f4744e4a4f", "address": "fa:16:3e:9e:67:88", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b52d740-f7", "ovs_interfaceid": "7b52d740-f797-4bc8-9e0c-d9f4744e4a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:67:88,bridge_name='br-int',has_traffic_filtering=True,id=7b52d740-f797-4bc8-9e0c-d9f4744e4a4f,network=Network(8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b52d740-f7') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG os_vif [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:67:88,bridge_name='br-int',has_traffic_filtering=True,id=7b52d740-f797-4bc8-9e0c-d9f4744e4a4f,network=Network(8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b52d740-f7') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG nova.compute.manager [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Created schema index Interface.name {{(pid=75745) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Created schema index Port.name {{(pid=75745) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Created schema index Bridge.name {{(pid=75745) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [POLLOUT] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-b78cc30b-6087-4ac0-a579-38292bc8b1b9 req-13ef60a5-9bef-48dd-a55f-2f1ef02171ac service nova] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Received event network-changed-ea70774b-9342-49b5-b596-1da083140c0a {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-b78cc30b-6087-4ac0-a579-38292bc8b1b9 req-13ef60a5-9bef-48dd-a55f-2f1ef02171ac service nova] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Refreshing instance network info cache due to event network-changed-ea70774b-9342-49b5-b596-1da083140c0a. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b78cc30b-6087-4ac0-a579-38292bc8b1b9 req-13ef60a5-9bef-48dd-a55f-2f1ef02171ac service nova] Acquiring lock "refresh_cache-b566a6fd-2ea6-4df7-8866-eab5b4d398a7" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '993ebb76-be6e-53bc-9dc3-822dad221d97', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:05:51 user nova-compute[75745]: INFO oslo.privsep.daemon [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpi8bm5w29/privsep.sock']
Dec 01 17:05:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:05:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:05:51 user sudo[85060]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpi8bm5w29/privsep.sock
Dec 01 17:05:51 user sudo[85060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Dec 01 17:05:51 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:05:51 user nova-compute[75745]: INFO nova.compute.claims [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Claim successful on node user
Dec 01 17:05:52 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:05:52 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:05:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:05:52 user nova-compute[75745]: DEBUG nova.compute.manager [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:05:52 user nova-compute[75745]: DEBUG nova.compute.manager [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:05:52 user nova-compute[75745]: DEBUG nova.network.neutron [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:05:52 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:05:52 user nova-compute[75745]: DEBUG nova.compute.manager [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:05:52 user nova-compute[75745]: DEBUG nova.compute.manager [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:05:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:05:52 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Creating image(s)
Dec 01 17:05:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Acquiring lock "/opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:05:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "/opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:05:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "/opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:05:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:05:52 user nova-compute[75745]: DEBUG nova.network.neutron [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Successfully updated port: b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:05:52 user nova-compute[75745]: DEBUG nova.policy [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '683fd305fb0b4c978a762e79e901fa36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1efefd35d14e03a3eebfff2ac0d335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:05:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.185s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:05:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:05:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:05:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:05:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "refresh_cache-4ac6f586-cc5b-4a3f-b374-4b2006a48427" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:05:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquired lock "refresh_cache-4ac6f586-cc5b-4a3f-b374-4b2006a48427" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:05:52 user nova-compute[75745]: DEBUG nova.network.neutron [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:05:52 user nova-compute[75745]: DEBUG nova.compute.manager [req-4cb05913-5138-4bac-9c33-67893d65e824 req-f986a872-d889-4bac-bdc3-c520419bc645 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Received event network-changed-b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:05:52 user nova-compute[75745]: DEBUG nova.compute.manager [req-4cb05913-5138-4bac-9c33-67893d65e824 req-f986a872-d889-4bac-bdc3-c520419bc645 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Refreshing instance network info cache due to event network-changed-b4990a3b-371a-44eb-98d8-685dc63590da. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:05:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-4cb05913-5138-4bac-9c33-67893d65e824 req-f986a872-d889-4bac-bdc3-c520419bc645 service nova] Acquiring lock "refresh_cache-4ac6f586-cc5b-4a3f-b374-4b2006a48427" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Updating instance_info_cache with network_info: [{"id": "ea70774b-9342-49b5-b596-1da083140c0a", "address": "fa:16:3e:48:5d:1c", "network": {"id": "004342e4-e51d-4e72-bda8-00a8e88f5e0a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2037576247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e08f6fe2b83b488ca3febd45986ed592", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea70774b-93", "ovs_interfaceid": "ea70774b-9342-49b5-b596-1da083140c0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Releasing lock "refresh_cache-b566a6fd-2ea6-4df7-8866-eab5b4d398a7" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Instance network_info: |[{"id": "ea70774b-9342-49b5-b596-1da083140c0a", "address": "fa:16:3e:48:5d:1c", "network": {"id": "004342e4-e51d-4e72-bda8-00a8e88f5e0a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2037576247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e08f6fe2b83b488ca3febd45986ed592", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea70774b-93", "ovs_interfaceid": "ea70774b-9342-49b5-b596-1da083140c0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b78cc30b-6087-4ac0-a579-38292bc8b1b9 req-13ef60a5-9bef-48dd-a55f-2f1ef02171ac service nova] Acquired lock "refresh_cache-b566a6fd-2ea6-4df7-8866-eab5b4d398a7" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.network.neutron [req-b78cc30b-6087-4ac0-a579-38292bc8b1b9 req-13ef60a5-9bef-48dd-a55f-2f1ef02171ac service nova] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Refreshing network info cache for port ea70774b-9342-49b5-b596-1da083140c0a {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Start _get_guest_xml network_info=[{"id": "ea70774b-9342-49b5-b596-1da083140c0a", "address": "fa:16:3e:48:5d:1c", "network": {"id": "004342e4-e51d-4e72-bda8-00a8e88f5e0a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2037576247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e08f6fe2b83b488ca3febd45986ed592", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea70774b-93", "ovs_interfaceid": "ea70774b-9342-49b5-b596-1da083140c0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:05:53 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:05:53 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.237s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:05:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1369399865',display_name='tempest-DeleteServersTestJSON-server-1369399865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1369399865',id=2,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e08f6fe2b83b488ca3febd45986ed592',ramdisk_id='',reservation_id='r-ca9c753f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-13375027',owner_user_name='tempest-DeleteServersTestJSON-13375027-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:05:46Z,user_data=None,user_id='4ad569596dc749f1a20e0bd4a1594a18',uuid=b566a6fd-2ea6-4df7-8866-eab5b4d398a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea70774b-9342-49b5-b596-1da083140c0a", "address": "fa:16:3e:48:5d:1c", "network": {"id": "004342e4-e51d-4e72-bda8-00a8e88f5e0a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2037576247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e08f6fe2b83b488ca3febd45986ed592", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea70774b-93", "ovs_interfaceid": "ea70774b-9342-49b5-b596-1da083140c0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Converting VIF {"id": "ea70774b-9342-49b5-b596-1da083140c0a", "address": "fa:16:3e:48:5d:1c", "network": {"id": "004342e4-e51d-4e72-bda8-00a8e88f5e0a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2037576247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e08f6fe2b83b488ca3febd45986ed592", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea70774b-93", "ovs_interfaceid": "ea70774b-9342-49b5-b596-1da083140c0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:5d:1c,bridge_name='br-int',has_traffic_filtering=True,id=ea70774b-9342-49b5-b596-1da083140c0a,network=Network(004342e4-e51d-4e72-bda8-00a8e88f5e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea70774b-93') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.objects.instance [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Lazy-loading 'pci_devices' on Instance uuid b566a6fd-2ea6-4df7-8866-eab5b4d398a7 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.network.neutron [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk 1073741824" returned: 0 in 0.120s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.361s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:05:53 user nova-compute[75745]:   <uuid>b566a6fd-2ea6-4df7-8866-eab5b4d398a7</uuid>
Dec 01 17:05:53 user nova-compute[75745]:   <name>instance-00000002</name>
Dec 01 17:05:53 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:05:53 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:05:53 user nova-compute[75745]:   <metadata>
Dec 01 17:05:53 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:05:53 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:05:53 user nova-compute[75745]:       <nova:name>tempest-DeleteServersTestJSON-server-1369399865</nova:name>
Dec 01 17:05:53 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:05:53</nova:creationTime>
Dec 01 17:05:53 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:05:53 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:05:53 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:05:53 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:05:53 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:05:53 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:05:53 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:05:53 user nova-compute[75745]:       <nova:owner>
Dec 01 17:05:53 user nova-compute[75745]:         <nova:user uuid="4ad569596dc749f1a20e0bd4a1594a18">tempest-DeleteServersTestJSON-13375027-project-member</nova:user>
Dec 01 17:05:53 user nova-compute[75745]:         <nova:project uuid="e08f6fe2b83b488ca3febd45986ed592">tempest-DeleteServersTestJSON-13375027</nova:project>
Dec 01 17:05:53 user nova-compute[75745]:       </nova:owner>
Dec 01 17:05:53 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:05:53 user nova-compute[75745]:       <nova:ports>
Dec 01 17:05:53 user nova-compute[75745]:         <nova:port uuid="ea70774b-9342-49b5-b596-1da083140c0a">
Dec 01 17:05:53 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 01 17:05:53 user nova-compute[75745]:         </nova:port>
Dec 01 17:05:53 user nova-compute[75745]:       </nova:ports>
Dec 01 17:05:53 user nova-compute[75745]:     </nova:instance>
Dec 01 17:05:53 user nova-compute[75745]:   </metadata>
Dec 01 17:05:53 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:05:53 user nova-compute[75745]:     <system>
Dec 01 17:05:53 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:05:53 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:05:53 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:05:53 user nova-compute[75745]:       <entry name="serial">b566a6fd-2ea6-4df7-8866-eab5b4d398a7</entry>
Dec 01 17:05:53 user nova-compute[75745]:       <entry name="uuid">b566a6fd-2ea6-4df7-8866-eab5b4d398a7</entry>
Dec 01 17:05:53 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:05:53 user nova-compute[75745]:     </system>
Dec 01 17:05:53 user nova-compute[75745]:   </sysinfo>
Dec 01 17:05:53 user nova-compute[75745]:   <os>
Dec 01 17:05:53 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:05:53 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:05:53 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:05:53 user nova-compute[75745]:   </os>
Dec 01 17:05:53 user nova-compute[75745]:   <features>
Dec 01 17:05:53 user nova-compute[75745]:     <acpi/>
Dec 01 17:05:53 user nova-compute[75745]:     <apic/>
Dec 01 17:05:53 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:05:53 user nova-compute[75745]:   </features>
Dec 01 17:05:53 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:05:53 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:05:53 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:05:53 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:05:53 user nova-compute[75745]:   </clock>
Dec 01 17:05:53 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:05:53 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:05:53 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:05:53 user nova-compute[75745]:   </cpu>
Dec 01 17:05:53 user nova-compute[75745]:   <devices>
Dec 01 17:05:53 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:05:53 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:05:53 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/b566a6fd-2ea6-4df7-8866-eab5b4d398a7/disk"/>
Dec 01 17:05:53 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:05:53 user nova-compute[75745]:     </disk>
Dec 01 17:05:53 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:05:53 user nova-compute[75745]:       <mac address="fa:16:3e:48:5d:1c"/>
Dec 01 17:05:53 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:05:53 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:05:53 user nova-compute[75745]:       <target dev="tapea70774b-93"/>
Dec 01 17:05:53 user nova-compute[75745]:     </interface>
Dec 01 17:05:53 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:05:53 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/b566a6fd-2ea6-4df7-8866-eab5b4d398a7/console.log" append="off"/>
Dec 01 17:05:53 user nova-compute[75745]:     </serial>
Dec 01 17:05:53 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:05:53 user nova-compute[75745]:     <video>
Dec 01 17:05:53 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:05:53 user nova-compute[75745]:     </video>
Dec 01 17:05:53 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:05:53 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:05:53 user nova-compute[75745]:     </rng>
Dec 01 17:05:53 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:05:53 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:05:53 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:05:53 user nova-compute[75745]:     </memballoon>
Dec 01 17:05:53 user nova-compute[75745]:   </devices>
Dec 01 17:05:53 user nova-compute[75745]: </domain>
Dec 01 17:05:53 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:05:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1369399865',display_name='tempest-DeleteServersTestJSON-server-1369399865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1369399865',id=2,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e08f6fe2b83b488ca3febd45986ed592',ramdisk_id='',reservation_id='r-ca9c753f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-13375027',owner_user_name='tempest-DeleteServersTestJSON-13375027-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:05:46Z,user_data=None,user_id='4ad569596dc749f1a20e0bd4a1594a18',uuid=b566a6fd-2ea6-4df7-8866-eab5b4d398a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea70774b-9342-49b5-b596-1da083140c0a", "address": "fa:16:3e:48:5d:1c", "network": {"id": "004342e4-e51d-4e72-bda8-00a8e88f5e0a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2037576247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e08f6fe2b83b488ca3febd45986ed592", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea70774b-93", "ovs_interfaceid": "ea70774b-9342-49b5-b596-1da083140c0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Converting VIF {"id": "ea70774b-9342-49b5-b596-1da083140c0a", "address": "fa:16:3e:48:5d:1c", "network": {"id": "004342e4-e51d-4e72-bda8-00a8e88f5e0a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2037576247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e08f6fe2b83b488ca3febd45986ed592", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea70774b-93", "ovs_interfaceid": "ea70774b-9342-49b5-b596-1da083140c0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:5d:1c,bridge_name='br-int',has_traffic_filtering=True,id=ea70774b-9342-49b5-b596-1da083140c0a,network=Network(004342e4-e51d-4e72-bda8-00a8e88f5e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea70774b-93') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG os_vif [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:5d:1c,bridge_name='br-int',has_traffic_filtering=True,id=ea70774b-9342-49b5-b596-1da083140c0a,network=Network(004342e4-e51d-4e72-bda8-00a8e88f5e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea70774b-93') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a8d847d9-fcc4-5daa-80de-3b23f3f98bf7', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.200s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.network.neutron [req-ea59cbc7-5f58-4f85-8ec4-bf889f3f28bf req-4da49e6d-7a9d-4836-b6e0-d33881577bdd service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Updated VIF entry in instance network info cache for port 7b52d740-f797-4bc8-9e0c-d9f4744e4a4f. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.network.neutron [req-ea59cbc7-5f58-4f85-8ec4-bf889f3f28bf req-4da49e6d-7a9d-4836-b6e0-d33881577bdd service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Updating instance_info_cache with network_info: [{"id": "7b52d740-f797-4bc8-9e0c-d9f4744e4a4f", "address": "fa:16:3e:9e:67:88", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b52d740-f7", "ovs_interfaceid": "7b52d740-f797-4bc8-9e0c-d9f4744e4a4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:05:53 user sudo[85060]: pam_unix(sudo:session): session closed for user root
Dec 01 17:05:53 user nova-compute[75745]: INFO oslo.privsep.daemon [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Spawned new privsep daemon via rootwrap
Dec 01 17:05:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ea59cbc7-5f58-4f85-8ec4-bf889f3f28bf req-4da49e6d-7a9d-4836-b6e0-d33881577bdd service nova] Releasing lock "refresh_cache-dc78dcf1-f005-415c-ac27-798cab8f52fb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:05:53 user nova-compute[75745]: INFO oslo.privsep.daemon [-] privsep daemon starting
Dec 01 17:05:53 user nova-compute[75745]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Dec 01 17:05:53 user nova-compute[75745]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Dec 01 17:05:53 user nova-compute[75745]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85073
Dec 01 17:05:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:53 user nova-compute[75745]: WARNING oslo_privsep.priv_context [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] privsep daemon already running
Dec 01 17:05:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Cannot resize image /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Ensure instance console log exists: /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.network.neutron [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Updating instance_info_cache with network_info: [{"id": "b4990a3b-371a-44eb-98d8-685dc63590da", "address": "fa:16:3e:d3:4e:b4", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4990a3b-37", "ovs_interfaceid": "b4990a3b-371a-44eb-98d8-685dc63590da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Releasing lock "refresh_cache-4ac6f586-cc5b-4a3f-b374-4b2006a48427" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.compute.manager [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Instance network_info: |[{"id": "b4990a3b-371a-44eb-98d8-685dc63590da", "address": "fa:16:3e:d3:4e:b4", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4990a3b-37", "ovs_interfaceid": "b4990a3b-371a-44eb-98d8-685dc63590da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-4cb05913-5138-4bac-9c33-67893d65e824 req-f986a872-d889-4bac-bdc3-c520419bc645 service nova] Acquired lock "refresh_cache-4ac6f586-cc5b-4a3f-b374-4b2006a48427" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.network.neutron [req-4cb05913-5138-4bac-9c33-67893d65e824 req-f986a872-d889-4bac-bdc3-c520419bc645 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Refreshing network info cache for port b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Start _get_guest_xml network_info=[{"id": "b4990a3b-371a-44eb-98d8-685dc63590da", "address": "fa:16:3e:d3:4e:b4", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4990a3b-37", "ovs_interfaceid": "b4990a3b-371a-44eb-98d8-685dc63590da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:05:53 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:05:53 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:05:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2091565177',display_name='tempest-AttachVolumeTestJSON-server-2091565177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2091565177',id=3,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3XjkUwzRZSzJkFVK8CajxZrqSjgRTlHxxeyK14q4pHPTuyqvoLAZM+Yf8NfQQKwzsK8V31lsj4YBhMGkfSH1VtWc/GskdhpcUVvoTFK+eiPPk/qO2e2As1y2z8e2iGKw==',key_name='tempest-keypair-811365711',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c4e507763844b67b588fa2509ec3aff',ramdisk_id='',reservation_id='r-38xwk32b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-712829532',owner_user_name='tempest-AttachVolumeTestJSON-712829532-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:05:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e92e1fa18cc4bdaa17afd2b2db97259',uuid=4ac6f586-cc5b-4a3f-b374-4b2006a48427,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4990a3b-371a-44eb-98d8-685dc63590da", "address": "fa:16:3e:d3:4e:b4", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4990a3b-37", "ovs_interfaceid": "b4990a3b-371a-44eb-98d8-685dc63590da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Converting VIF {"id": "b4990a3b-371a-44eb-98d8-685dc63590da", "address": "fa:16:3e:d3:4e:b4", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4990a3b-37", "ovs_interfaceid": "b4990a3b-371a-44eb-98d8-685dc63590da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:4e:b4,bridge_name='br-int',has_traffic_filtering=True,id=b4990a3b-371a-44eb-98d8-685dc63590da,network=Network(b2b1c054-5370-4c64-9fb7-b98791c8f5ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4990a3b-37') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.objects.instance [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ac6f586-cc5b-4a3f-b374-4b2006a48427 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:05:53 user nova-compute[75745]:   <uuid>4ac6f586-cc5b-4a3f-b374-4b2006a48427</uuid>
Dec 01 17:05:53 user nova-compute[75745]:   <name>instance-00000003</name>
Dec 01 17:05:53 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:05:53 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:05:53 user nova-compute[75745]:   <metadata>
Dec 01 17:05:53 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:05:53 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:05:53 user nova-compute[75745]:       <nova:name>tempest-AttachVolumeTestJSON-server-2091565177</nova:name>
Dec 01 17:05:53 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:05:53</nova:creationTime>
Dec 01 17:05:53 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:05:53 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:05:53 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:05:53 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:05:53 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:05:53 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:05:53 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:05:53 user nova-compute[75745]:       <nova:owner>
Dec 01 17:05:53 user nova-compute[75745]:         <nova:user uuid="7e92e1fa18cc4bdaa17afd2b2db97259">tempest-AttachVolumeTestJSON-712829532-project-member</nova:user>
Dec 01 17:05:53 user nova-compute[75745]:         <nova:project uuid="7c4e507763844b67b588fa2509ec3aff">tempest-AttachVolumeTestJSON-712829532</nova:project>
Dec 01 17:05:53 user nova-compute[75745]:       </nova:owner>
Dec 01 17:05:53 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:05:53 user nova-compute[75745]:       <nova:ports>
Dec 01 17:05:53 user nova-compute[75745]:         <nova:port uuid="b4990a3b-371a-44eb-98d8-685dc63590da">
Dec 01 17:05:53 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 01 17:05:53 user nova-compute[75745]:         </nova:port>
Dec 01 17:05:53 user nova-compute[75745]:       </nova:ports>
Dec 01 17:05:53 user nova-compute[75745]:     </nova:instance>
Dec 01 17:05:53 user nova-compute[75745]:   </metadata>
Dec 01 17:05:53 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:05:53 user nova-compute[75745]:     <system>
Dec 01 17:05:53 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:05:53 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:05:53 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:05:53 user nova-compute[75745]:       <entry name="serial">4ac6f586-cc5b-4a3f-b374-4b2006a48427</entry>
Dec 01 17:05:53 user nova-compute[75745]:       <entry name="uuid">4ac6f586-cc5b-4a3f-b374-4b2006a48427</entry>
Dec 01 17:05:53 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:05:53 user nova-compute[75745]:     </system>
Dec 01 17:05:53 user nova-compute[75745]:   </sysinfo>
Dec 01 17:05:53 user nova-compute[75745]:   <os>
Dec 01 17:05:53 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:05:53 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:05:53 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:05:53 user nova-compute[75745]:   </os>
Dec 01 17:05:53 user nova-compute[75745]:   <features>
Dec 01 17:05:53 user nova-compute[75745]:     <acpi/>
Dec 01 17:05:53 user nova-compute[75745]:     <apic/>
Dec 01 17:05:53 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:05:53 user nova-compute[75745]:   </features>
Dec 01 17:05:53 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:05:53 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:05:53 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:05:53 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:05:53 user nova-compute[75745]:   </clock>
Dec 01 17:05:53 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:05:53 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:05:53 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:05:53 user nova-compute[75745]:   </cpu>
Dec 01 17:05:53 user nova-compute[75745]:   <devices>
Dec 01 17:05:53 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:05:53 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:05:53 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk"/>
Dec 01 17:05:53 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:05:53 user nova-compute[75745]:     </disk>
Dec 01 17:05:53 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:05:53 user nova-compute[75745]:       <mac address="fa:16:3e:d3:4e:b4"/>
Dec 01 17:05:53 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:05:53 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:05:53 user nova-compute[75745]:       <target dev="tapb4990a3b-37"/>
Dec 01 17:05:53 user nova-compute[75745]:     </interface>
Dec 01 17:05:53 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:05:53 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/console.log" append="off"/>
Dec 01 17:05:53 user nova-compute[75745]:     </serial>
Dec 01 17:05:53 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:05:53 user nova-compute[75745]:     <video>
Dec 01 17:05:53 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:05:53 user nova-compute[75745]:     </video>
Dec 01 17:05:53 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:05:53 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:05:53 user nova-compute[75745]:     </rng>
Dec 01 17:05:53 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:05:53 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:05:53 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:05:53 user nova-compute[75745]:     </memballoon>
Dec 01 17:05:53 user nova-compute[75745]:   </devices>
Dec 01 17:05:53 user nova-compute[75745]: </domain>
Dec 01 17:05:53 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:05:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2091565177',display_name='tempest-AttachVolumeTestJSON-server-2091565177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2091565177',id=3,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3XjkUwzRZSzJkFVK8CajxZrqSjgRTlHxxeyK14q4pHPTuyqvoLAZM+Yf8NfQQKwzsK8V31lsj4YBhMGkfSH1VtWc/GskdhpcUVvoTFK+eiPPk/qO2e2As1y2z8e2iGKw==',key_name='tempest-keypair-811365711',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c4e507763844b67b588fa2509ec3aff',ramdisk_id='',reservation_id='r-38xwk32b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-712829532',owner_user_name='tempest-AttachVolumeTestJSON-712829532-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:05:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e92e1fa18cc4bdaa17afd2b2db97259',uuid=4ac6f586-cc5b-4a3f-b374-4b2006a48427,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4990a3b-371a-44eb-98d8-685dc63590da", "address": "fa:16:3e:d3:4e:b4", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4990a3b-37", "ovs_interfaceid": "b4990a3b-371a-44eb-98d8-685dc63590da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Converting VIF {"id": "b4990a3b-371a-44eb-98d8-685dc63590da", "address": "fa:16:3e:d3:4e:b4", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4990a3b-37", "ovs_interfaceid": "b4990a3b-371a-44eb-98d8-685dc63590da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:4e:b4,bridge_name='br-int',has_traffic_filtering=True,id=b4990a3b-371a-44eb-98d8-685dc63590da,network=Network(b2b1c054-5370-4c64-9fb7-b98791c8f5ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4990a3b-37') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG os_vif [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:4e:b4,bridge_name='br-int',has_traffic_filtering=True,id=b4990a3b-371a-44eb-98d8-685dc63590da,network=Network(b2b1c054-5370-4c64-9fb7-b98791c8f5ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4990a3b-37') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '84adab1e-4b86-5406-9964-83fef1e265db', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:05:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b52d740-f7, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:05:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7b52d740-f7, col_values=(('qos', UUID('9f0fd05c-192d-4450-bd89-a692b7aa14c3')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:05:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7b52d740-f7, col_values=(('external_ids', {'iface-id': '7b52d740-f797-4bc8-9e0c-d9f4744e4a4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:67:88', 'vm-uuid': 'dc78dcf1-f005-415c-ac27-798cab8f52fb'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:05:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:05:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4990a3b-37, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:05:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb4990a3b-37, col_values=(('qos', UUID('e80615b7-d9e0-45b8-b476-2f5923317ef6')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:05:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb4990a3b-37, col_values=(('external_ids', {'iface-id': 'b4990a3b-371a-44eb-98d8-685dc63590da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:4e:b4', 'vm-uuid': '4ac6f586-cc5b-4a3f-b374-4b2006a48427'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:05:54 user nova-compute[75745]: INFO os_vif [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:67:88,bridge_name='br-int',has_traffic_filtering=True,id=7b52d740-f797-4bc8-9e0c-d9f4744e4a4f,network=Network(8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b52d740-f7')
Dec 01 17:05:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:05:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:54 user nova-compute[75745]: INFO os_vif [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:4e:b4,bridge_name='br-int',has_traffic_filtering=True,id=b4990a3b-371a-44eb-98d8-685dc63590da,network=Network(b2b1c054-5370-4c64-9fb7-b98791c8f5ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4990a3b-37')
Dec 01 17:05:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea70774b-93, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:05:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea70774b-93, col_values=(('qos', UUID('c6faf5a9-fd2c-4fe3-8832-b3b6f8a54554')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:05:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea70774b-93, col_values=(('external_ids', {'iface-id': 'ea70774b-9342-49b5-b596-1da083140c0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:5d:1c', 'vm-uuid': 'b566a6fd-2ea6-4df7-8866-eab5b4d398a7'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:05:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:05:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:54 user nova-compute[75745]: INFO os_vif [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:5d:1c,bridge_name='br-int',has_traffic_filtering=True,id=ea70774b-9342-49b5-b596-1da083140c0a,network=Network(004342e4-e51d-4e72-bda8-00a8e88f5e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea70774b-93')
Dec 01 17:05:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:05:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] No VIF found with MAC fa:16:3e:9e:67:88, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:05:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:05:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] No VIF found with MAC fa:16:3e:d3:4e:b4, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:05:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:05:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] No VIF found with MAC fa:16:3e:48:5d:1c, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:05:54 user nova-compute[75745]: DEBUG nova.network.neutron [req-4cb05913-5138-4bac-9c33-67893d65e824 req-f986a872-d889-4bac-bdc3-c520419bc645 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Updated VIF entry in instance network info cache for port b4990a3b-371a-44eb-98d8-685dc63590da. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:05:54 user nova-compute[75745]: DEBUG nova.network.neutron [req-4cb05913-5138-4bac-9c33-67893d65e824 req-f986a872-d889-4bac-bdc3-c520419bc645 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Updating instance_info_cache with network_info: [{"id": "b4990a3b-371a-44eb-98d8-685dc63590da", "address": "fa:16:3e:d3:4e:b4", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4990a3b-37", "ovs_interfaceid": "b4990a3b-371a-44eb-98d8-685dc63590da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:05:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-4cb05913-5138-4bac-9c33-67893d65e824 req-f986a872-d889-4bac-bdc3-c520419bc645 service nova] Releasing lock "refresh_cache-4ac6f586-cc5b-4a3f-b374-4b2006a48427" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:05:54 user nova-compute[75745]: DEBUG nova.network.neutron [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Successfully created port: 5897fde5-fea9-4ff3-98b8-db1020cf5127 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:05:54 user nova-compute[75745]: DEBUG nova.network.neutron [req-b78cc30b-6087-4ac0-a579-38292bc8b1b9 req-13ef60a5-9bef-48dd-a55f-2f1ef02171ac service nova] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Updated VIF entry in instance network info cache for port ea70774b-9342-49b5-b596-1da083140c0a. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:05:54 user nova-compute[75745]: DEBUG nova.network.neutron [req-b78cc30b-6087-4ac0-a579-38292bc8b1b9 req-13ef60a5-9bef-48dd-a55f-2f1ef02171ac service nova] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Updating instance_info_cache with network_info: [{"id": "ea70774b-9342-49b5-b596-1da083140c0a", "address": "fa:16:3e:48:5d:1c", "network": {"id": "004342e4-e51d-4e72-bda8-00a8e88f5e0a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2037576247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e08f6fe2b83b488ca3febd45986ed592", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea70774b-93", "ovs_interfaceid": "ea70774b-9342-49b5-b596-1da083140c0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:05:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b78cc30b-6087-4ac0-a579-38292bc8b1b9 req-13ef60a5-9bef-48dd-a55f-2f1ef02171ac service nova] Releasing lock "refresh_cache-b566a6fd-2ea6-4df7-8866-eab5b4d398a7" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:05:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:57 user nova-compute[75745]: DEBUG nova.network.neutron [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Successfully updated port: 5897fde5-fea9-4ff3-98b8-db1020cf5127 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:05:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Acquiring lock "refresh_cache-2abc6436-bf45-497a-acd2-47d43d5e158c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:05:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Acquired lock "refresh_cache-2abc6436-bf45-497a-acd2-47d43d5e158c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:05:57 user nova-compute[75745]: DEBUG nova.network.neutron [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:05:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:57 user nova-compute[75745]: DEBUG nova.network.neutron [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:05:57 user nova-compute[75745]: DEBUG nova.compute.manager [req-ff4a6e80-87d3-47bd-a24b-c6a0e93e1493 req-c5a0c2d9-1c2e-46cb-b639-4ee118e82a31 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Received event network-changed-5897fde5-fea9-4ff3-98b8-db1020cf5127 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:05:57 user nova-compute[75745]: DEBUG nova.compute.manager [req-ff4a6e80-87d3-47bd-a24b-c6a0e93e1493 req-c5a0c2d9-1c2e-46cb-b639-4ee118e82a31 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Refreshing instance network info cache due to event network-changed-5897fde5-fea9-4ff3-98b8-db1020cf5127. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:05:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ff4a6e80-87d3-47bd-a24b-c6a0e93e1493 req-c5a0c2d9-1c2e-46cb-b639-4ee118e82a31 service nova] Acquiring lock "refresh_cache-2abc6436-bf45-497a-acd2-47d43d5e158c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:05:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG nova.network.neutron [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Updating instance_info_cache with network_info: [{"id": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "address": "fa:16:3e:66:74:ba", "network": {"id": "3d78774f-ff2b-4705-b359-7a1fb7fc272f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-234182378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1efefd35d14e03a3eebfff2ac0d335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5897fde5-fe", "ovs_interfaceid": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Releasing lock "refresh_cache-2abc6436-bf45-497a-acd2-47d43d5e158c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG nova.compute.manager [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Instance network_info: |[{"id": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "address": "fa:16:3e:66:74:ba", "network": {"id": "3d78774f-ff2b-4705-b359-7a1fb7fc272f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-234182378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1efefd35d14e03a3eebfff2ac0d335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5897fde5-fe", "ovs_interfaceid": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ff4a6e80-87d3-47bd-a24b-c6a0e93e1493 req-c5a0c2d9-1c2e-46cb-b639-4ee118e82a31 service nova] Acquired lock "refresh_cache-2abc6436-bf45-497a-acd2-47d43d5e158c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG nova.network.neutron [req-ff4a6e80-87d3-47bd-a24b-c6a0e93e1493 req-c5a0c2d9-1c2e-46cb-b639-4ee118e82a31 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Refreshing network info cache for port 5897fde5-fea9-4ff3-98b8-db1020cf5127 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Start _get_guest_xml network_info=[{"id": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "address": "fa:16:3e:66:74:ba", "network": {"id": "3d78774f-ff2b-4705-b359-7a1fb7fc272f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-234182378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1efefd35d14e03a3eebfff2ac0d335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5897fde5-fe", "ovs_interfaceid": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:05:58 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:05:58 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:05:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:05:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1767622081',display_name='tempest-ServerStableDeviceRescueTest-server-1767622081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1767622081',id=4,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDp6Xk0Jeq39zNj7o2b3I/4McvYNabWuSHGIAAfwXUIskcvOUTL7Ihwn85mCvmRB2rKQsuxT0meUWSqSSoPSMQuH6KX6uS91/fBFZ5QCBCit5t+fzh+i6OT0756vLnrQNQ==',key_name='tempest-keypair-274950354',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c1efefd35d14e03a3eebfff2ac0d335',ramdisk_id='',reservation_id='r-s1zydaxk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1685174732',owner_user_name='tempest-ServerStableDeviceRescueTest-1685174732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:05:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='683fd305fb0b4c978a762e79e901fa36',uuid=2abc6436-bf45-497a-acd2-47d43d5e158c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "address": "fa:16:3e:66:74:ba", "network": {"id": "3d78774f-ff2b-4705-b359-7a1fb7fc272f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-234182378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1efefd35d14e03a3eebfff2ac0d335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5897fde5-fe", "ovs_interfaceid": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Converting VIF {"id": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "address": "fa:16:3e:66:74:ba", "network": {"id": "3d78774f-ff2b-4705-b359-7a1fb7fc272f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-234182378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1efefd35d14e03a3eebfff2ac0d335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5897fde5-fe", "ovs_interfaceid": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:74:ba,bridge_name='br-int',has_traffic_filtering=True,id=5897fde5-fea9-4ff3-98b8-db1020cf5127,network=Network(3d78774f-ff2b-4705-b359-7a1fb7fc272f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5897fde5-fe') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG nova.objects.instance [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lazy-loading 'pci_devices' on Instance uuid 2abc6436-bf45-497a-acd2-47d43d5e158c {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:05:58 user nova-compute[75745]:   <uuid>2abc6436-bf45-497a-acd2-47d43d5e158c</uuid>
Dec 01 17:05:58 user nova-compute[75745]:   <name>instance-00000004</name>
Dec 01 17:05:58 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:05:58 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:05:58 user nova-compute[75745]:   <metadata>
Dec 01 17:05:58 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:05:58 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:05:58 user nova-compute[75745]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1767622081</nova:name>
Dec 01 17:05:58 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:05:58</nova:creationTime>
Dec 01 17:05:58 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:05:58 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:05:58 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:05:58 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:05:58 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:05:58 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:05:58 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:05:58 user nova-compute[75745]:       <nova:owner>
Dec 01 17:05:58 user nova-compute[75745]:         <nova:user uuid="683fd305fb0b4c978a762e79e901fa36">tempest-ServerStableDeviceRescueTest-1685174732-project-member</nova:user>
Dec 01 17:05:58 user nova-compute[75745]:         <nova:project uuid="0c1efefd35d14e03a3eebfff2ac0d335">tempest-ServerStableDeviceRescueTest-1685174732</nova:project>
Dec 01 17:05:58 user nova-compute[75745]:       </nova:owner>
Dec 01 17:05:58 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:05:58 user nova-compute[75745]:       <nova:ports>
Dec 01 17:05:58 user nova-compute[75745]:         <nova:port uuid="5897fde5-fea9-4ff3-98b8-db1020cf5127">
Dec 01 17:05:58 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 01 17:05:58 user nova-compute[75745]:         </nova:port>
Dec 01 17:05:58 user nova-compute[75745]:       </nova:ports>
Dec 01 17:05:58 user nova-compute[75745]:     </nova:instance>
Dec 01 17:05:58 user nova-compute[75745]:   </metadata>
Dec 01 17:05:58 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:05:58 user nova-compute[75745]:     <system>
Dec 01 17:05:58 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:05:58 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:05:58 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:05:58 user nova-compute[75745]:       <entry name="serial">2abc6436-bf45-497a-acd2-47d43d5e158c</entry>
Dec 01 17:05:58 user nova-compute[75745]:       <entry name="uuid">2abc6436-bf45-497a-acd2-47d43d5e158c</entry>
Dec 01 17:05:58 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:05:58 user nova-compute[75745]:     </system>
Dec 01 17:05:58 user nova-compute[75745]:   </sysinfo>
Dec 01 17:05:58 user nova-compute[75745]:   <os>
Dec 01 17:05:58 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:05:58 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:05:58 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:05:58 user nova-compute[75745]:   </os>
Dec 01 17:05:58 user nova-compute[75745]:   <features>
Dec 01 17:05:58 user nova-compute[75745]:     <acpi/>
Dec 01 17:05:58 user nova-compute[75745]:     <apic/>
Dec 01 17:05:58 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:05:58 user nova-compute[75745]:   </features>
Dec 01 17:05:58 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:05:58 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:05:58 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:05:58 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:05:58 user nova-compute[75745]:   </clock>
Dec 01 17:05:58 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:05:58 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:05:58 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:05:58 user nova-compute[75745]:   </cpu>
Dec 01 17:05:58 user nova-compute[75745]:   <devices>
Dec 01 17:05:58 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:05:58 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:05:58 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk"/>
Dec 01 17:05:58 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:05:58 user nova-compute[75745]:     </disk>
Dec 01 17:05:58 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:05:58 user nova-compute[75745]:       <mac address="fa:16:3e:66:74:ba"/>
Dec 01 17:05:58 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:05:58 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:05:58 user nova-compute[75745]:       <target dev="tap5897fde5-fe"/>
Dec 01 17:05:58 user nova-compute[75745]:     </interface>
Dec 01 17:05:58 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:05:58 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/console.log" append="off"/>
Dec 01 17:05:58 user nova-compute[75745]:     </serial>
Dec 01 17:05:58 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:05:58 user nova-compute[75745]:     <video>
Dec 01 17:05:58 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:05:58 user nova-compute[75745]:     </video>
Dec 01 17:05:58 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:05:58 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:05:58 user nova-compute[75745]:     </rng>
Dec 01 17:05:58 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:05:58 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:05:58 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:05:58 user nova-compute[75745]:     </memballoon>
Dec 01 17:05:58 user nova-compute[75745]:   </devices>
Dec 01 17:05:58 user nova-compute[75745]: </domain>
Dec 01 17:05:58 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:05:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1767622081',display_name='tempest-ServerStableDeviceRescueTest-server-1767622081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1767622081',id=4,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDp6Xk0Jeq39zNj7o2b3I/4McvYNabWuSHGIAAfwXUIskcvOUTL7Ihwn85mCvmRB2rKQsuxT0meUWSqSSoPSMQuH6KX6uS91/fBFZ5QCBCit5t+fzh+i6OT0756vLnrQNQ==',key_name='tempest-keypair-274950354',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c1efefd35d14e03a3eebfff2ac0d335',ramdisk_id='',reservation_id='r-s1zydaxk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1685174732',owner_user_name='tempest-ServerStableDeviceRescueTest-1685174732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:05:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='683fd305fb0b4c978a762e79e901fa36',uuid=2abc6436-bf45-497a-acd2-47d43d5e158c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "address": "fa:16:3e:66:74:ba", "network": {"id": "3d78774f-ff2b-4705-b359-7a1fb7fc272f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-234182378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1efefd35d14e03a3eebfff2ac0d335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5897fde5-fe", "ovs_interfaceid": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Converting VIF {"id": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "address": "fa:16:3e:66:74:ba", "network": {"id": "3d78774f-ff2b-4705-b359-7a1fb7fc272f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-234182378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1efefd35d14e03a3eebfff2ac0d335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5897fde5-fe", "ovs_interfaceid": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:74:ba,bridge_name='br-int',has_traffic_filtering=True,id=5897fde5-fea9-4ff3-98b8-db1020cf5127,network=Network(3d78774f-ff2b-4705-b359-7a1fb7fc272f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5897fde5-fe') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG os_vif [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:74:ba,bridge_name='br-int',has_traffic_filtering=True,id=5897fde5-fea9-4ff3-98b8-db1020cf5127,network=Network(3d78774f-ff2b-4705-b359-7a1fb7fc272f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5897fde5-fe') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e59adff-d532-5925-ac06-ce0d4ea18076', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5897fde5-fe, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5897fde5-fe, col_values=(('qos', UUID('e027bfb7-3228-47b6-8acd-e13dc4371e6f')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5897fde5-fe, col_values=(('external_ids', {'iface-id': '5897fde5-fea9-4ff3-98b8-db1020cf5127', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:74:ba', 'vm-uuid': '2abc6436-bf45-497a-acd2-47d43d5e158c'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:58 user nova-compute[75745]: INFO os_vif [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:74:ba,bridge_name='br-int',has_traffic_filtering=True,id=5897fde5-fea9-4ff3-98b8-db1020cf5127,network=Network(3d78774f-ff2b-4705-b359-7a1fb7fc272f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5897fde5-fe')
Dec 01 17:05:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:05:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] No VIF found with MAC fa:16:3e:66:74:ba, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:05:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:05:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:00 user nova-compute[75745]: DEBUG nova.network.neutron [req-ff4a6e80-87d3-47bd-a24b-c6a0e93e1493 req-c5a0c2d9-1c2e-46cb-b639-4ee118e82a31 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Updated VIF entry in instance network info cache for port 5897fde5-fea9-4ff3-98b8-db1020cf5127. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:06:00 user nova-compute[75745]: DEBUG nova.network.neutron [req-ff4a6e80-87d3-47bd-a24b-c6a0e93e1493 req-c5a0c2d9-1c2e-46cb-b639-4ee118e82a31 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Updating instance_info_cache with network_info: [{"id": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "address": "fa:16:3e:66:74:ba", "network": {"id": "3d78774f-ff2b-4705-b359-7a1fb7fc272f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-234182378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1efefd35d14e03a3eebfff2ac0d335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5897fde5-fe", "ovs_interfaceid": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:06:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ff4a6e80-87d3-47bd-a24b-c6a0e93e1493 req-c5a0c2d9-1c2e-46cb-b639-4ee118e82a31 service nova] Releasing lock "refresh_cache-2abc6436-bf45-497a-acd2-47d43d5e158c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:06:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:01 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:06:01 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:06:01 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Instance spawned successfully.
Dec 01 17:06:01 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:06:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:02 user nova-compute[75745]: DEBUG nova.compute.manager [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:06:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:06:02 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Instance spawned successfully.
Dec 01 17:06:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:06:02 user nova-compute[75745]: INFO nova.compute.manager [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Took 15.72 seconds to spawn the instance on the hypervisor.
Dec 01 17:06:02 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:06:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:02 user nova-compute[75745]: INFO nova.compute.manager [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Took 17.66 seconds to build instance.
Dec 01 17:06:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d3e6aec8-1ba1-4a66-88f5-a628e6166994 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Lock "b566a6fd-2ea6-4df7-8866-eab5b4d398a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.885s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:02 user nova-compute[75745]: INFO nova.compute.manager [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Took 14.94 seconds to spawn the instance on the hypervisor.
Dec 01 17:06:02 user nova-compute[75745]: DEBUG nova.compute.manager [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:06:02 user nova-compute[75745]: INFO nova.compute.manager [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Took 15.85 seconds to build instance.
Dec 01 17:06:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-92661aa9-c8a0-4b0e-859d-120d479ad414 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.028s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:02 user nova-compute[75745]: DEBUG nova.compute.manager [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:06:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:06:02 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Instance spawned successfully.
Dec 01 17:06:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:06:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:03 user nova-compute[75745]: INFO nova.compute.manager [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Took 18.33 seconds to spawn the instance on the hypervisor.
Dec 01 17:06:03 user nova-compute[75745]: DEBUG nova.compute.manager [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:06:03 user nova-compute[75745]: INFO nova.compute.manager [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Took 19.46 seconds to build instance.
Dec 01 17:06:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ca29d9fa-9b90-4d95-9211-b8a292c98262 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "dc78dcf1-f005-415c-ac27-798cab8f52fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.717s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:03 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:03 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:03 user nova-compute[75745]: DEBUG nova.compute.manager [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:06:03 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:06:03 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Instance spawned successfully.
Dec 01 17:06:03 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:06:04 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:04 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:04 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:04 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:04 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:04 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:04 user nova-compute[75745]: INFO nova.compute.manager [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Took 11.58 seconds to spawn the instance on the hypervisor.
Dec 01 17:06:04 user nova-compute[75745]: DEBUG nova.compute.manager [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:06:04 user nova-compute[75745]: INFO nova.compute.manager [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Took 12.47 seconds to build instance.
Dec 01 17:06:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-559a4b4b-4258-43d1-a9da-a2c62abb3db6 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.738s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Acquiring lock "c7fb74ee-dfa0-40e1-8773-99bd4a0402d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Lock "c7fb74ee-dfa0-40e1-8773-99bd4a0402d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:08 user nova-compute[75745]: DEBUG nova.compute.manager [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:06:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:08 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:06:08 user nova-compute[75745]: INFO nova.compute.claims [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Claim successful on node user
Dec 01 17:06:09 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:06:09 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:06:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.607s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:09 user nova-compute[75745]: DEBUG nova.compute.manager [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:06:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:09 user nova-compute[75745]: DEBUG nova.compute.manager [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:06:09 user nova-compute[75745]: DEBUG nova.network.neutron [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:06:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:09 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Dec 01 17:06:09 user nova-compute[75745]: DEBUG nova.compute.manager [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:06:09 user nova-compute[75745]: DEBUG nova.policy [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '09bac2cfb1e04bc996cbf64610b63c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca0e64357e24c7098548625d1e269f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:06:09 user nova-compute[75745]: DEBUG nova.compute.manager [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:06:09 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:06:09 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Creating image(s)
Dec 01 17:06:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Acquiring lock "/opt/stack/data/nova/instances/c7fb74ee-dfa0-40e1-8773-99bd4a0402d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Lock "/opt/stack/data/nova/instances/c7fb74ee-dfa0-40e1-8773-99bd4a0402d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Lock "/opt/stack/data/nova/instances/c7fb74ee-dfa0-40e1-8773-99bd4a0402d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Acquiring lock "e86ba2f36b2b3f5ac59848f2c60ebbd1950a493a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Lock "e86ba2f36b2b3f5ac59848f2c60ebbd1950a493a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e86ba2f36b2b3f5ac59848f2c60ebbd1950a493a.part --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e86ba2f36b2b3f5ac59848f2c60ebbd1950a493a.part --force-share --output=json" returned: 0 in 0.326s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:10 user nova-compute[75745]: DEBUG nova.virt.images [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] 875fd380-18d6-4a66-ac7b-9e2356a51945 was qcow2, converting to raw {{(pid=75745) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 01 17:06:10 user nova-compute[75745]: DEBUG nova.privsep.utils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75745) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 17:06:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e86ba2f36b2b3f5ac59848f2c60ebbd1950a493a.part /opt/stack/data/nova/instances/_base/e86ba2f36b2b3f5ac59848f2c60ebbd1950a493a.converted {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e86ba2f36b2b3f5ac59848f2c60ebbd1950a493a.part /opt/stack/data/nova/instances/_base/e86ba2f36b2b3f5ac59848f2c60ebbd1950a493a.converted" returned: 0 in 0.210s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e86ba2f36b2b3f5ac59848f2c60ebbd1950a493a.converted --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Acquiring lock "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Lock "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:11 user nova-compute[75745]: DEBUG nova.compute.manager [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:06:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e86ba2f36b2b3f5ac59848f2c60ebbd1950a493a.converted --force-share --output=json" returned: 0 in 0.280s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Lock "e86ba2f36b2b3f5ac59848f2c60ebbd1950a493a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.409s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e86ba2f36b2b3f5ac59848f2c60ebbd1950a493a --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:11 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:06:11 user nova-compute[75745]: INFO nova.compute.claims [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Claim successful on node user
Dec 01 17:06:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e86ba2f36b2b3f5ac59848f2c60ebbd1950a493a --force-share --output=json" returned: 0 in 0.292s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Acquiring lock "e86ba2f36b2b3f5ac59848f2c60ebbd1950a493a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Lock "e86ba2f36b2b3f5ac59848f2c60ebbd1950a493a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e86ba2f36b2b3f5ac59848f2c60ebbd1950a493a --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e86ba2f36b2b3f5ac59848f2c60ebbd1950a493a --force-share --output=json" returned: 0 in 0.281s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e86ba2f36b2b3f5ac59848f2c60ebbd1950a493a,backing_fmt=raw /opt/stack/data/nova/instances/c7fb74ee-dfa0-40e1-8773-99bd4a0402d5/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e86ba2f36b2b3f5ac59848f2c60ebbd1950a493a,backing_fmt=raw /opt/stack/data/nova/instances/c7fb74ee-dfa0-40e1-8773-99bd4a0402d5/disk 1073741824" returned: 0 in 0.078s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Lock "e86ba2f36b2b3f5ac59848f2c60ebbd1950a493a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.375s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e86ba2f36b2b3f5ac59848f2c60ebbd1950a493a --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:12 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:06:12 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:06:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.677s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:12 user nova-compute[75745]: DEBUG nova.compute.manager [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:06:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e86ba2f36b2b3f5ac59848f2c60ebbd1950a493a --force-share --output=json" returned: 0 in 0.224s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:12 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c7fb74ee-dfa0-40e1-8773-99bd4a0402d5/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:06:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fb74ee-dfa0-40e1-8773-99bd4a0402d5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:12 user nova-compute[75745]: DEBUG nova.compute.manager [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:06:12 user nova-compute[75745]: DEBUG nova.network.neutron [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:06:12 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:06:12 user nova-compute[75745]: DEBUG nova.compute.manager [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:06:12 user nova-compute[75745]: DEBUG nova.policy [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '472f83420af04b39a943b74e012c908d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2aaa61f4c24fd5adaca1c9b5445ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:06:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fb74ee-dfa0-40e1-8773-99bd4a0402d5/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:12 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Cannot resize image /opt/stack/data/nova/instances/c7fb74ee-dfa0-40e1-8773-99bd4a0402d5/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:06:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:06:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Ensure instance console log exists: /opt/stack/data/nova/instances/c7fb74ee-dfa0-40e1-8773-99bd4a0402d5/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:06:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:12 user nova-compute[75745]: DEBUG nova.compute.manager [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:06:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:06:12 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Creating image(s)
Dec 01 17:06:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Acquiring lock "/opt/stack/data/nova/instances/d9bfb9f9-95a4-49f5-b781-5e78c83c54d1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Lock "/opt/stack/data/nova/instances/d9bfb9f9-95a4-49f5-b781-5e78c83c54d1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Lock "/opt/stack/data/nova/instances/d9bfb9f9-95a4-49f5-b781-5e78c83c54d1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.298s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.243s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/d9bfb9f9-95a4-49f5-b781-5e78c83c54d1/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/d9bfb9f9-95a4-49f5-b781-5e78c83c54d1/disk 1073741824" returned: 0 in 0.066s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.319s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:13 user nova-compute[75745]: DEBUG nova.network.neutron [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Successfully created port: 0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:06:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.308s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:13 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d9bfb9f9-95a4-49f5-b781-5e78c83c54d1/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:06:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bfb9f9-95a4-49f5-b781-5e78c83c54d1/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bfb9f9-95a4-49f5-b781-5e78c83c54d1/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:13 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Cannot resize image /opt/stack/data/nova/instances/d9bfb9f9-95a4-49f5-b781-5e78c83c54d1/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:06:13 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:06:13 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Ensure instance console log exists: /opt/stack/data/nova/instances/d9bfb9f9-95a4-49f5-b781-5e78c83c54d1/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:06:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:13 user nova-compute[75745]: DEBUG nova.compute.manager [req-5b258a3c-3655-4251-93ec-3f99ab951e5a req-36299592-5aba-4507-9116-aec1ce4988ac service nova] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Received event network-vif-plugged-ea70774b-9342-49b5-b596-1da083140c0a {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:06:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5b258a3c-3655-4251-93ec-3f99ab951e5a req-36299592-5aba-4507-9116-aec1ce4988ac service nova] Acquiring lock "b566a6fd-2ea6-4df7-8866-eab5b4d398a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5b258a3c-3655-4251-93ec-3f99ab951e5a req-36299592-5aba-4507-9116-aec1ce4988ac service nova] Lock "b566a6fd-2ea6-4df7-8866-eab5b4d398a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5b258a3c-3655-4251-93ec-3f99ab951e5a req-36299592-5aba-4507-9116-aec1ce4988ac service nova] Lock "b566a6fd-2ea6-4df7-8866-eab5b4d398a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:13 user nova-compute[75745]: DEBUG nova.compute.manager [req-5b258a3c-3655-4251-93ec-3f99ab951e5a req-36299592-5aba-4507-9116-aec1ce4988ac service nova] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] No waiting events found dispatching network-vif-plugged-ea70774b-9342-49b5-b596-1da083140c0a {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:06:13 user nova-compute[75745]: WARNING nova.compute.manager [req-5b258a3c-3655-4251-93ec-3f99ab951e5a req-36299592-5aba-4507-9116-aec1ce4988ac service nova] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Received unexpected event network-vif-plugged-ea70774b-9342-49b5-b596-1da083140c0a for instance with vm_state active and task_state None.
Dec 01 17:06:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:13 user nova-compute[75745]: DEBUG nova.network.neutron [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Successfully created port: 9f322a2f-deae-4c15-8b43-c21c779ed76a {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:06:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Acquiring lock "02715ae1-5200-4df5-8430-2f19a610d2bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lock "02715ae1-5200-4df5-8430-2f19a610d2bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:14 user nova-compute[75745]: DEBUG nova.compute.manager [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:06:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:14 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:06:14 user nova-compute[75745]: INFO nova.compute.claims [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Claim successful on node user
Dec 01 17:06:15 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.671s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG nova.compute.manager [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG nova.network.neutron [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Successfully updated port: 9f322a2f-deae-4c15-8b43-c21c779ed76a {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Acquiring lock "refresh_cache-d9bfb9f9-95a4-49f5-b781-5e78c83c54d1" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Acquired lock "refresh_cache-d9bfb9f9-95a4-49f5-b781-5e78c83c54d1" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG nova.network.neutron [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG nova.compute.manager [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG nova.network.neutron [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:06:15 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:06:15 user nova-compute[75745]: DEBUG nova.compute.manager [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG nova.network.neutron [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Successfully updated port: 0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG nova.network.neutron [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Acquiring lock "refresh_cache-c7fb74ee-dfa0-40e1-8773-99bd4a0402d5" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Acquired lock "refresh_cache-c7fb74ee-dfa0-40e1-8773-99bd4a0402d5" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG nova.network.neutron [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG nova.compute.manager [req-3c1bbed8-1b7e-4d10-b9a3-e5e79dd98988 req-548dd12d-b3b5-4efc-86b4-4fb2ba6f8bc9 service nova] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Received event network-changed-0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG nova.compute.manager [req-3c1bbed8-1b7e-4d10-b9a3-e5e79dd98988 req-548dd12d-b3b5-4efc-86b4-4fb2ba6f8bc9 service nova] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Refreshing instance network info cache due to event network-changed-0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3c1bbed8-1b7e-4d10-b9a3-e5e79dd98988 req-548dd12d-b3b5-4efc-86b4-4fb2ba6f8bc9 service nova] Acquiring lock "refresh_cache-c7fb74ee-dfa0-40e1-8773-99bd4a0402d5" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG nova.policy [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '77cc6ad71fa84904acd8d24eec648c94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5275e723c904fa183974b49d4530824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG nova.network.neutron [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG nova.compute.manager [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:06:15 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Creating image(s)
Dec 01 17:06:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Acquiring lock "/opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lock "/opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lock "/opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.016s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG nova.compute.manager [req-5676e288-78cc-4e2d-ab1f-fd297e36ea97 req-aaf35a3a-304c-4782-8e56-e041e280ed1d service nova] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Received event network-vif-plugged-ea70774b-9342-49b5-b596-1da083140c0a {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5676e288-78cc-4e2d-ab1f-fd297e36ea97 req-aaf35a3a-304c-4782-8e56-e041e280ed1d service nova] Acquiring lock "b566a6fd-2ea6-4df7-8866-eab5b4d398a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5676e288-78cc-4e2d-ab1f-fd297e36ea97 req-aaf35a3a-304c-4782-8e56-e041e280ed1d service nova] Lock "b566a6fd-2ea6-4df7-8866-eab5b4d398a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5676e288-78cc-4e2d-ab1f-fd297e36ea97 req-aaf35a3a-304c-4782-8e56-e041e280ed1d service nova] Lock "b566a6fd-2ea6-4df7-8866-eab5b4d398a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG nova.compute.manager [req-5676e288-78cc-4e2d-ab1f-fd297e36ea97 req-aaf35a3a-304c-4782-8e56-e041e280ed1d service nova] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] No waiting events found dispatching network-vif-plugged-ea70774b-9342-49b5-b596-1da083140c0a {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:06:15 user nova-compute[75745]: WARNING nova.compute.manager [req-5676e288-78cc-4e2d-ab1f-fd297e36ea97 req-aaf35a3a-304c-4782-8e56-e041e280ed1d service nova] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Received unexpected event network-vif-plugged-ea70774b-9342-49b5-b596-1da083140c0a for instance with vm_state active and task_state None.
Dec 01 17:06:15 user nova-compute[75745]: DEBUG nova.compute.manager [req-5676e288-78cc-4e2d-ab1f-fd297e36ea97 req-aaf35a3a-304c-4782-8e56-e041e280ed1d service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Received event network-vif-plugged-7b52d740-f797-4bc8-9e0c-d9f4744e4a4f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5676e288-78cc-4e2d-ab1f-fd297e36ea97 req-aaf35a3a-304c-4782-8e56-e041e280ed1d service nova] Acquiring lock "dc78dcf1-f005-415c-ac27-798cab8f52fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5676e288-78cc-4e2d-ab1f-fd297e36ea97 req-aaf35a3a-304c-4782-8e56-e041e280ed1d service nova] Lock "dc78dcf1-f005-415c-ac27-798cab8f52fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5676e288-78cc-4e2d-ab1f-fd297e36ea97 req-aaf35a3a-304c-4782-8e56-e041e280ed1d service nova] Lock "dc78dcf1-f005-415c-ac27-798cab8f52fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG nova.compute.manager [req-5676e288-78cc-4e2d-ab1f-fd297e36ea97 req-aaf35a3a-304c-4782-8e56-e041e280ed1d service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] No waiting events found dispatching network-vif-plugged-7b52d740-f797-4bc8-9e0c-d9f4744e4a4f {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:06:15 user nova-compute[75745]: WARNING nova.compute.manager [req-5676e288-78cc-4e2d-ab1f-fd297e36ea97 req-aaf35a3a-304c-4782-8e56-e041e280ed1d service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Received unexpected event network-vif-plugged-7b52d740-f797-4bc8-9e0c-d9f4744e4a4f for instance with vm_state active and task_state None.
Dec 01 17:06:15 user nova-compute[75745]: DEBUG nova.compute.manager [req-5676e288-78cc-4e2d-ab1f-fd297e36ea97 req-aaf35a3a-304c-4782-8e56-e041e280ed1d service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Received event network-vif-plugged-7b52d740-f797-4bc8-9e0c-d9f4744e4a4f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5676e288-78cc-4e2d-ab1f-fd297e36ea97 req-aaf35a3a-304c-4782-8e56-e041e280ed1d service nova] Acquiring lock "dc78dcf1-f005-415c-ac27-798cab8f52fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5676e288-78cc-4e2d-ab1f-fd297e36ea97 req-aaf35a3a-304c-4782-8e56-e041e280ed1d service nova] Lock "dc78dcf1-f005-415c-ac27-798cab8f52fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5676e288-78cc-4e2d-ab1f-fd297e36ea97 req-aaf35a3a-304c-4782-8e56-e041e280ed1d service nova] Lock "dc78dcf1-f005-415c-ac27-798cab8f52fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG nova.compute.manager [req-5676e288-78cc-4e2d-ab1f-fd297e36ea97 req-aaf35a3a-304c-4782-8e56-e041e280ed1d service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] No waiting events found dispatching network-vif-plugged-7b52d740-f797-4bc8-9e0c-d9f4744e4a4f {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:06:15 user nova-compute[75745]: WARNING nova.compute.manager [req-5676e288-78cc-4e2d-ab1f-fd297e36ea97 req-aaf35a3a-304c-4782-8e56-e041e280ed1d service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Received unexpected event network-vif-plugged-7b52d740-f797-4bc8-9e0c-d9f4744e4a4f for instance with vm_state active and task_state None.
Dec 01 17:06:15 user nova-compute[75745]: DEBUG nova.compute.manager [req-5676e288-78cc-4e2d-ab1f-fd297e36ea97 req-aaf35a3a-304c-4782-8e56-e041e280ed1d service nova] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Received event network-changed-9f322a2f-deae-4c15-8b43-c21c779ed76a {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG nova.compute.manager [req-5676e288-78cc-4e2d-ab1f-fd297e36ea97 req-aaf35a3a-304c-4782-8e56-e041e280ed1d service nova] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Refreshing instance network info cache due to event network-changed-9f322a2f-deae-4c15-8b43-c21c779ed76a. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5676e288-78cc-4e2d-ab1f-fd297e36ea97 req-aaf35a3a-304c-4782-8e56-e041e280ed1d service nova] Acquiring lock "refresh_cache-d9bfb9f9-95a4-49f5-b781-5e78c83c54d1" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.230s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:15 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.network.neutron [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Updating instance_info_cache with network_info: [{"id": "9f322a2f-deae-4c15-8b43-c21c779ed76a", "address": "fa:16:3e:d0:61:8e", "network": {"id": "2cbf6c6e-fe98-488e-b0d7-fe25e97af92d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1025939428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2aaa61f4c24fd5adaca1c9b5445ed8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f322a2f-de", "ovs_interfaceid": "9f322a2f-deae-4c15-8b43-c21c779ed76a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.network.neutron [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Updating instance_info_cache with network_info: [{"id": "0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f", "address": "fa:16:3e:1d:54:77", "network": {"id": "1d5056ab-3b1d-40a2-b83f-5012d1e8c71f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1526171674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca0e64357e24c7098548625d1e269f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f98a2c5-bb", "ovs_interfaceid": "0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.283s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Releasing lock "refresh_cache-d9bfb9f9-95a4-49f5-b781-5e78c83c54d1" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.compute.manager [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Instance network_info: |[{"id": "9f322a2f-deae-4c15-8b43-c21c779ed76a", "address": "fa:16:3e:d0:61:8e", "network": {"id": "2cbf6c6e-fe98-488e-b0d7-fe25e97af92d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1025939428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2aaa61f4c24fd5adaca1c9b5445ed8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f322a2f-de", "ovs_interfaceid": "9f322a2f-deae-4c15-8b43-c21c779ed76a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Releasing lock "refresh_cache-c7fb74ee-dfa0-40e1-8773-99bd4a0402d5" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.compute.manager [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Instance network_info: |[{"id": "0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f", "address": "fa:16:3e:1d:54:77", "network": {"id": "1d5056ab-3b1d-40a2-b83f-5012d1e8c71f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1526171674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca0e64357e24c7098548625d1e269f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f98a2c5-bb", "ovs_interfaceid": "0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5676e288-78cc-4e2d-ab1f-fd297e36ea97 req-aaf35a3a-304c-4782-8e56-e041e280ed1d service nova] Acquired lock "refresh_cache-d9bfb9f9-95a4-49f5-b781-5e78c83c54d1" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.network.neutron [req-5676e288-78cc-4e2d-ab1f-fd297e36ea97 req-aaf35a3a-304c-4782-8e56-e041e280ed1d service nova] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Refreshing network info cache for port 9f322a2f-deae-4c15-8b43-c21c779ed76a {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Start _get_guest_xml network_info=[{"id": "9f322a2f-deae-4c15-8b43-c21c779ed76a", "address": "fa:16:3e:d0:61:8e", "network": {"id": "2cbf6c6e-fe98-488e-b0d7-fe25e97af92d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1025939428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2aaa61f4c24fd5adaca1c9b5445ed8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f322a2f-de", "ovs_interfaceid": "9f322a2f-deae-4c15-8b43-c21c779ed76a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3c1bbed8-1b7e-4d10-b9a3-e5e79dd98988 req-548dd12d-b3b5-4efc-86b4-4fb2ba6f8bc9 service nova] Acquired lock "refresh_cache-c7fb74ee-dfa0-40e1-8773-99bd4a0402d5" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.network.neutron [req-3c1bbed8-1b7e-4d10-b9a3-e5e79dd98988 req-548dd12d-b3b5-4efc-86b4-4fb2ba6f8bc9 service nova] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Refreshing network info cache for port 0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Start _get_guest_xml network_info=[{"id": "0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f", "address": "fa:16:3e:1d:54:77", "network": {"id": "1d5056ab-3b1d-40a2-b83f-5012d1e8c71f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1526171674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca0e64357e24c7098548625d1e269f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f98a2c5-bb", "ovs_interfaceid": "0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:05:59Z,direct_url=<?>,disk_format='qcow2',id=875fd380-18d6-4a66-ac7b-9e2356a51945,min_disk=0,min_ram=0,name='',owner='b5b9595d9b44499b8602583cd6d3419b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:06:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/sda', 'device_type': 'disk', 'image_id': '875fd380-18d6-4a66-ac7b-9e2356a51945'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk 1073741824" returned: 0 in 0.097s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.386s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:16 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:06:16 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:06:16 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:06:16 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:06:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1463371879',display_name='tempest-TestVolumeSwap-server-1463371879',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1463371879',id=6,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1GwHWdccv1HjSqp8crhX8CmASt2p7nFMJxD95YF07UWETFHUJ7fCKkes3CaYvpie3VLliCMpk2oJ1UZPGbCqvuwR1onUCJddIF/So0py+OVcvH6VCT63fdWq7LLgITSA==',key_name='tempest-keypair-1848842371',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a2aaa61f4c24fd5adaca1c9b5445ed8',ramdisk_id='',reservation_id='r-qudp85em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1688920360',owner_user_name='tempest-TestVolumeSwap-1688920360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='472f83420af04b39a943b74e012c908d',uuid=d9bfb9f9-95a4-49f5-b781-5e78c83c54d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f322a2f-deae-4c15-8b43-c21c779ed76a", "address": "fa:16:3e:d0:61:8e", "network": {"id": "2cbf6c6e-fe98-488e-b0d7-fe25e97af92d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1025939428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2aaa61f4c24fd5adaca1c9b5445ed8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f322a2f-de", "ovs_interfaceid": "9f322a2f-deae-4c15-8b43-c21c779ed76a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Converting VIF {"id": "9f322a2f-deae-4c15-8b43-c21c779ed76a", "address": "fa:16:3e:d0:61:8e", "network": {"id": "2cbf6c6e-fe98-488e-b0d7-fe25e97af92d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1025939428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2aaa61f4c24fd5adaca1c9b5445ed8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f322a2f-de", "ovs_interfaceid": "9f322a2f-deae-4c15-8b43-c21c779ed76a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:61:8e,bridge_name='br-int',has_traffic_filtering=True,id=9f322a2f-deae-4c15-8b43-c21c779ed76a,network=Network(2cbf6c6e-fe98-488e-b0d7-fe25e97af92d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f322a2f-de') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.objects.instance [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Lazy-loading 'pci_devices' on Instance uuid d9bfb9f9-95a4-49f5-b781-5e78c83c54d1 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.202s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:06:16 user nova-compute[75745]:   <uuid>d9bfb9f9-95a4-49f5-b781-5e78c83c54d1</uuid>
Dec 01 17:06:16 user nova-compute[75745]:   <name>instance-00000006</name>
Dec 01 17:06:16 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:06:16 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:06:16 user nova-compute[75745]:   <metadata>
Dec 01 17:06:16 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:06:16 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:06:16 user nova-compute[75745]:       <nova:name>tempest-TestVolumeSwap-server-1463371879</nova:name>
Dec 01 17:06:16 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:06:16</nova:creationTime>
Dec 01 17:06:16 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:06:16 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:06:16 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:06:16 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:06:16 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:06:16 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:06:16 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:06:16 user nova-compute[75745]:       <nova:owner>
Dec 01 17:06:16 user nova-compute[75745]:         <nova:user uuid="472f83420af04b39a943b74e012c908d">tempest-TestVolumeSwap-1688920360-project-member</nova:user>
Dec 01 17:06:16 user nova-compute[75745]:         <nova:project uuid="6a2aaa61f4c24fd5adaca1c9b5445ed8">tempest-TestVolumeSwap-1688920360</nova:project>
Dec 01 17:06:16 user nova-compute[75745]:       </nova:owner>
Dec 01 17:06:16 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:06:16 user nova-compute[75745]:       <nova:ports>
Dec 01 17:06:16 user nova-compute[75745]:         <nova:port uuid="9f322a2f-deae-4c15-8b43-c21c779ed76a">
Dec 01 17:06:16 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 01 17:06:16 user nova-compute[75745]:         </nova:port>
Dec 01 17:06:16 user nova-compute[75745]:       </nova:ports>
Dec 01 17:06:16 user nova-compute[75745]:     </nova:instance>
Dec 01 17:06:16 user nova-compute[75745]:   </metadata>
Dec 01 17:06:16 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:06:16 user nova-compute[75745]:     <system>
Dec 01 17:06:16 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:06:16 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:06:16 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:06:16 user nova-compute[75745]:       <entry name="serial">d9bfb9f9-95a4-49f5-b781-5e78c83c54d1</entry>
Dec 01 17:06:16 user nova-compute[75745]:       <entry name="uuid">d9bfb9f9-95a4-49f5-b781-5e78c83c54d1</entry>
Dec 01 17:06:16 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:06:16 user nova-compute[75745]:     </system>
Dec 01 17:06:16 user nova-compute[75745]:   </sysinfo>
Dec 01 17:06:16 user nova-compute[75745]:   <os>
Dec 01 17:06:16 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:06:16 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:06:16 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:06:16 user nova-compute[75745]:   </os>
Dec 01 17:06:16 user nova-compute[75745]:   <features>
Dec 01 17:06:16 user nova-compute[75745]:     <acpi/>
Dec 01 17:06:16 user nova-compute[75745]:     <apic/>
Dec 01 17:06:16 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:06:16 user nova-compute[75745]:   </features>
Dec 01 17:06:16 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:06:16 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:06:16 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:06:16 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:06:16 user nova-compute[75745]:   </clock>
Dec 01 17:06:16 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:06:16 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:06:16 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:06:16 user nova-compute[75745]:   </cpu>
Dec 01 17:06:16 user nova-compute[75745]:   <devices>
Dec 01 17:06:16 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:06:16 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:06:16 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/d9bfb9f9-95a4-49f5-b781-5e78c83c54d1/disk"/>
Dec 01 17:06:16 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:06:16 user nova-compute[75745]:     </disk>
Dec 01 17:06:16 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:06:16 user nova-compute[75745]:       <mac address="fa:16:3e:d0:61:8e"/>
Dec 01 17:06:16 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:06:16 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:06:16 user nova-compute[75745]:       <target dev="tap9f322a2f-de"/>
Dec 01 17:06:16 user nova-compute[75745]:     </interface>
Dec 01 17:06:16 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:06:16 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/d9bfb9f9-95a4-49f5-b781-5e78c83c54d1/console.log" append="off"/>
Dec 01 17:06:16 user nova-compute[75745]:     </serial>
Dec 01 17:06:16 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:06:16 user nova-compute[75745]:     <video>
Dec 01 17:06:16 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:06:16 user nova-compute[75745]:     </video>
Dec 01 17:06:16 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:06:16 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:06:16 user nova-compute[75745]:     </rng>
Dec 01 17:06:16 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:06:16 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:06:16 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:06:16 user nova-compute[75745]:     </memballoon>
Dec 01 17:06:16 user nova-compute[75745]:   </devices>
Dec 01 17:06:16 user nova-compute[75745]: </domain>
Dec 01 17:06:16 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:06:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1463371879',display_name='tempest-TestVolumeSwap-server-1463371879',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1463371879',id=6,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1GwHWdccv1HjSqp8crhX8CmASt2p7nFMJxD95YF07UWETFHUJ7fCKkes3CaYvpie3VLliCMpk2oJ1UZPGbCqvuwR1onUCJddIF/So0py+OVcvH6VCT63fdWq7LLgITSA==',key_name='tempest-keypair-1848842371',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a2aaa61f4c24fd5adaca1c9b5445ed8',ramdisk_id='',reservation_id='r-qudp85em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1688920360',owner_user_name='tempest-TestVolumeSwap-1688920360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='472f83420af04b39a943b74e012c908d',uuid=d9bfb9f9-95a4-49f5-b781-5e78c83c54d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f322a2f-deae-4c15-8b43-c21c779ed76a", "address": "fa:16:3e:d0:61:8e", "network": {"id": "2cbf6c6e-fe98-488e-b0d7-fe25e97af92d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1025939428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2aaa61f4c24fd5adaca1c9b5445ed8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f322a2f-de", "ovs_interfaceid": "9f322a2f-deae-4c15-8b43-c21c779ed76a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Converting VIF {"id": "9f322a2f-deae-4c15-8b43-c21c779ed76a", "address": "fa:16:3e:d0:61:8e", "network": {"id": "2cbf6c6e-fe98-488e-b0d7-fe25e97af92d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1025939428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2aaa61f4c24fd5adaca1c9b5445ed8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f322a2f-de", "ovs_interfaceid": "9f322a2f-deae-4c15-8b43-c21c779ed76a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:61:8e,bridge_name='br-int',has_traffic_filtering=True,id=9f322a2f-deae-4c15-8b43-c21c779ed76a,network=Network(2cbf6c6e-fe98-488e-b0d7-fe25e97af92d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f322a2f-de') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG os_vif [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:61:8e,bridge_name='br-int',has_traffic_filtering=True,id=9f322a2f-deae-4c15-8b43-c21c779ed76a,network=Network(2cbf6c6e-fe98-488e-b0d7-fe25e97af92d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f322a2f-de') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:05:59Z,direct_url=<?>,disk_format='qcow2',id=875fd380-18d6-4a66-ac7b-9e2356a51945,min_disk=0,min_ram=0,name='',owner='b5b9595d9b44499b8602583cd6d3419b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:06:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2093162159',display_name='tempest-AttachSCSIVolumeTestJSON-server-2093162159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2093162159',id=5,image_ref='875fd380-18d6-4a66-ac7b-9e2356a51945',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcNvJdXBy3wIJ5dV4f6g7puHwPxGXVj+1ua5O0MU/W2pSVV7MIKhdoMPngO6hx9lEABMKU3cuCp6ZPNJ1/w1JWFcnFZ8bXcUMadeA6wIqUXWc/XUcIsuwb/cJW0CHx18Q==',key_name='tempest-keypair-910136177',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dca0e64357e24c7098548625d1e269f1',ramdisk_id='',reservation_id='r-va47zz0e',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='875fd380-18d6-4a66-ac7b-9e2356a51945',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-17080036',owner_user_name='tempest-AttachSCSIVolumeTestJSON-17080036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09bac2cfb1e04bc996cbf64610b63c57',uuid=c7fb74ee-dfa0-40e1-8773-99bd4a0402d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f", "address": "fa:16:3e:1d:54:77", "network": {"id": "1d5056ab-3b1d-40a2-b83f-5012d1e8c71f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1526171674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca0e64357e24c7098548625d1e269f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f98a2c5-bb", "ovs_interfaceid": "0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Converting VIF {"id": "0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f", "address": "fa:16:3e:1d:54:77", "network": {"id": "1d5056ab-3b1d-40a2-b83f-5012d1e8c71f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1526171674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca0e64357e24c7098548625d1e269f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f98a2c5-bb", "ovs_interfaceid": "0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:54:77,bridge_name='br-int',has_traffic_filtering=True,id=0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f,network=Network(1d5056ab-3b1d-40a2-b83f-5012d1e8c71f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f98a2c5-bb') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.objects.instance [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Lazy-loading 'pci_devices' on Instance uuid c7fb74ee-dfa0-40e1-8773-99bd4a0402d5 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Checking if we can resize image /opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:06:16 user nova-compute[75745]:   <uuid>c7fb74ee-dfa0-40e1-8773-99bd4a0402d5</uuid>
Dec 01 17:06:16 user nova-compute[75745]:   <name>instance-00000005</name>
Dec 01 17:06:16 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:06:16 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:06:16 user nova-compute[75745]:   <metadata>
Dec 01 17:06:16 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:06:16 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:06:16 user nova-compute[75745]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-2093162159</nova:name>
Dec 01 17:06:16 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:06:16</nova:creationTime>
Dec 01 17:06:16 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:06:16 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:06:16 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:06:16 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:06:16 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:06:16 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:06:16 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:06:16 user nova-compute[75745]:       <nova:owner>
Dec 01 17:06:16 user nova-compute[75745]:         <nova:user uuid="09bac2cfb1e04bc996cbf64610b63c57">tempest-AttachSCSIVolumeTestJSON-17080036-project-member</nova:user>
Dec 01 17:06:16 user nova-compute[75745]:         <nova:project uuid="dca0e64357e24c7098548625d1e269f1">tempest-AttachSCSIVolumeTestJSON-17080036</nova:project>
Dec 01 17:06:16 user nova-compute[75745]:       </nova:owner>
Dec 01 17:06:16 user nova-compute[75745]:       <nova:root type="image" uuid="875fd380-18d6-4a66-ac7b-9e2356a51945"/>
Dec 01 17:06:16 user nova-compute[75745]:       <nova:ports>
Dec 01 17:06:16 user nova-compute[75745]:         <nova:port uuid="0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f">
Dec 01 17:06:16 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 01 17:06:16 user nova-compute[75745]:         </nova:port>
Dec 01 17:06:16 user nova-compute[75745]:       </nova:ports>
Dec 01 17:06:16 user nova-compute[75745]:     </nova:instance>
Dec 01 17:06:16 user nova-compute[75745]:   </metadata>
Dec 01 17:06:16 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:06:16 user nova-compute[75745]:     <system>
Dec 01 17:06:16 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:06:16 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:06:16 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:06:16 user nova-compute[75745]:       <entry name="serial">c7fb74ee-dfa0-40e1-8773-99bd4a0402d5</entry>
Dec 01 17:06:16 user nova-compute[75745]:       <entry name="uuid">c7fb74ee-dfa0-40e1-8773-99bd4a0402d5</entry>
Dec 01 17:06:16 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:06:16 user nova-compute[75745]:     </system>
Dec 01 17:06:16 user nova-compute[75745]:   </sysinfo>
Dec 01 17:06:16 user nova-compute[75745]:   <os>
Dec 01 17:06:16 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:06:16 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:06:16 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:06:16 user nova-compute[75745]:   </os>
Dec 01 17:06:16 user nova-compute[75745]:   <features>
Dec 01 17:06:16 user nova-compute[75745]:     <acpi/>
Dec 01 17:06:16 user nova-compute[75745]:     <apic/>
Dec 01 17:06:16 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:06:16 user nova-compute[75745]:   </features>
Dec 01 17:06:16 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:06:16 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:06:16 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:06:16 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:06:16 user nova-compute[75745]:   </clock>
Dec 01 17:06:16 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:06:16 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:06:16 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:06:16 user nova-compute[75745]:   </cpu>
Dec 01 17:06:16 user nova-compute[75745]:   <devices>
Dec 01 17:06:16 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:06:16 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:06:16 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/c7fb74ee-dfa0-40e1-8773-99bd4a0402d5/disk"/>
Dec 01 17:06:16 user nova-compute[75745]:       <target dev="sda" bus="scsi"/>
Dec 01 17:06:16 user nova-compute[75745]:       <address type="drive" controller="0" unit="0"/>
Dec 01 17:06:16 user nova-compute[75745]:     </disk>
Dec 01 17:06:16 user nova-compute[75745]:     <disk type="file" device="cdrom">
Dec 01 17:06:16 user nova-compute[75745]:       <driver name="qemu" type="raw" cache="none"/>
Dec 01 17:06:16 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/c7fb74ee-dfa0-40e1-8773-99bd4a0402d5/disk.config"/>
Dec 01 17:06:16 user nova-compute[75745]:       <target dev="sdb" bus="scsi"/>
Dec 01 17:06:16 user nova-compute[75745]:       <address type="drive" controller="0" unit="1"/>
Dec 01 17:06:16 user nova-compute[75745]:     </disk>
Dec 01 17:06:16 user nova-compute[75745]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Dec 01 17:06:16 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:06:16 user nova-compute[75745]:       <mac address="fa:16:3e:1d:54:77"/>
Dec 01 17:06:16 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:06:16 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:06:16 user nova-compute[75745]:       <target dev="tap0f98a2c5-bb"/>
Dec 01 17:06:16 user nova-compute[75745]:     </interface>
Dec 01 17:06:16 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:06:16 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/c7fb74ee-dfa0-40e1-8773-99bd4a0402d5/console.log" append="off"/>
Dec 01 17:06:16 user nova-compute[75745]:     </serial>
Dec 01 17:06:16 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:06:16 user nova-compute[75745]:     <video>
Dec 01 17:06:16 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:06:16 user nova-compute[75745]:     </video>
Dec 01 17:06:16 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:06:16 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:06:16 user nova-compute[75745]:     </rng>
Dec 01 17:06:16 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:06:16 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:06:16 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:06:16 user nova-compute[75745]:     </memballoon>
Dec 01 17:06:16 user nova-compute[75745]:   </devices>
Dec 01 17:06:16 user nova-compute[75745]: </domain>
Dec 01 17:06:16 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2093162159',display_name='tempest-AttachSCSIVolumeTestJSON-server-2093162159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2093162159',id=5,image_ref='875fd380-18d6-4a66-ac7b-9e2356a51945',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcNvJdXBy3wIJ5dV4f6g7puHwPxGXVj+1ua5O0MU/W2pSVV7MIKhdoMPngO6hx9lEABMKU3cuCp6ZPNJ1/w1JWFcnFZ8bXcUMadeA6wIqUXWc/XUcIsuwb/cJW0CHx18Q==',key_name='tempest-keypair-910136177',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dca0e64357e24c7098548625d1e269f1',ramdisk_id='',reservation_id='r-va47zz0e',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='875fd380-18d6-4a66-ac7b-9e2356a51945',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-17080036',owner_user_name='tempest-AttachSCSIVolumeTestJSON-17080036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09bac2cfb1e04bc996cbf64610b63c57',uuid=c7fb74ee-dfa0-40e1-8773-99bd4a0402d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f", "address": "fa:16:3e:1d:54:77", "network": {"id": "1d5056ab-3b1d-40a2-b83f-5012d1e8c71f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1526171674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca0e64357e24c7098548625d1e269f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f98a2c5-bb", "ovs_interfaceid": "0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Converting VIF {"id": "0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f", "address": "fa:16:3e:1d:54:77", "network": {"id": "1d5056ab-3b1d-40a2-b83f-5012d1e8c71f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1526171674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca0e64357e24c7098548625d1e269f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f98a2c5-bb", "ovs_interfaceid": "0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:54:77,bridge_name='br-int',has_traffic_filtering=True,id=0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f,network=Network(1d5056ab-3b1d-40a2-b83f-5012d1e8c71f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f98a2c5-bb') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG os_vif [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:54:77,bridge_name='br-int',has_traffic_filtering=True,id=0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f,network=Network(1d5056ab-3b1d-40a2-b83f-5012d1e8c71f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f98a2c5-bb') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0ff766ff-7019-581d-a51f-9dcf1432fc0f', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e6142f0-83ec-595b-980e-f5010a40513f', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f322a2f-de, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9f322a2f-de, col_values=(('qos', UUID('2212808f-0f27-48ec-b359-f631f50437cf')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9f322a2f-de, col_values=(('external_ids', {'iface-id': '9f322a2f-deae-4c15-8b43-c21c779ed76a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:61:8e', 'vm-uuid': 'd9bfb9f9-95a4-49f5-b781-5e78c83c54d1'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.network.neutron [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Successfully created port: f2e5d5e1-b6be-444f-b8b6-c8f26cef560b {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:06:16 user nova-compute[75745]: INFO os_vif [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:61:8e,bridge_name='br-int',has_traffic_filtering=True,id=9f322a2f-deae-4c15-8b43-c21c779ed76a,network=Network(2cbf6c6e-fe98-488e-b0d7-fe25e97af92d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f322a2f-de')
Dec 01 17:06:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f98a2c5-bb, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f98a2c5-bb, col_values=(('qos', UUID('19261309-cdc9-478a-9bbc-7235491a124f')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f98a2c5-bb, col_values=(('external_ids', {'iface-id': '0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:54:77', 'vm-uuid': 'c7fb74ee-dfa0-40e1-8773-99bd4a0402d5'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:06:16 user nova-compute[75745]: INFO os_vif [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:54:77,bridge_name='br-int',has_traffic_filtering=True,id=0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f,network=Network(1d5056ab-3b1d-40a2-b83f-5012d1e8c71f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f98a2c5-bb')
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] No VIF found with MAC fa:16:3e:d0:61:8e, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Cannot resize image /opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Ensure instance console log exists: /opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] No BDM found with device name sda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:06:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] No VIF found with MAC fa:16:3e:1d:54:77, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:06:16 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Using config drive
Dec 01 17:06:17 user nova-compute[75745]: DEBUG nova.network.neutron [req-3c1bbed8-1b7e-4d10-b9a3-e5e79dd98988 req-548dd12d-b3b5-4efc-86b4-4fb2ba6f8bc9 service nova] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Updated VIF entry in instance network info cache for port 0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:06:17 user nova-compute[75745]: DEBUG nova.network.neutron [req-3c1bbed8-1b7e-4d10-b9a3-e5e79dd98988 req-548dd12d-b3b5-4efc-86b4-4fb2ba6f8bc9 service nova] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Updating instance_info_cache with network_info: [{"id": "0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f", "address": "fa:16:3e:1d:54:77", "network": {"id": "1d5056ab-3b1d-40a2-b83f-5012d1e8c71f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1526171674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca0e64357e24c7098548625d1e269f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f98a2c5-bb", "ovs_interfaceid": "0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:06:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3c1bbed8-1b7e-4d10-b9a3-e5e79dd98988 req-548dd12d-b3b5-4efc-86b4-4fb2ba6f8bc9 service nova] Releasing lock "refresh_cache-c7fb74ee-dfa0-40e1-8773-99bd4a0402d5" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:06:17 user nova-compute[75745]: DEBUG nova.network.neutron [req-5676e288-78cc-4e2d-ab1f-fd297e36ea97 req-aaf35a3a-304c-4782-8e56-e041e280ed1d service nova] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Updated VIF entry in instance network info cache for port 9f322a2f-deae-4c15-8b43-c21c779ed76a. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:06:17 user nova-compute[75745]: DEBUG nova.network.neutron [req-5676e288-78cc-4e2d-ab1f-fd297e36ea97 req-aaf35a3a-304c-4782-8e56-e041e280ed1d service nova] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Updating instance_info_cache with network_info: [{"id": "9f322a2f-deae-4c15-8b43-c21c779ed76a", "address": "fa:16:3e:d0:61:8e", "network": {"id": "2cbf6c6e-fe98-488e-b0d7-fe25e97af92d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1025939428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2aaa61f4c24fd5adaca1c9b5445ed8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f322a2f-de", "ovs_interfaceid": "9f322a2f-deae-4c15-8b43-c21c779ed76a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:06:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5676e288-78cc-4e2d-ab1f-fd297e36ea97 req-aaf35a3a-304c-4782-8e56-e041e280ed1d service nova] Releasing lock "refresh_cache-d9bfb9f9-95a4-49f5-b781-5e78c83c54d1" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:06:17 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:18 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Creating config drive at /opt/stack/data/nova/instances/c7fb74ee-dfa0-40e1-8773-99bd4a0402d5/disk.config
Dec 01 17:06:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c7fb74ee-dfa0-40e1-8773-99bd4a0402d5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2z21zgb8 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:18 user nova-compute[75745]: DEBUG nova.compute.manager [req-cd21fb11-6d4a-430a-9d65-c9514c004471 req-7f51b653-31ff-4499-ae0f-979f944fe383 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Received event network-vif-plugged-b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:06:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-cd21fb11-6d4a-430a-9d65-c9514c004471 req-7f51b653-31ff-4499-ae0f-979f944fe383 service nova] Acquiring lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-cd21fb11-6d4a-430a-9d65-c9514c004471 req-7f51b653-31ff-4499-ae0f-979f944fe383 service nova] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-cd21fb11-6d4a-430a-9d65-c9514c004471 req-7f51b653-31ff-4499-ae0f-979f944fe383 service nova] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:18 user nova-compute[75745]: DEBUG nova.compute.manager [req-cd21fb11-6d4a-430a-9d65-c9514c004471 req-7f51b653-31ff-4499-ae0f-979f944fe383 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] No waiting events found dispatching network-vif-plugged-b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:06:18 user nova-compute[75745]: WARNING nova.compute.manager [req-cd21fb11-6d4a-430a-9d65-c9514c004471 req-7f51b653-31ff-4499-ae0f-979f944fe383 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Received unexpected event network-vif-plugged-b4990a3b-371a-44eb-98d8-685dc63590da for instance with vm_state active and task_state None.
Dec 01 17:06:18 user nova-compute[75745]: DEBUG nova.network.neutron [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Successfully updated port: f2e5d5e1-b6be-444f-b8b6-c8f26cef560b {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:06:18 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c7fb74ee-dfa0-40e1-8773-99bd4a0402d5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2z21zgb8" returned: 0 in 0.243s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Acquiring lock "refresh_cache-02715ae1-5200-4df5-8430-2f19a610d2bb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:06:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Acquired lock "refresh_cache-02715ae1-5200-4df5-8430-2f19a610d2bb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:06:18 user nova-compute[75745]: DEBUG nova.network.neutron [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:06:18 user nova-compute[75745]: DEBUG nova.network.neutron [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:06:18 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG nova.network.neutron [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Updating instance_info_cache with network_info: [{"id": "f2e5d5e1-b6be-444f-b8b6-c8f26cef560b", "address": "fa:16:3e:ff:a2:43", "network": {"id": "32e8e577-9bad-40af-b8e3-cb700c5f2ddf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-262107762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5275e723c904fa183974b49d4530824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e5d5e1-b6", "ovs_interfaceid": "f2e5d5e1-b6be-444f-b8b6-c8f26cef560b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Releasing lock "refresh_cache-02715ae1-5200-4df5-8430-2f19a610d2bb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG nova.compute.manager [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Instance network_info: |[{"id": "f2e5d5e1-b6be-444f-b8b6-c8f26cef560b", "address": "fa:16:3e:ff:a2:43", "network": {"id": "32e8e577-9bad-40af-b8e3-cb700c5f2ddf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-262107762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5275e723c904fa183974b49d4530824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e5d5e1-b6", "ovs_interfaceid": "f2e5d5e1-b6be-444f-b8b6-c8f26cef560b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Start _get_guest_xml network_info=[{"id": "f2e5d5e1-b6be-444f-b8b6-c8f26cef560b", "address": "fa:16:3e:ff:a2:43", "network": {"id": "32e8e577-9bad-40af-b8e3-cb700c5f2ddf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-262107762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5275e723c904fa183974b49d4530824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e5d5e1-b6", "ovs_interfaceid": "f2e5d5e1-b6be-444f-b8b6-c8f26cef560b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:06:19 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:06:19 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:06:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-307822093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-307822093',id=7,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcs8sgcxWpvAhCDukezlQYcNLHeLOr5mWfJj0puItGCkRZJXOGQ6MpM5uepe4ipPhQinPlSmQOH6fLeiZ2h4cJWUaoqQV3toeXUomzqHJu8XbHvxkd2bF7E/efoK+eL7A==',key_name='tempest-keypair-903294596',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5275e723c904fa183974b49d4530824',ramdisk_id='',reservation_id='r-1wsmmw87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-161209440',owner_user_name='tempest-TaggedAttachmentsTest-161209440-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77cc6ad71fa84904acd8d24eec648c94',uuid=02715ae1-5200-4df5-8430-2f19a610d2bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2e5d5e1-b6be-444f-b8b6-c8f26cef560b", "address": "fa:16:3e:ff:a2:43", "network": {"id": "32e8e577-9bad-40af-b8e3-cb700c5f2ddf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-262107762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5275e723c904fa183974b49d4530824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e5d5e1-b6", "ovs_interfaceid": "f2e5d5e1-b6be-444f-b8b6-c8f26cef560b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Converting VIF {"id": "f2e5d5e1-b6be-444f-b8b6-c8f26cef560b", "address": "fa:16:3e:ff:a2:43", "network": {"id": "32e8e577-9bad-40af-b8e3-cb700c5f2ddf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-262107762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5275e723c904fa183974b49d4530824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e5d5e1-b6", "ovs_interfaceid": "f2e5d5e1-b6be-444f-b8b6-c8f26cef560b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:a2:43,bridge_name='br-int',has_traffic_filtering=True,id=f2e5d5e1-b6be-444f-b8b6-c8f26cef560b,network=Network(32e8e577-9bad-40af-b8e3-cb700c5f2ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2e5d5e1-b6') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG nova.objects.instance [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lazy-loading 'pci_devices' on Instance uuid 02715ae1-5200-4df5-8430-2f19a610d2bb {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:06:19 user nova-compute[75745]:   <uuid>02715ae1-5200-4df5-8430-2f19a610d2bb</uuid>
Dec 01 17:06:19 user nova-compute[75745]:   <name>instance-00000007</name>
Dec 01 17:06:19 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:06:19 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:06:19 user nova-compute[75745]:   <metadata>
Dec 01 17:06:19 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:06:19 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:06:19 user nova-compute[75745]:       <nova:name>tempest-device-tagging-server-307822093</nova:name>
Dec 01 17:06:19 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:06:19</nova:creationTime>
Dec 01 17:06:19 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:06:19 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:06:19 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:06:19 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:06:19 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:06:19 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:06:19 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:06:19 user nova-compute[75745]:       <nova:owner>
Dec 01 17:06:19 user nova-compute[75745]:         <nova:user uuid="77cc6ad71fa84904acd8d24eec648c94">tempest-TaggedAttachmentsTest-161209440-project-member</nova:user>
Dec 01 17:06:19 user nova-compute[75745]:         <nova:project uuid="d5275e723c904fa183974b49d4530824">tempest-TaggedAttachmentsTest-161209440</nova:project>
Dec 01 17:06:19 user nova-compute[75745]:       </nova:owner>
Dec 01 17:06:19 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:06:19 user nova-compute[75745]:       <nova:ports>
Dec 01 17:06:19 user nova-compute[75745]:         <nova:port uuid="f2e5d5e1-b6be-444f-b8b6-c8f26cef560b">
Dec 01 17:06:19 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 01 17:06:19 user nova-compute[75745]:         </nova:port>
Dec 01 17:06:19 user nova-compute[75745]:       </nova:ports>
Dec 01 17:06:19 user nova-compute[75745]:     </nova:instance>
Dec 01 17:06:19 user nova-compute[75745]:   </metadata>
Dec 01 17:06:19 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:06:19 user nova-compute[75745]:     <system>
Dec 01 17:06:19 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:06:19 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:06:19 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:06:19 user nova-compute[75745]:       <entry name="serial">02715ae1-5200-4df5-8430-2f19a610d2bb</entry>
Dec 01 17:06:19 user nova-compute[75745]:       <entry name="uuid">02715ae1-5200-4df5-8430-2f19a610d2bb</entry>
Dec 01 17:06:19 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:06:19 user nova-compute[75745]:     </system>
Dec 01 17:06:19 user nova-compute[75745]:   </sysinfo>
Dec 01 17:06:19 user nova-compute[75745]:   <os>
Dec 01 17:06:19 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:06:19 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:06:19 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:06:19 user nova-compute[75745]:   </os>
Dec 01 17:06:19 user nova-compute[75745]:   <features>
Dec 01 17:06:19 user nova-compute[75745]:     <acpi/>
Dec 01 17:06:19 user nova-compute[75745]:     <apic/>
Dec 01 17:06:19 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:06:19 user nova-compute[75745]:   </features>
Dec 01 17:06:19 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:06:19 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:06:19 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:06:19 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:06:19 user nova-compute[75745]:   </clock>
Dec 01 17:06:19 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:06:19 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:06:19 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:06:19 user nova-compute[75745]:   </cpu>
Dec 01 17:06:19 user nova-compute[75745]:   <devices>
Dec 01 17:06:19 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:06:19 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:06:19 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk"/>
Dec 01 17:06:19 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:06:19 user nova-compute[75745]:     </disk>
Dec 01 17:06:19 user nova-compute[75745]:     <disk type="file" device="cdrom">
Dec 01 17:06:19 user nova-compute[75745]:       <driver name="qemu" type="raw" cache="none"/>
Dec 01 17:06:19 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk.config"/>
Dec 01 17:06:19 user nova-compute[75745]:       <target dev="hda" bus="ide"/>
Dec 01 17:06:19 user nova-compute[75745]:     </disk>
Dec 01 17:06:19 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:06:19 user nova-compute[75745]:       <mac address="fa:16:3e:ff:a2:43"/>
Dec 01 17:06:19 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:06:19 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:06:19 user nova-compute[75745]:       <target dev="tapf2e5d5e1-b6"/>
Dec 01 17:06:19 user nova-compute[75745]:     </interface>
Dec 01 17:06:19 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:06:19 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/console.log" append="off"/>
Dec 01 17:06:19 user nova-compute[75745]:     </serial>
Dec 01 17:06:19 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:06:19 user nova-compute[75745]:     <video>
Dec 01 17:06:19 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:06:19 user nova-compute[75745]:     </video>
Dec 01 17:06:19 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:06:19 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:06:19 user nova-compute[75745]:     </rng>
Dec 01 17:06:19 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:06:19 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:06:19 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:06:19 user nova-compute[75745]:     </memballoon>
Dec 01 17:06:19 user nova-compute[75745]:   </devices>
Dec 01 17:06:19 user nova-compute[75745]: </domain>
Dec 01 17:06:19 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-307822093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-307822093',id=7,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcs8sgcxWpvAhCDukezlQYcNLHeLOr5mWfJj0puItGCkRZJXOGQ6MpM5uepe4ipPhQinPlSmQOH6fLeiZ2h4cJWUaoqQV3toeXUomzqHJu8XbHvxkd2bF7E/efoK+eL7A==',key_name='tempest-keypair-903294596',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5275e723c904fa183974b49d4530824',ramdisk_id='',reservation_id='r-1wsmmw87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-161209440',owner_user_name='tempest-TaggedAttachmentsTest-161209440-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77cc6ad71fa84904acd8d24eec648c94',uuid=02715ae1-5200-4df5-8430-2f19a610d2bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2e5d5e1-b6be-444f-b8b6-c8f26cef560b", "address": "fa:16:3e:ff:a2:43", "network": {"id": "32e8e577-9bad-40af-b8e3-cb700c5f2ddf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-262107762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5275e723c904fa183974b49d4530824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e5d5e1-b6", "ovs_interfaceid": "f2e5d5e1-b6be-444f-b8b6-c8f26cef560b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Converting VIF {"id": "f2e5d5e1-b6be-444f-b8b6-c8f26cef560b", "address": "fa:16:3e:ff:a2:43", "network": {"id": "32e8e577-9bad-40af-b8e3-cb700c5f2ddf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-262107762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5275e723c904fa183974b49d4530824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e5d5e1-b6", "ovs_interfaceid": "f2e5d5e1-b6be-444f-b8b6-c8f26cef560b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:a2:43,bridge_name='br-int',has_traffic_filtering=True,id=f2e5d5e1-b6be-444f-b8b6-c8f26cef560b,network=Network(32e8e577-9bad-40af-b8e3-cb700c5f2ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2e5d5e1-b6') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG os_vif [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:a2:43,bridge_name='br-int',has_traffic_filtering=True,id=f2e5d5e1-b6be-444f-b8b6-c8f26cef560b,network=Network(32e8e577-9bad-40af-b8e3-cb700c5f2ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2e5d5e1-b6') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '46482a8e-87df-5f65-877f-6a1a05adf689', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2e5d5e1-b6, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf2e5d5e1-b6, col_values=(('qos', UUID('35256f2b-fccb-496f-b060-cb98625dd28c')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf2e5d5e1-b6, col_values=(('external_ids', {'iface-id': 'f2e5d5e1-b6be-444f-b8b6-c8f26cef560b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:a2:43', 'vm-uuid': '02715ae1-5200-4df5-8430-2f19a610d2bb'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:19 user nova-compute[75745]: INFO os_vif [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:a2:43,bridge_name='br-int',has_traffic_filtering=True,id=f2e5d5e1-b6be-444f-b8b6-c8f26cef560b,network=Network(32e8e577-9bad-40af-b8e3-cb700c5f2ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2e5d5e1-b6')
Dec 01 17:06:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] No BDM found with device name hda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:06:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] No VIF found with MAC fa:16:3e:ff:a2:43, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:06:19 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Using config drive
Dec 01 17:06:20 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Creating config drive at /opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk.config
Dec 01 17:06:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpo68hhvzl {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:20 user nova-compute[75745]: DEBUG nova.compute.manager [req-b62bc199-1fd4-421c-bbcf-af62b2212c90 req-4b4242de-2267-418f-a194-6e8de7dcab10 service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Received event network-changed-f2e5d5e1-b6be-444f-b8b6-c8f26cef560b {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:06:20 user nova-compute[75745]: DEBUG nova.compute.manager [req-b62bc199-1fd4-421c-bbcf-af62b2212c90 req-4b4242de-2267-418f-a194-6e8de7dcab10 service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Refreshing instance network info cache due to event network-changed-f2e5d5e1-b6be-444f-b8b6-c8f26cef560b. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:06:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b62bc199-1fd4-421c-bbcf-af62b2212c90 req-4b4242de-2267-418f-a194-6e8de7dcab10 service nova] Acquiring lock "refresh_cache-02715ae1-5200-4df5-8430-2f19a610d2bb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:06:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b62bc199-1fd4-421c-bbcf-af62b2212c90 req-4b4242de-2267-418f-a194-6e8de7dcab10 service nova] Acquired lock "refresh_cache-02715ae1-5200-4df5-8430-2f19a610d2bb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:06:20 user nova-compute[75745]: DEBUG nova.network.neutron [req-b62bc199-1fd4-421c-bbcf-af62b2212c90 req-4b4242de-2267-418f-a194-6e8de7dcab10 service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Refreshing network info cache for port f2e5d5e1-b6be-444f-b8b6-c8f26cef560b {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:06:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpo68hhvzl" returned: 0 in 0.154s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:21 user nova-compute[75745]: DEBUG nova.network.neutron [req-b62bc199-1fd4-421c-bbcf-af62b2212c90 req-4b4242de-2267-418f-a194-6e8de7dcab10 service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Updated VIF entry in instance network info cache for port f2e5d5e1-b6be-444f-b8b6-c8f26cef560b. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:06:21 user nova-compute[75745]: DEBUG nova.network.neutron [req-b62bc199-1fd4-421c-bbcf-af62b2212c90 req-4b4242de-2267-418f-a194-6e8de7dcab10 service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Updating instance_info_cache with network_info: [{"id": "f2e5d5e1-b6be-444f-b8b6-c8f26cef560b", "address": "fa:16:3e:ff:a2:43", "network": {"id": "32e8e577-9bad-40af-b8e3-cb700c5f2ddf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-262107762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5275e723c904fa183974b49d4530824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e5d5e1-b6", "ovs_interfaceid": "f2e5d5e1-b6be-444f-b8b6-c8f26cef560b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:06:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b62bc199-1fd4-421c-bbcf-af62b2212c90 req-4b4242de-2267-418f-a194-6e8de7dcab10 service nova] Releasing lock "refresh_cache-02715ae1-5200-4df5-8430-2f19a610d2bb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:06:21 user nova-compute[75745]: DEBUG nova.compute.manager [req-b62bc199-1fd4-421c-bbcf-af62b2212c90 req-4b4242de-2267-418f-a194-6e8de7dcab10 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Received event network-vif-plugged-b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:06:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b62bc199-1fd4-421c-bbcf-af62b2212c90 req-4b4242de-2267-418f-a194-6e8de7dcab10 service nova] Acquiring lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b62bc199-1fd4-421c-bbcf-af62b2212c90 req-4b4242de-2267-418f-a194-6e8de7dcab10 service nova] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b62bc199-1fd4-421c-bbcf-af62b2212c90 req-4b4242de-2267-418f-a194-6e8de7dcab10 service nova] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:21 user nova-compute[75745]: DEBUG nova.compute.manager [req-b62bc199-1fd4-421c-bbcf-af62b2212c90 req-4b4242de-2267-418f-a194-6e8de7dcab10 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] No waiting events found dispatching network-vif-plugged-b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:06:21 user nova-compute[75745]: WARNING nova.compute.manager [req-b62bc199-1fd4-421c-bbcf-af62b2212c90 req-4b4242de-2267-418f-a194-6e8de7dcab10 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Received unexpected event network-vif-plugged-b4990a3b-371a-44eb-98d8-685dc63590da for instance with vm_state active and task_state None.
Dec 01 17:06:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:21 user nova-compute[75745]: DEBUG nova.compute.manager [req-2220c806-11a7-4a92-b288-2c8f8acc4061 req-684f1a11-5f15-4af8-8b08-589de3e184f8 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Received event network-vif-plugged-5897fde5-fea9-4ff3-98b8-db1020cf5127 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:06:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2220c806-11a7-4a92-b288-2c8f8acc4061 req-684f1a11-5f15-4af8-8b08-589de3e184f8 service nova] Acquiring lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2220c806-11a7-4a92-b288-2c8f8acc4061 req-684f1a11-5f15-4af8-8b08-589de3e184f8 service nova] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2220c806-11a7-4a92-b288-2c8f8acc4061 req-684f1a11-5f15-4af8-8b08-589de3e184f8 service nova] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:21 user nova-compute[75745]: DEBUG nova.compute.manager [req-2220c806-11a7-4a92-b288-2c8f8acc4061 req-684f1a11-5f15-4af8-8b08-589de3e184f8 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] No waiting events found dispatching network-vif-plugged-5897fde5-fea9-4ff3-98b8-db1020cf5127 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:06:21 user nova-compute[75745]: WARNING nova.compute.manager [req-2220c806-11a7-4a92-b288-2c8f8acc4061 req-684f1a11-5f15-4af8-8b08-589de3e184f8 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Received unexpected event network-vif-plugged-5897fde5-fea9-4ff3-98b8-db1020cf5127 for instance with vm_state active and task_state None.
Dec 01 17:06:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:22 user nova-compute[75745]: DEBUG nova.compute.manager [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:06:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:06:22 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Instance spawned successfully.
Dec 01 17:06:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:06:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:23 user nova-compute[75745]: INFO nova.compute.manager [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Took 10.54 seconds to spawn the instance on the hypervisor.
Dec 01 17:06:23 user nova-compute[75745]: DEBUG nova.compute.manager [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:06:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:23 user nova-compute[75745]: INFO nova.compute.manager [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Took 11.77 seconds to build instance.
Dec 01 17:06:23 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5c46e045-8419-4e90-b0cf-242446f9396c tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Lock "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.034s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:23 user nova-compute[75745]: DEBUG nova.compute.manager [req-aa43aae6-e543-4c7e-a6c8-5a264fe8967a req-289daa79-613e-4a34-b602-5087110a7feb service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Received event network-vif-plugged-5897fde5-fea9-4ff3-98b8-db1020cf5127 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:06:23 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-aa43aae6-e543-4c7e-a6c8-5a264fe8967a req-289daa79-613e-4a34-b602-5087110a7feb service nova] Acquiring lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:23 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-aa43aae6-e543-4c7e-a6c8-5a264fe8967a req-289daa79-613e-4a34-b602-5087110a7feb service nova] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:23 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-aa43aae6-e543-4c7e-a6c8-5a264fe8967a req-289daa79-613e-4a34-b602-5087110a7feb service nova] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:23 user nova-compute[75745]: DEBUG nova.compute.manager [req-aa43aae6-e543-4c7e-a6c8-5a264fe8967a req-289daa79-613e-4a34-b602-5087110a7feb service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] No waiting events found dispatching network-vif-plugged-5897fde5-fea9-4ff3-98b8-db1020cf5127 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:06:23 user nova-compute[75745]: WARNING nova.compute.manager [req-aa43aae6-e543-4c7e-a6c8-5a264fe8967a req-289daa79-613e-4a34-b602-5087110a7feb service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Received unexpected event network-vif-plugged-5897fde5-fea9-4ff3-98b8-db1020cf5127 for instance with vm_state active and task_state None.
Dec 01 17:06:24 user nova-compute[75745]: DEBUG nova.compute.manager [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:06:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:06:24 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Instance spawned successfully.
Dec 01 17:06:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:06:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:24 user nova-compute[75745]: INFO nova.compute.manager [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Took 14.60 seconds to spawn the instance on the hypervisor.
Dec 01 17:06:24 user nova-compute[75745]: DEBUG nova.compute.manager [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:06:24 user nova-compute[75745]: INFO nova.compute.manager [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Took 15.82 seconds to build instance.
Dec 01 17:06:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-30583fd5-f522-443c-9cf2-2be377d7ade2 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Lock "c7fb74ee-dfa0-40e1-8773-99bd4a0402d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.992s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:24 user nova-compute[75745]: DEBUG nova.compute.manager [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:06:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:06:24 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Instance spawned successfully.
Dec 01 17:06:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:06:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:24 user nova-compute[75745]: INFO nova.compute.manager [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Took 9.18 seconds to spawn the instance on the hypervisor.
Dec 01 17:06:24 user nova-compute[75745]: DEBUG nova.compute.manager [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:06:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:24 user nova-compute[75745]: INFO nova.compute.manager [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Took 10.42 seconds to build instance.
Dec 01 17:06:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-61363b00-4e5e-46d8-838b-0db80241c290 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lock "02715ae1-5200-4df5-8430-2f19a610d2bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.557s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:25 user nova-compute[75745]: DEBUG nova.compute.manager [req-7e3909c2-12b7-4a18-b6a8-7b9445aead62 req-64c1f382-d506-491d-9f65-b59e046d1458 service nova] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Received event network-vif-plugged-9f322a2f-deae-4c15-8b43-c21c779ed76a {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:06:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7e3909c2-12b7-4a18-b6a8-7b9445aead62 req-64c1f382-d506-491d-9f65-b59e046d1458 service nova] Acquiring lock "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7e3909c2-12b7-4a18-b6a8-7b9445aead62 req-64c1f382-d506-491d-9f65-b59e046d1458 service nova] Lock "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7e3909c2-12b7-4a18-b6a8-7b9445aead62 req-64c1f382-d506-491d-9f65-b59e046d1458 service nova] Lock "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:25 user nova-compute[75745]: DEBUG nova.compute.manager [req-7e3909c2-12b7-4a18-b6a8-7b9445aead62 req-64c1f382-d506-491d-9f65-b59e046d1458 service nova] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] No waiting events found dispatching network-vif-plugged-9f322a2f-deae-4c15-8b43-c21c779ed76a {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:06:25 user nova-compute[75745]: WARNING nova.compute.manager [req-7e3909c2-12b7-4a18-b6a8-7b9445aead62 req-64c1f382-d506-491d-9f65-b59e046d1458 service nova] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Received unexpected event network-vif-plugged-9f322a2f-deae-4c15-8b43-c21c779ed76a for instance with vm_state active and task_state None.
Dec 01 17:06:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Acquiring lock "0e256c89-0301-431a-ae27-dfd7c2af19f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Lock "0e256c89-0301-431a-ae27-dfd7c2af19f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:26 user nova-compute[75745]: DEBUG nova.compute.manager [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:06:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:26 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:06:26 user nova-compute[75745]: INFO nova.compute.claims [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Claim successful on node user
Dec 01 17:06:26 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:06:26 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:06:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.567s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:26 user nova-compute[75745]: DEBUG nova.compute.manager [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG nova.compute.manager [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG nova.network.neutron [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:06:27 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:06:27 user nova-compute[75745]: DEBUG nova.compute.manager [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG nova.policy [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12e2e99da25148c69846d9afced1f307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c36b3e1f1ae4122abfac021cefc809a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG nova.compute.manager [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:06:27 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Creating image(s)
Dec 01 17:06:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Acquiring lock "/opt/stack/data/nova/instances/0e256c89-0301-431a-ae27-dfd7c2af19f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Lock "/opt/stack/data/nova/instances/0e256c89-0301-431a-ae27-dfd7c2af19f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Lock "/opt/stack/data/nova/instances/0e256c89-0301-431a-ae27-dfd7c2af19f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG nova.compute.manager [req-e86a591d-6abb-4ea8-a652-afe597a16c66 req-5a932c93-72f4-4533-bc52-730f79fca581 service nova] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Received event network-vif-plugged-9f322a2f-deae-4c15-8b43-c21c779ed76a {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e86a591d-6abb-4ea8-a652-afe597a16c66 req-5a932c93-72f4-4533-bc52-730f79fca581 service nova] Acquiring lock "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e86a591d-6abb-4ea8-a652-afe597a16c66 req-5a932c93-72f4-4533-bc52-730f79fca581 service nova] Lock "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e86a591d-6abb-4ea8-a652-afe597a16c66 req-5a932c93-72f4-4533-bc52-730f79fca581 service nova] Lock "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG nova.compute.manager [req-e86a591d-6abb-4ea8-a652-afe597a16c66 req-5a932c93-72f4-4533-bc52-730f79fca581 service nova] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] No waiting events found dispatching network-vif-plugged-9f322a2f-deae-4c15-8b43-c21c779ed76a {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:06:27 user nova-compute[75745]: WARNING nova.compute.manager [req-e86a591d-6abb-4ea8-a652-afe597a16c66 req-5a932c93-72f4-4533-bc52-730f79fca581 service nova] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Received unexpected event network-vif-plugged-9f322a2f-deae-4c15-8b43-c21c779ed76a for instance with vm_state active and task_state None.
Dec 01 17:06:27 user nova-compute[75745]: DEBUG nova.compute.manager [req-e86a591d-6abb-4ea8-a652-afe597a16c66 req-5a932c93-72f4-4533-bc52-730f79fca581 service nova] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Received event network-vif-plugged-0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e86a591d-6abb-4ea8-a652-afe597a16c66 req-5a932c93-72f4-4533-bc52-730f79fca581 service nova] Acquiring lock "c7fb74ee-dfa0-40e1-8773-99bd4a0402d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e86a591d-6abb-4ea8-a652-afe597a16c66 req-5a932c93-72f4-4533-bc52-730f79fca581 service nova] Lock "c7fb74ee-dfa0-40e1-8773-99bd4a0402d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e86a591d-6abb-4ea8-a652-afe597a16c66 req-5a932c93-72f4-4533-bc52-730f79fca581 service nova] Lock "c7fb74ee-dfa0-40e1-8773-99bd4a0402d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG nova.compute.manager [req-e86a591d-6abb-4ea8-a652-afe597a16c66 req-5a932c93-72f4-4533-bc52-730f79fca581 service nova] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] No waiting events found dispatching network-vif-plugged-0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:06:27 user nova-compute[75745]: WARNING nova.compute.manager [req-e86a591d-6abb-4ea8-a652-afe597a16c66 req-5a932c93-72f4-4533-bc52-730f79fca581 service nova] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Received unexpected event network-vif-plugged-0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f for instance with vm_state active and task_state None.
Dec 01 17:06:27 user nova-compute[75745]: DEBUG nova.compute.manager [req-e86a591d-6abb-4ea8-a652-afe597a16c66 req-5a932c93-72f4-4533-bc52-730f79fca581 service nova] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Received event network-vif-plugged-0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e86a591d-6abb-4ea8-a652-afe597a16c66 req-5a932c93-72f4-4533-bc52-730f79fca581 service nova] Acquiring lock "c7fb74ee-dfa0-40e1-8773-99bd4a0402d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e86a591d-6abb-4ea8-a652-afe597a16c66 req-5a932c93-72f4-4533-bc52-730f79fca581 service nova] Lock "c7fb74ee-dfa0-40e1-8773-99bd4a0402d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e86a591d-6abb-4ea8-a652-afe597a16c66 req-5a932c93-72f4-4533-bc52-730f79fca581 service nova] Lock "c7fb74ee-dfa0-40e1-8773-99bd4a0402d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG nova.compute.manager [req-e86a591d-6abb-4ea8-a652-afe597a16c66 req-5a932c93-72f4-4533-bc52-730f79fca581 service nova] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] No waiting events found dispatching network-vif-plugged-0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:06:27 user nova-compute[75745]: WARNING nova.compute.manager [req-e86a591d-6abb-4ea8-a652-afe597a16c66 req-5a932c93-72f4-4533-bc52-730f79fca581 service nova] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Received unexpected event network-vif-plugged-0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f for instance with vm_state active and task_state None.
Dec 01 17:06:27 user nova-compute[75745]: DEBUG nova.compute.manager [req-e86a591d-6abb-4ea8-a652-afe597a16c66 req-5a932c93-72f4-4533-bc52-730f79fca581 service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Received event network-vif-plugged-f2e5d5e1-b6be-444f-b8b6-c8f26cef560b {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e86a591d-6abb-4ea8-a652-afe597a16c66 req-5a932c93-72f4-4533-bc52-730f79fca581 service nova] Acquiring lock "02715ae1-5200-4df5-8430-2f19a610d2bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e86a591d-6abb-4ea8-a652-afe597a16c66 req-5a932c93-72f4-4533-bc52-730f79fca581 service nova] Lock "02715ae1-5200-4df5-8430-2f19a610d2bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e86a591d-6abb-4ea8-a652-afe597a16c66 req-5a932c93-72f4-4533-bc52-730f79fca581 service nova] Lock "02715ae1-5200-4df5-8430-2f19a610d2bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG nova.compute.manager [req-e86a591d-6abb-4ea8-a652-afe597a16c66 req-5a932c93-72f4-4533-bc52-730f79fca581 service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] No waiting events found dispatching network-vif-plugged-f2e5d5e1-b6be-444f-b8b6-c8f26cef560b {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:06:27 user nova-compute[75745]: WARNING nova.compute.manager [req-e86a591d-6abb-4ea8-a652-afe597a16c66 req-5a932c93-72f4-4533-bc52-730f79fca581 service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Received unexpected event network-vif-plugged-f2e5d5e1-b6be-444f-b8b6-c8f26cef560b for instance with vm_state active and task_state None.
Dec 01 17:06:27 user nova-compute[75745]: DEBUG nova.compute.manager [req-e86a591d-6abb-4ea8-a652-afe597a16c66 req-5a932c93-72f4-4533-bc52-730f79fca581 service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Received event network-vif-plugged-f2e5d5e1-b6be-444f-b8b6-c8f26cef560b {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e86a591d-6abb-4ea8-a652-afe597a16c66 req-5a932c93-72f4-4533-bc52-730f79fca581 service nova] Acquiring lock "02715ae1-5200-4df5-8430-2f19a610d2bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e86a591d-6abb-4ea8-a652-afe597a16c66 req-5a932c93-72f4-4533-bc52-730f79fca581 service nova] Lock "02715ae1-5200-4df5-8430-2f19a610d2bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e86a591d-6abb-4ea8-a652-afe597a16c66 req-5a932c93-72f4-4533-bc52-730f79fca581 service nova] Lock "02715ae1-5200-4df5-8430-2f19a610d2bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG nova.compute.manager [req-e86a591d-6abb-4ea8-a652-afe597a16c66 req-5a932c93-72f4-4533-bc52-730f79fca581 service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] No waiting events found dispatching network-vif-plugged-f2e5d5e1-b6be-444f-b8b6-c8f26cef560b {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:06:27 user nova-compute[75745]: WARNING nova.compute.manager [req-e86a591d-6abb-4ea8-a652-afe597a16c66 req-5a932c93-72f4-4533-bc52-730f79fca581 service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Received unexpected event network-vif-plugged-f2e5d5e1-b6be-444f-b8b6-c8f26cef560b for instance with vm_state active and task_state None.
Dec 01 17:06:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.217s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.241s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/0e256c89-0301-431a-ae27-dfd7c2af19f2/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/0e256c89-0301-431a-ae27-dfd7c2af19f2/disk 1073741824" returned: 0 in 0.083s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.332s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:28 user nova-compute[75745]: DEBUG nova.network.neutron [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Successfully created port: 2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:06:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.269s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:28 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0e256c89-0301-431a-ae27-dfd7c2af19f2/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:06:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e256c89-0301-431a-ae27-dfd7c2af19f2/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e256c89-0301-431a-ae27-dfd7c2af19f2/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:28 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Cannot resize image /opt/stack/data/nova/instances/0e256c89-0301-431a-ae27-dfd7c2af19f2/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:06:28 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:06:28 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Ensure instance console log exists: /opt/stack/data/nova/instances/0e256c89-0301-431a-ae27-dfd7c2af19f2/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:06:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.005s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:28 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:28 user nova-compute[75745]: DEBUG nova.network.neutron [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Successfully updated port: 2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:06:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Acquiring lock "refresh_cache-0e256c89-0301-431a-ae27-dfd7c2af19f2" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:06:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Acquired lock "refresh_cache-0e256c89-0301-431a-ae27-dfd7c2af19f2" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:06:28 user nova-compute[75745]: DEBUG nova.network.neutron [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:06:28 user nova-compute[75745]: DEBUG nova.network.neutron [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG nova.network.neutron [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Updating instance_info_cache with network_info: [{"id": "2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1", "address": "fa:16:3e:66:77:e0", "network": {"id": "c0dde7ef-077a-49d3-996e-9cd7f48984ce", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-105760332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c36b3e1f1ae4122abfac021cefc809a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bbb1dd6-ad", "ovs_interfaceid": "2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Releasing lock "refresh_cache-0e256c89-0301-431a-ae27-dfd7c2af19f2" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG nova.compute.manager [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Instance network_info: |[{"id": "2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1", "address": "fa:16:3e:66:77:e0", "network": {"id": "c0dde7ef-077a-49d3-996e-9cd7f48984ce", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-105760332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c36b3e1f1ae4122abfac021cefc809a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bbb1dd6-ad", "ovs_interfaceid": "2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Start _get_guest_xml network_info=[{"id": "2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1", "address": "fa:16:3e:66:77:e0", "network": {"id": "c0dde7ef-077a-49d3-996e-9cd7f48984ce", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-105760332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c36b3e1f1ae4122abfac021cefc809a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bbb1dd6-ad", "ovs_interfaceid": "2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:06:29 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:06:29 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:06:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:06:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-796321199',display_name='tempest-VolumesAssistedSnapshotsTest-server-796321199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-796321199',id=8,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1aYetgDvzSaTYJHtVcSiLSi1G5KPaJEZd7B7gpxzbW4kzRhzVmy3AthrA4kZjytlEb+QCiAOIjWgZZF51Qw0A6nGMWrOW66g1LFo+JkL3nCEs8W5CJQEKwGYuSm8JL1g==',key_name='tempest-keypair-81983607',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c36b3e1f1ae4122abfac021cefc809a',ramdisk_id='',reservation_id='r-20a5cgwp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-180603530',owner_user_name='tempest-VolumesAssistedSnapshotsTest-180603530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12e2e99da25148c69846d9afced1f307',uuid=0e256c89-0301-431a-ae27-dfd7c2af19f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1", "address": "fa:16:3e:66:77:e0", "network": {"id": "c0dde7ef-077a-49d3-996e-9cd7f48984ce", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-105760332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c36b3e1f1ae4122abfac021cefc809a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bbb1dd6-ad", "ovs_interfaceid": "2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Converting VIF {"id": "2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1", "address": "fa:16:3e:66:77:e0", "network": {"id": "c0dde7ef-077a-49d3-996e-9cd7f48984ce", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-105760332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c36b3e1f1ae4122abfac021cefc809a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bbb1dd6-ad", "ovs_interfaceid": "2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:77:e0,bridge_name='br-int',has_traffic_filtering=True,id=2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1,network=Network(c0dde7ef-077a-49d3-996e-9cd7f48984ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bbb1dd6-ad') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG nova.objects.instance [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e256c89-0301-431a-ae27-dfd7c2af19f2 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:06:29 user nova-compute[75745]:   <uuid>0e256c89-0301-431a-ae27-dfd7c2af19f2</uuid>
Dec 01 17:06:29 user nova-compute[75745]:   <name>instance-00000008</name>
Dec 01 17:06:29 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:06:29 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:06:29 user nova-compute[75745]:   <metadata>
Dec 01 17:06:29 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:06:29 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:06:29 user nova-compute[75745]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-796321199</nova:name>
Dec 01 17:06:29 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:06:29</nova:creationTime>
Dec 01 17:06:29 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:06:29 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:06:29 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:06:29 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:06:29 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:06:29 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:06:29 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:06:29 user nova-compute[75745]:       <nova:owner>
Dec 01 17:06:29 user nova-compute[75745]:         <nova:user uuid="12e2e99da25148c69846d9afced1f307">tempest-VolumesAssistedSnapshotsTest-180603530-project-member</nova:user>
Dec 01 17:06:29 user nova-compute[75745]:         <nova:project uuid="9c36b3e1f1ae4122abfac021cefc809a">tempest-VolumesAssistedSnapshotsTest-180603530</nova:project>
Dec 01 17:06:29 user nova-compute[75745]:       </nova:owner>
Dec 01 17:06:29 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:06:29 user nova-compute[75745]:       <nova:ports>
Dec 01 17:06:29 user nova-compute[75745]:         <nova:port uuid="2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1">
Dec 01 17:06:29 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 01 17:06:29 user nova-compute[75745]:         </nova:port>
Dec 01 17:06:29 user nova-compute[75745]:       </nova:ports>
Dec 01 17:06:29 user nova-compute[75745]:     </nova:instance>
Dec 01 17:06:29 user nova-compute[75745]:   </metadata>
Dec 01 17:06:29 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:06:29 user nova-compute[75745]:     <system>
Dec 01 17:06:29 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:06:29 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:06:29 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:06:29 user nova-compute[75745]:       <entry name="serial">0e256c89-0301-431a-ae27-dfd7c2af19f2</entry>
Dec 01 17:06:29 user nova-compute[75745]:       <entry name="uuid">0e256c89-0301-431a-ae27-dfd7c2af19f2</entry>
Dec 01 17:06:29 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:06:29 user nova-compute[75745]:     </system>
Dec 01 17:06:29 user nova-compute[75745]:   </sysinfo>
Dec 01 17:06:29 user nova-compute[75745]:   <os>
Dec 01 17:06:29 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:06:29 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:06:29 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:06:29 user nova-compute[75745]:   </os>
Dec 01 17:06:29 user nova-compute[75745]:   <features>
Dec 01 17:06:29 user nova-compute[75745]:     <acpi/>
Dec 01 17:06:29 user nova-compute[75745]:     <apic/>
Dec 01 17:06:29 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:06:29 user nova-compute[75745]:   </features>
Dec 01 17:06:29 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:06:29 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:06:29 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:06:29 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:06:29 user nova-compute[75745]:   </clock>
Dec 01 17:06:29 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:06:29 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:06:29 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:06:29 user nova-compute[75745]:   </cpu>
Dec 01 17:06:29 user nova-compute[75745]:   <devices>
Dec 01 17:06:29 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:06:29 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:06:29 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/0e256c89-0301-431a-ae27-dfd7c2af19f2/disk"/>
Dec 01 17:06:29 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:06:29 user nova-compute[75745]:     </disk>
Dec 01 17:06:29 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:06:29 user nova-compute[75745]:       <mac address="fa:16:3e:66:77:e0"/>
Dec 01 17:06:29 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:06:29 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:06:29 user nova-compute[75745]:       <target dev="tap2bbb1dd6-ad"/>
Dec 01 17:06:29 user nova-compute[75745]:     </interface>
Dec 01 17:06:29 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:06:29 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/0e256c89-0301-431a-ae27-dfd7c2af19f2/console.log" append="off"/>
Dec 01 17:06:29 user nova-compute[75745]:     </serial>
Dec 01 17:06:29 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:06:29 user nova-compute[75745]:     <video>
Dec 01 17:06:29 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:06:29 user nova-compute[75745]:     </video>
Dec 01 17:06:29 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:06:29 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:06:29 user nova-compute[75745]:     </rng>
Dec 01 17:06:29 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:06:29 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:06:29 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:06:29 user nova-compute[75745]:     </memballoon>
Dec 01 17:06:29 user nova-compute[75745]:   </devices>
Dec 01 17:06:29 user nova-compute[75745]: </domain>
Dec 01 17:06:29 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:06:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-796321199',display_name='tempest-VolumesAssistedSnapshotsTest-server-796321199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-796321199',id=8,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1aYetgDvzSaTYJHtVcSiLSi1G5KPaJEZd7B7gpxzbW4kzRhzVmy3AthrA4kZjytlEb+QCiAOIjWgZZF51Qw0A6nGMWrOW66g1LFo+JkL3nCEs8W5CJQEKwGYuSm8JL1g==',key_name='tempest-keypair-81983607',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c36b3e1f1ae4122abfac021cefc809a',ramdisk_id='',reservation_id='r-20a5cgwp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-180603530',owner_user_name='tempest-VolumesAssistedSnapshotsTest-180603530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12e2e99da25148c69846d9afced1f307',uuid=0e256c89-0301-431a-ae27-dfd7c2af19f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1", "address": "fa:16:3e:66:77:e0", "network": {"id": "c0dde7ef-077a-49d3-996e-9cd7f48984ce", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-105760332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c36b3e1f1ae4122abfac021cefc809a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bbb1dd6-ad", "ovs_interfaceid": "2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Converting VIF {"id": "2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1", "address": "fa:16:3e:66:77:e0", "network": {"id": "c0dde7ef-077a-49d3-996e-9cd7f48984ce", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-105760332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c36b3e1f1ae4122abfac021cefc809a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bbb1dd6-ad", "ovs_interfaceid": "2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:77:e0,bridge_name='br-int',has_traffic_filtering=True,id=2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1,network=Network(c0dde7ef-077a-49d3-996e-9cd7f48984ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bbb1dd6-ad') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG os_vif [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:77:e0,bridge_name='br-int',has_traffic_filtering=True,id=2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1,network=Network(c0dde7ef-077a-49d3-996e-9cd7f48984ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bbb1dd6-ad') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6cd1f6b7-7211-5ef9-ad1f-d5e7ef7049eb', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG nova.compute.manager [req-39619fb6-f3ea-40de-bebf-9fb93771510a req-ddabcc79-5e70-4f57-b26a-29e684169d9b service nova] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Received event network-changed-2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG nova.compute.manager [req-39619fb6-f3ea-40de-bebf-9fb93771510a req-ddabcc79-5e70-4f57-b26a-29e684169d9b service nova] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Refreshing instance network info cache due to event network-changed-2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-39619fb6-f3ea-40de-bebf-9fb93771510a req-ddabcc79-5e70-4f57-b26a-29e684169d9b service nova] Acquiring lock "refresh_cache-0e256c89-0301-431a-ae27-dfd7c2af19f2" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-39619fb6-f3ea-40de-bebf-9fb93771510a req-ddabcc79-5e70-4f57-b26a-29e684169d9b service nova] Acquired lock "refresh_cache-0e256c89-0301-431a-ae27-dfd7c2af19f2" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG nova.network.neutron [req-39619fb6-f3ea-40de-bebf-9fb93771510a req-ddabcc79-5e70-4f57-b26a-29e684169d9b service nova] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Refreshing network info cache for port 2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2bbb1dd6-ad, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2bbb1dd6-ad, col_values=(('qos', UUID('d131df9c-cda4-4a35-aa3e-f3ae27b6ebcd')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2bbb1dd6-ad, col_values=(('external_ids', {'iface-id': '2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:77:e0', 'vm-uuid': '0e256c89-0301-431a-ae27-dfd7c2af19f2'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:29 user nova-compute[75745]: INFO os_vif [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:77:e0,bridge_name='br-int',has_traffic_filtering=True,id=2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1,network=Network(c0dde7ef-077a-49d3-996e-9cd7f48984ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bbb1dd6-ad')
Dec 01 17:06:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:06:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] No VIF found with MAC fa:16:3e:66:77:e0, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:06:30 user nova-compute[75745]: DEBUG nova.network.neutron [req-39619fb6-f3ea-40de-bebf-9fb93771510a req-ddabcc79-5e70-4f57-b26a-29e684169d9b service nova] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Updated VIF entry in instance network info cache for port 2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:06:30 user nova-compute[75745]: DEBUG nova.network.neutron [req-39619fb6-f3ea-40de-bebf-9fb93771510a req-ddabcc79-5e70-4f57-b26a-29e684169d9b service nova] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Updating instance_info_cache with network_info: [{"id": "2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1", "address": "fa:16:3e:66:77:e0", "network": {"id": "c0dde7ef-077a-49d3-996e-9cd7f48984ce", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-105760332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c36b3e1f1ae4122abfac021cefc809a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bbb1dd6-ad", "ovs_interfaceid": "2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:06:30 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-39619fb6-f3ea-40de-bebf-9fb93771510a req-ddabcc79-5e70-4f57-b26a-29e684169d9b service nova] Releasing lock "refresh_cache-0e256c89-0301-431a-ae27-dfd7c2af19f2" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:06:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:31 user nova-compute[75745]: DEBUG nova.compute.manager [req-1daedd09-b6c5-422f-9153-80a51e12cbbb req-2ef648b1-cb1f-4bd2-bee0-b19b6e7565db service nova] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Received event network-vif-plugged-2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:06:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1daedd09-b6c5-422f-9153-80a51e12cbbb req-2ef648b1-cb1f-4bd2-bee0-b19b6e7565db service nova] Acquiring lock "0e256c89-0301-431a-ae27-dfd7c2af19f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1daedd09-b6c5-422f-9153-80a51e12cbbb req-2ef648b1-cb1f-4bd2-bee0-b19b6e7565db service nova] Lock "0e256c89-0301-431a-ae27-dfd7c2af19f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1daedd09-b6c5-422f-9153-80a51e12cbbb req-2ef648b1-cb1f-4bd2-bee0-b19b6e7565db service nova] Lock "0e256c89-0301-431a-ae27-dfd7c2af19f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:31 user nova-compute[75745]: DEBUG nova.compute.manager [req-1daedd09-b6c5-422f-9153-80a51e12cbbb req-2ef648b1-cb1f-4bd2-bee0-b19b6e7565db service nova] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] No waiting events found dispatching network-vif-plugged-2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:06:31 user nova-compute[75745]: WARNING nova.compute.manager [req-1daedd09-b6c5-422f-9153-80a51e12cbbb req-2ef648b1-cb1f-4bd2-bee0-b19b6e7565db service nova] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Received unexpected event network-vif-plugged-2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1 for instance with vm_state building and task_state spawning.
Dec 01 17:06:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:32 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:06:32 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Cleaning up deleted instances {{(pid=75745) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 01 17:06:32 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] There are 0 instances to clean {{(pid=75745) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 01 17:06:32 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:06:32 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75745) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 01 17:06:32 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:06:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:33 user nova-compute[75745]: DEBUG nova.compute.manager [req-bb02576f-dfa5-4ec0-807c-051bc12c54a7 req-3f3a20bd-0783-46e0-9d85-591d40d32571 service nova] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Received event network-vif-plugged-2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:06:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-bb02576f-dfa5-4ec0-807c-051bc12c54a7 req-3f3a20bd-0783-46e0-9d85-591d40d32571 service nova] Acquiring lock "0e256c89-0301-431a-ae27-dfd7c2af19f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-bb02576f-dfa5-4ec0-807c-051bc12c54a7 req-3f3a20bd-0783-46e0-9d85-591d40d32571 service nova] Lock "0e256c89-0301-431a-ae27-dfd7c2af19f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-bb02576f-dfa5-4ec0-807c-051bc12c54a7 req-3f3a20bd-0783-46e0-9d85-591d40d32571 service nova] Lock "0e256c89-0301-431a-ae27-dfd7c2af19f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:33 user nova-compute[75745]: DEBUG nova.compute.manager [req-bb02576f-dfa5-4ec0-807c-051bc12c54a7 req-3f3a20bd-0783-46e0-9d85-591d40d32571 service nova] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] No waiting events found dispatching network-vif-plugged-2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:06:33 user nova-compute[75745]: WARNING nova.compute.manager [req-bb02576f-dfa5-4ec0-807c-051bc12c54a7 req-3f3a20bd-0783-46e0-9d85-591d40d32571 service nova] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Received unexpected event network-vif-plugged-2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1 for instance with vm_state building and task_state spawning.
Dec 01 17:06:34 user nova-compute[75745]: DEBUG nova.compute.manager [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:06:34 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:06:34 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Instance spawned successfully.
Dec 01 17:06:34 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:06:34 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:34 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:34 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:34 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:34 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:34 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:34 user nova-compute[75745]: INFO nova.compute.manager [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Took 6.87 seconds to spawn the instance on the hypervisor.
Dec 01 17:06:34 user nova-compute[75745]: DEBUG nova.compute.manager [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:06:34 user nova-compute[75745]: INFO nova.compute.manager [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Took 8.06 seconds to build instance.
Dec 01 17:06:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6d53a4b5-445f-4a72-abbe-1c74ad5e8cb9 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Lock "0e256c89-0301-431a-ae27-dfd7c2af19f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.195s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:34 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:06:34 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:06:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:34 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:06:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b566a6fd-2ea6-4df7-8866-eab5b4d398a7/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b566a6fd-2ea6-4df7-8866-eab5b4d398a7/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b566a6fd-2ea6-4df7-8866-eab5b4d398a7/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b566a6fd-2ea6-4df7-8866-eab5b4d398a7/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bfb9f9-95a4-49f5-b781-5e78c83c54d1/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bfb9f9-95a4-49f5-b781-5e78c83c54d1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bfb9f9-95a4-49f5-b781-5e78c83c54d1/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:37 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bfb9f9-95a4-49f5-b781-5e78c83c54d1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:37 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:37 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:37 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:37 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:37 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fb74ee-dfa0-40e1-8773-99bd4a0402d5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:37 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fb74ee-dfa0-40e1-8773-99bd4a0402d5/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:37 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fb74ee-dfa0-40e1-8773-99bd4a0402d5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:37 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fb74ee-dfa0-40e1-8773-99bd4a0402d5/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:37 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc78dcf1-f005-415c-ac27-798cab8f52fb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc78dcf1-f005-415c-ac27-798cab8f52fb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc78dcf1-f005-415c-ac27-798cab8f52fb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc78dcf1-f005-415c-ac27-798cab8f52fb/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e256c89-0301-431a-ae27-dfd7c2af19f2/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e256c89-0301-431a-ae27-dfd7c2af19f2/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e256c89-0301-431a-ae27-dfd7c2af19f2/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e256c89-0301-431a-ae27-dfd7c2af19f2/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:39 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:06:39 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:06:39 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=7763MB free_disk=25.682994842529297GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:06:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:39 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance dc78dcf1-f005-415c-ac27-798cab8f52fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:06:39 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance b566a6fd-2ea6-4df7-8866-eab5b4d398a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:06:39 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 4ac6f586-cc5b-4a3f-b374-4b2006a48427 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:06:39 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 2abc6436-bf45-497a-acd2-47d43d5e158c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:06:39 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance c7fb74ee-dfa0-40e1-8773-99bd4a0402d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:06:39 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance d9bfb9f9-95a4-49f5-b781-5e78c83c54d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:06:39 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 02715ae1-5200-4df5-8430-2f19a610d2bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:06:39 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 0e256c89-0301-431a-ae27-dfd7c2af19f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:06:39 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:06:39 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:06:39 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:06:39 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:06:39 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:06:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.549s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:40 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:06:40 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:06:40 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Rebuilding the list of instances to heal {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 17:06:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-dc78dcf1-f005-415c-ac27-798cab8f52fb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:06:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-dc78dcf1-f005-415c-ac27-798cab8f52fb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:06:40 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:06:40 user nova-compute[75745]: DEBUG nova.objects.instance [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lazy-loading 'info_cache' on Instance uuid dc78dcf1-f005-415c-ac27-798cab8f52fb {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:06:41 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Updating instance_info_cache with network_info: [{"id": "7b52d740-f797-4bc8-9e0c-d9f4744e4a4f", "address": "fa:16:3e:9e:67:88", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b52d740-f7", "ovs_interfaceid": "7b52d740-f797-4bc8-9e0c-d9f4744e4a4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:06:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-dc78dcf1-f005-415c-ac27-798cab8f52fb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:06:41 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:06:41 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:06:41 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:06:41 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:06:41 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:06:41 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:06:41 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:06:41 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:06:43 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Acquiring lock "9d4bc58d-90b6-4621-80a9-0b72194b10da" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Lock "9d4bc58d-90b6-4621-80a9-0b72194b10da" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:49 user nova-compute[75745]: DEBUG nova.compute.manager [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:06:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:49 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:06:49 user nova-compute[75745]: INFO nova.compute.claims [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Claim successful on node user
Dec 01 17:06:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:49 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Refreshing inventories for resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 01 17:06:49 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Updating ProviderTree inventory for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 01 17:06:49 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Updating inventory in ProviderTree for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 01 17:06:49 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Refreshing aggregate associations for resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9, aggregates: None {{(pid=75745) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 01 17:06:49 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Refreshing trait associations for resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9, traits: COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=75745) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 01 17:06:49 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:06:49 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:06:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:49 user nova-compute[75745]: DEBUG nova.compute.manager [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:06:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Acquiring lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:50 user nova-compute[75745]: DEBUG nova.compute.manager [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:06:50 user nova-compute[75745]: DEBUG nova.network.neutron [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:06:50 user nova-compute[75745]: DEBUG nova.compute.manager [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:06:50 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:06:50 user nova-compute[75745]: DEBUG nova.compute.manager [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:06:50 user nova-compute[75745]: DEBUG nova.policy [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9250484734b54064bceffe0a3530b468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '304bee6e8498432fa7a1e04e3cac5bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:06:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:50 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:06:50 user nova-compute[75745]: INFO nova.compute.claims [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Claim successful on node user
Dec 01 17:06:50 user nova-compute[75745]: DEBUG nova.compute.manager [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:06:50 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:06:50 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Creating image(s)
Dec 01 17:06:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Acquiring lock "/opt/stack/data/nova/instances/9d4bc58d-90b6-4621-80a9-0b72194b10da/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Lock "/opt/stack/data/nova/instances/9d4bc58d-90b6-4621-80a9-0b72194b10da/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Lock "/opt/stack/data/nova/instances/9d4bc58d-90b6-4621-80a9-0b72194b10da/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.173s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.172s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/9d4bc58d-90b6-4621-80a9-0b72194b10da/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:50 user nova-compute[75745]: DEBUG nova.network.neutron [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Successfully created port: 6b6d1ec0-f24a-4552-8851-861f7494eb49 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:06:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/9d4bc58d-90b6-4621-80a9-0b72194b10da/disk 1073741824" returned: 0 in 0.054s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:50 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:06:50 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:06:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.575s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:50 user nova-compute[75745]: DEBUG nova.compute.manager [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:06:50 user nova-compute[75745]: DEBUG nova.compute.manager [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:06:50 user nova-compute[75745]: DEBUG nova.network.neutron [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:06:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.172s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:50 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9d4bc58d-90b6-4621-80a9-0b72194b10da/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:06:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4bc58d-90b6-4621-80a9-0b72194b10da/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:50 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:06:50 user nova-compute[75745]: DEBUG nova.compute.manager [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:06:50 user nova-compute[75745]: INFO nova.virt.block_device [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Booting with volume e3a909f6-670c-4801-83b3-67dcc39f18b9 at /dev/vda
Dec 01 17:06:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4bc58d-90b6-4621-80a9-0b72194b10da/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:50 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Cannot resize image /opt/stack/data/nova/instances/9d4bc58d-90b6-4621-80a9-0b72194b10da/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:06:50 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:06:50 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Ensure instance console log exists: /opt/stack/data/nova/instances/9d4bc58d-90b6-4621-80a9-0b72194b10da/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:06:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:51 user nova-compute[75745]: DEBUG os_brick.utils [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:06:51 user nova-compute[75745]: INFO oslo.privsep.daemon [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpznejmfoo/privsep.sock']
Dec 01 17:06:51 user sudo[86708]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpznejmfoo/privsep.sock
Dec 01 17:06:51 user sudo[86708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Dec 01 17:06:51 user nova-compute[75745]: DEBUG nova.policy [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9840763db2774692ae52f8a689ed9083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586f7ce69de240cb9e2d110530c2c7ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:06:51 user nova-compute[75745]: DEBUG nova.network.neutron [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Successfully updated port: 6b6d1ec0-f24a-4552-8851-861f7494eb49 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:06:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Acquiring lock "refresh_cache-9d4bc58d-90b6-4621-80a9-0b72194b10da" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:06:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Acquired lock "refresh_cache-9d4bc58d-90b6-4621-80a9-0b72194b10da" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:06:51 user nova-compute[75745]: DEBUG nova.network.neutron [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:06:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-33e50076-40ee-4308-8c93-c870007b4526 req-f1ad7f1e-9147-4840-8a0c-9f56d4eb1131 service nova] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Received event network-changed-6b6d1ec0-f24a-4552-8851-861f7494eb49 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:06:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-33e50076-40ee-4308-8c93-c870007b4526 req-f1ad7f1e-9147-4840-8a0c-9f56d4eb1131 service nova] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Refreshing instance network info cache due to event network-changed-6b6d1ec0-f24a-4552-8851-861f7494eb49. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:06:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-33e50076-40ee-4308-8c93-c870007b4526 req-f1ad7f1e-9147-4840-8a0c-9f56d4eb1131 service nova] Acquiring lock "refresh_cache-9d4bc58d-90b6-4621-80a9-0b72194b10da" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:06:51 user nova-compute[75745]: DEBUG nova.network.neutron [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:06:51 user nova-compute[75745]: DEBUG nova.network.neutron [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Successfully created port: d7c02fc7-a4d9-4c86-b18b-cf12d101f22f {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:06:51 user nova-compute[75745]: DEBUG nova.network.neutron [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Updating instance_info_cache with network_info: [{"id": "6b6d1ec0-f24a-4552-8851-861f7494eb49", "address": "fa:16:3e:c3:f4:38", "network": {"id": "a4de24de-6059-4a2a-bf8c-2a234f6c7d08", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1860496659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "304bee6e8498432fa7a1e04e3cac5bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6d1ec0-f2", "ovs_interfaceid": "6b6d1ec0-f24a-4552-8851-861f7494eb49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:06:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Releasing lock "refresh_cache-9d4bc58d-90b6-4621-80a9-0b72194b10da" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:06:51 user nova-compute[75745]: DEBUG nova.compute.manager [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Instance network_info: |[{"id": "6b6d1ec0-f24a-4552-8851-861f7494eb49", "address": "fa:16:3e:c3:f4:38", "network": {"id": "a4de24de-6059-4a2a-bf8c-2a234f6c7d08", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1860496659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "304bee6e8498432fa7a1e04e3cac5bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6d1ec0-f2", "ovs_interfaceid": "6b6d1ec0-f24a-4552-8851-861f7494eb49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:06:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-33e50076-40ee-4308-8c93-c870007b4526 req-f1ad7f1e-9147-4840-8a0c-9f56d4eb1131 service nova] Acquired lock "refresh_cache-9d4bc58d-90b6-4621-80a9-0b72194b10da" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:06:51 user nova-compute[75745]: DEBUG nova.network.neutron [req-33e50076-40ee-4308-8c93-c870007b4526 req-f1ad7f1e-9147-4840-8a0c-9f56d4eb1131 service nova] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Refreshing network info cache for port 6b6d1ec0-f24a-4552-8851-861f7494eb49 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:06:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Start _get_guest_xml network_info=[{"id": "6b6d1ec0-f24a-4552-8851-861f7494eb49", "address": "fa:16:3e:c3:f4:38", "network": {"id": "a4de24de-6059-4a2a-bf8c-2a234f6c7d08", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1860496659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "304bee6e8498432fa7a1e04e3cac5bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6d1ec0-f2", "ovs_interfaceid": "6b6d1ec0-f24a-4552-8851-861f7494eb49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:06:52 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:06:52 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:06:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:06:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-174829171',display_name='tempest-VolumesActionsTest-instance-174829171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-174829171',id=9,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='304bee6e8498432fa7a1e04e3cac5bc1',ramdisk_id='',reservation_id='r-tzkgadl3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1268939950',owner_user_name='tempest-VolumesActionsTest-1268939950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:50Z,user_data=None,user_id='9250484734b54064bceffe0a3530b468',uuid=9d4bc58d-90b6-4621-80a9-0b72194b10da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b6d1ec0-f24a-4552-8851-861f7494eb49", "address": "fa:16:3e:c3:f4:38", "network": {"id": "a4de24de-6059-4a2a-bf8c-2a234f6c7d08", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1860496659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "304bee6e8498432fa7a1e04e3cac5bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6d1ec0-f2", "ovs_interfaceid": "6b6d1ec0-f24a-4552-8851-861f7494eb49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Converting VIF {"id": "6b6d1ec0-f24a-4552-8851-861f7494eb49", "address": "fa:16:3e:c3:f4:38", "network": {"id": "a4de24de-6059-4a2a-bf8c-2a234f6c7d08", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1860496659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "304bee6e8498432fa7a1e04e3cac5bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6d1ec0-f2", "ovs_interfaceid": "6b6d1ec0-f24a-4552-8851-861f7494eb49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f4:38,bridge_name='br-int',has_traffic_filtering=True,id=6b6d1ec0-f24a-4552-8851-861f7494eb49,network=Network(a4de24de-6059-4a2a-bf8c-2a234f6c7d08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b6d1ec0-f2') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG nova.objects.instance [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d4bc58d-90b6-4621-80a9-0b72194b10da {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:06:52 user nova-compute[75745]:   <uuid>9d4bc58d-90b6-4621-80a9-0b72194b10da</uuid>
Dec 01 17:06:52 user nova-compute[75745]:   <name>instance-00000009</name>
Dec 01 17:06:52 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:06:52 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:06:52 user nova-compute[75745]:   <metadata>
Dec 01 17:06:52 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:06:52 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:06:52 user nova-compute[75745]:       <nova:name>tempest-VolumesActionsTest-instance-174829171</nova:name>
Dec 01 17:06:52 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:06:52</nova:creationTime>
Dec 01 17:06:52 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:06:52 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:06:52 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:06:52 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:06:52 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:06:52 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:06:52 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:06:52 user nova-compute[75745]:       <nova:owner>
Dec 01 17:06:52 user nova-compute[75745]:         <nova:user uuid="9250484734b54064bceffe0a3530b468">tempest-VolumesActionsTest-1268939950-project-member</nova:user>
Dec 01 17:06:52 user nova-compute[75745]:         <nova:project uuid="304bee6e8498432fa7a1e04e3cac5bc1">tempest-VolumesActionsTest-1268939950</nova:project>
Dec 01 17:06:52 user nova-compute[75745]:       </nova:owner>
Dec 01 17:06:52 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:06:52 user nova-compute[75745]:       <nova:ports>
Dec 01 17:06:52 user nova-compute[75745]:         <nova:port uuid="6b6d1ec0-f24a-4552-8851-861f7494eb49">
Dec 01 17:06:52 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 01 17:06:52 user nova-compute[75745]:         </nova:port>
Dec 01 17:06:52 user nova-compute[75745]:       </nova:ports>
Dec 01 17:06:52 user nova-compute[75745]:     </nova:instance>
Dec 01 17:06:52 user nova-compute[75745]:   </metadata>
Dec 01 17:06:52 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:06:52 user nova-compute[75745]:     <system>
Dec 01 17:06:52 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:06:52 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:06:52 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:06:52 user nova-compute[75745]:       <entry name="serial">9d4bc58d-90b6-4621-80a9-0b72194b10da</entry>
Dec 01 17:06:52 user nova-compute[75745]:       <entry name="uuid">9d4bc58d-90b6-4621-80a9-0b72194b10da</entry>
Dec 01 17:06:52 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:06:52 user nova-compute[75745]:     </system>
Dec 01 17:06:52 user nova-compute[75745]:   </sysinfo>
Dec 01 17:06:52 user nova-compute[75745]:   <os>
Dec 01 17:06:52 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:06:52 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:06:52 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:06:52 user nova-compute[75745]:   </os>
Dec 01 17:06:52 user nova-compute[75745]:   <features>
Dec 01 17:06:52 user nova-compute[75745]:     <acpi/>
Dec 01 17:06:52 user nova-compute[75745]:     <apic/>
Dec 01 17:06:52 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:06:52 user nova-compute[75745]:   </features>
Dec 01 17:06:52 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:06:52 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:06:52 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:06:52 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:06:52 user nova-compute[75745]:   </clock>
Dec 01 17:06:52 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:06:52 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:06:52 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:06:52 user nova-compute[75745]:   </cpu>
Dec 01 17:06:52 user nova-compute[75745]:   <devices>
Dec 01 17:06:52 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:06:52 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:06:52 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/9d4bc58d-90b6-4621-80a9-0b72194b10da/disk"/>
Dec 01 17:06:52 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:06:52 user nova-compute[75745]:     </disk>
Dec 01 17:06:52 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:06:52 user nova-compute[75745]:       <mac address="fa:16:3e:c3:f4:38"/>
Dec 01 17:06:52 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:06:52 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:06:52 user nova-compute[75745]:       <target dev="tap6b6d1ec0-f2"/>
Dec 01 17:06:52 user nova-compute[75745]:     </interface>
Dec 01 17:06:52 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:06:52 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/9d4bc58d-90b6-4621-80a9-0b72194b10da/console.log" append="off"/>
Dec 01 17:06:52 user nova-compute[75745]:     </serial>
Dec 01 17:06:52 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:06:52 user nova-compute[75745]:     <video>
Dec 01 17:06:52 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:06:52 user nova-compute[75745]:     </video>
Dec 01 17:06:52 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:06:52 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:06:52 user nova-compute[75745]:     </rng>
Dec 01 17:06:52 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:06:52 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:06:52 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:06:52 user nova-compute[75745]:     </memballoon>
Dec 01 17:06:52 user nova-compute[75745]:   </devices>
Dec 01 17:06:52 user nova-compute[75745]: </domain>
Dec 01 17:06:52 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:06:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-174829171',display_name='tempest-VolumesActionsTest-instance-174829171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-174829171',id=9,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='304bee6e8498432fa7a1e04e3cac5bc1',ramdisk_id='',reservation_id='r-tzkgadl3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1268939950',owner_user_name='tempest-VolumesActionsTest-1268939950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:50Z,user_data=None,user_id='9250484734b54064bceffe0a3530b468',uuid=9d4bc58d-90b6-4621-80a9-0b72194b10da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b6d1ec0-f24a-4552-8851-861f7494eb49", "address": "fa:16:3e:c3:f4:38", "network": {"id": "a4de24de-6059-4a2a-bf8c-2a234f6c7d08", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1860496659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "304bee6e8498432fa7a1e04e3cac5bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6d1ec0-f2", "ovs_interfaceid": "6b6d1ec0-f24a-4552-8851-861f7494eb49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Converting VIF {"id": "6b6d1ec0-f24a-4552-8851-861f7494eb49", "address": "fa:16:3e:c3:f4:38", "network": {"id": "a4de24de-6059-4a2a-bf8c-2a234f6c7d08", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1860496659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "304bee6e8498432fa7a1e04e3cac5bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6d1ec0-f2", "ovs_interfaceid": "6b6d1ec0-f24a-4552-8851-861f7494eb49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f4:38,bridge_name='br-int',has_traffic_filtering=True,id=6b6d1ec0-f24a-4552-8851-861f7494eb49,network=Network(a4de24de-6059-4a2a-bf8c-2a234f6c7d08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b6d1ec0-f2') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG os_vif [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f4:38,bridge_name='br-int',has_traffic_filtering=True,id=6b6d1ec0-f24a-4552-8851-861f7494eb49,network=Network(a4de24de-6059-4a2a-bf8c-2a234f6c7d08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b6d1ec0-f2') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3770968a-6f5f-5b2d-b45c-c8bc634a50e4', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b6d1ec0-f2, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6b6d1ec0-f2, col_values=(('qos', UUID('4b4e4ec5-995f-4782-b22d-5a32b07ee58b')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6b6d1ec0-f2, col_values=(('external_ids', {'iface-id': '6b6d1ec0-f24a-4552-8851-861f7494eb49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:f4:38', 'vm-uuid': '9d4bc58d-90b6-4621-80a9-0b72194b10da'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:52 user nova-compute[75745]: INFO os_vif [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f4:38,bridge_name='br-int',has_traffic_filtering=True,id=6b6d1ec0-f24a-4552-8851-861f7494eb49,network=Network(a4de24de-6059-4a2a-bf8c-2a234f6c7d08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b6d1ec0-f2')
Dec 01 17:06:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] No VIF found with MAC fa:16:3e:c3:f4:38, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:06:52 user sudo[86708]: pam_unix(sudo:session): session closed for user root
Dec 01 17:06:52 user nova-compute[75745]: INFO oslo.privsep.daemon [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Spawned new privsep daemon via rootwrap
Dec 01 17:06:52 user nova-compute[75745]: INFO oslo.privsep.daemon [-] privsep daemon starting
Dec 01 17:06:52 user nova-compute[75745]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Dec 01 17:06:52 user nova-compute[75745]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Dec 01 17:06:52 user nova-compute[75745]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86714
Dec 01 17:06:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c225a18f-c006-488c-80d8-06f2a6c95c3f]: (2,) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c790fd-98ad-4518-b12e-736b667825f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:06:52 user nova-compute[75745]: WARNING os_brick.initiator.connectors.nvmeof [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Dec 01 17:06:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f2a450-24ae-46b7-92ff-0e7441fc7511]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG nova.network.neutron [req-33e50076-40ee-4308-8c93-c870007b4526 req-f1ad7f1e-9147-4840-8a0c-9f56d4eb1131 service nova] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Updated VIF entry in instance network info cache for port 6b6d1ec0-f24a-4552-8851-861f7494eb49. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG nova.network.neutron [req-33e50076-40ee-4308-8c93-c870007b4526 req-f1ad7f1e-9147-4840-8a0c-9f56d4eb1131 service nova] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Updating instance_info_cache with network_info: [{"id": "6b6d1ec0-f24a-4552-8851-861f7494eb49", "address": "fa:16:3e:c3:f4:38", "network": {"id": "a4de24de-6059-4a2a-bf8c-2a234f6c7d08", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1860496659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "304bee6e8498432fa7a1e04e3cac5bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6d1ec0-f2", "ovs_interfaceid": "6b6d1ec0-f24a-4552-8851-861f7494eb49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2aaafcb-7cdc-44ea-878e-3fa4902006db]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fea4971-5964-4575-81db-d0a593f09bbd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG nova.network.neutron [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Successfully created port: 92b697c2-8400-4b91-9fd7-53df7f47c4e0 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-33e50076-40ee-4308-8c93-c870007b4526 req-f1ad7f1e-9147-4840-8a0c-9f56d4eb1131 service nova] Releasing lock "refresh_cache-9d4bc58d-90b6-4621-80a9-0b72194b10da" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:06:52 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:06:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4f82c5-f40a-4284-9f09-8e6a3ee04192]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG os_brick.utils [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] <== get_connector_properties: return (1723ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:06:52 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Updating existing volume attachment record: 46a5225a-f794-43fb-8251-06a81550313e {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:06:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Acquiring lock "5c6c7551-7045-4129-9908-c0c6fbd93124" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:53 user nova-compute[75745]: DEBUG nova.compute.manager [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:06:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:06:53 user nova-compute[75745]: INFO nova.compute.claims [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Claim successful on node user
Dec 01 17:06:53 user nova-compute[75745]: DEBUG nova.network.neutron [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Successfully created port: 9f79cb7e-7ef6-4e1a-a241-780713de2217 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:06:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:53 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:06:53 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:06:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.517s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:53 user nova-compute[75745]: DEBUG nova.compute.manager [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:06:53 user nova-compute[75745]: DEBUG nova.compute.manager [req-cc975cd6-3601-4a06-aab8-08479501d81b req-9969405b-14c9-4992-b23a-8e55881acc82 service nova] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Received event network-vif-plugged-6b6d1ec0-f24a-4552-8851-861f7494eb49 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:06:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-cc975cd6-3601-4a06-aab8-08479501d81b req-9969405b-14c9-4992-b23a-8e55881acc82 service nova] Acquiring lock "9d4bc58d-90b6-4621-80a9-0b72194b10da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-cc975cd6-3601-4a06-aab8-08479501d81b req-9969405b-14c9-4992-b23a-8e55881acc82 service nova] Lock "9d4bc58d-90b6-4621-80a9-0b72194b10da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-cc975cd6-3601-4a06-aab8-08479501d81b req-9969405b-14c9-4992-b23a-8e55881acc82 service nova] Lock "9d4bc58d-90b6-4621-80a9-0b72194b10da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:53 user nova-compute[75745]: DEBUG nova.compute.manager [req-cc975cd6-3601-4a06-aab8-08479501d81b req-9969405b-14c9-4992-b23a-8e55881acc82 service nova] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] No waiting events found dispatching network-vif-plugged-6b6d1ec0-f24a-4552-8851-861f7494eb49 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:06:53 user nova-compute[75745]: WARNING nova.compute.manager [req-cc975cd6-3601-4a06-aab8-08479501d81b req-9969405b-14c9-4992-b23a-8e55881acc82 service nova] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Received unexpected event network-vif-plugged-6b6d1ec0-f24a-4552-8851-861f7494eb49 for instance with vm_state building and task_state spawning.
Dec 01 17:06:54 user nova-compute[75745]: DEBUG nova.compute.manager [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:06:54 user nova-compute[75745]: DEBUG nova.network.neutron [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:06:54 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:06:54 user nova-compute[75745]: DEBUG nova.compute.manager [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:06:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:54 user nova-compute[75745]: INFO nova.virt.block_device [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Booting with volume 40deba30-bea8-4474-9760-b572f1f764de at /dev/vda
Dec 01 17:06:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:54 user nova-compute[75745]: DEBUG nova.network.neutron [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Successfully created port: 4b6cfe1f-9722-41e1-9679-52398359a035 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:06:54 user nova-compute[75745]: DEBUG os_brick.utils [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:06:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:54 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[050817be-29c4-483b-a71f-d86ec1e24d53]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:06:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:54 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[50146b2c-22c7-486b-8807-edaf7119c3a1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:06:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:06:54 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[253c7219-220d-495c-aeb6-980143695b95]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:06:54 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[284fed80-2387-4059-9c0f-0af479bfcd9f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:06:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:06:54 user nova-compute[75745]: DEBUG nova.policy [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c78ca75618254393ab729856fb8905b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75997c4cca1f4ebc9037a6dfc36a92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:06:54 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:06:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:06:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:06:54 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:06:54 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8fc616-27ed-4f54-aa3b-e9efd338154f]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:06:54 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:06:54 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:06:54 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:06:54 user nova-compute[75745]: DEBUG os_brick.utils [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:06:54 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Updating existing volume attachment record: 4627b361-d67b-4050-9700-24cad4da5dfa {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:06:55 user nova-compute[75745]: DEBUG nova.network.neutron [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Successfully created port: f2f8e363-9e49-43ae-b61b-7ff8893c9f8f {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:06:55 user nova-compute[75745]: DEBUG nova.network.neutron [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Successfully created port: de0d310c-2bc9-4434-8b2b-253a88febaa0 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:06:55 user nova-compute[75745]: DEBUG nova.compute.manager [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:06:55 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:06:55 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Instance spawned successfully.
Dec 01 17:06:55 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:06:55 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:55 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:55 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:55 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:55 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:55 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:06:55 user nova-compute[75745]: INFO nova.compute.manager [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Took 5.73 seconds to spawn the instance on the hypervisor.
Dec 01 17:06:55 user nova-compute[75745]: DEBUG nova.compute.manager [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:06:55 user nova-compute[75745]: INFO nova.compute.manager [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Took 6.75 seconds to build instance.
Dec 01 17:06:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1b1bda86-0591-456e-8142-12503a6f4c34 tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Lock "9d4bc58d-90b6-4621-80a9-0b72194b10da" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.880s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-11d837aa-f656-418a-b5a3-9cfa53c1d308 req-eef7896a-fa43-412f-8d0c-a01c0fc470b5 service nova] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Received event network-vif-plugged-6b6d1ec0-f24a-4552-8851-861f7494eb49 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:06:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-11d837aa-f656-418a-b5a3-9cfa53c1d308 req-eef7896a-fa43-412f-8d0c-a01c0fc470b5 service nova] Acquiring lock "9d4bc58d-90b6-4621-80a9-0b72194b10da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:06:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-11d837aa-f656-418a-b5a3-9cfa53c1d308 req-eef7896a-fa43-412f-8d0c-a01c0fc470b5 service nova] Lock "9d4bc58d-90b6-4621-80a9-0b72194b10da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:06:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-11d837aa-f656-418a-b5a3-9cfa53c1d308 req-eef7896a-fa43-412f-8d0c-a01c0fc470b5 service nova] Lock "9d4bc58d-90b6-4621-80a9-0b72194b10da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:06:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-11d837aa-f656-418a-b5a3-9cfa53c1d308 req-eef7896a-fa43-412f-8d0c-a01c0fc470b5 service nova] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] No waiting events found dispatching network-vif-plugged-6b6d1ec0-f24a-4552-8851-861f7494eb49 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:06:56 user nova-compute[75745]: WARNING nova.compute.manager [req-11d837aa-f656-418a-b5a3-9cfa53c1d308 req-eef7896a-fa43-412f-8d0c-a01c0fc470b5 service nova] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Received unexpected event network-vif-plugged-6b6d1ec0-f24a-4552-8851-861f7494eb49 for instance with vm_state active and task_state None.
Dec 01 17:06:56 user nova-compute[75745]: DEBUG nova.network.neutron [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Successfully created port: 9d9f0b3d-a677-4db0-a8be-b19006908125 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:06:56 user nova-compute[75745]: DEBUG nova.network.neutron [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Successfully updated port: d7c02fc7-a4d9-4c86-b18b-cf12d101f22f {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:06:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-8d9eaa83-3ca9-4b8d-80c4-401b2afc47dd req-5d478fe7-5a7c-4434-8983-2f241cd7d3a8 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-changed-d7c02fc7-a4d9-4c86-b18b-cf12d101f22f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:06:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-8d9eaa83-3ca9-4b8d-80c4-401b2afc47dd req-5d478fe7-5a7c-4434-8983-2f241cd7d3a8 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Refreshing instance network info cache due to event network-changed-d7c02fc7-a4d9-4c86-b18b-cf12d101f22f. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:06:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8d9eaa83-3ca9-4b8d-80c4-401b2afc47dd req-5d478fe7-5a7c-4434-8983-2f241cd7d3a8 service nova] Acquiring lock "refresh_cache-1372f3b7-6608-43a9-b1a5-fd7dfbaf303e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:06:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8d9eaa83-3ca9-4b8d-80c4-401b2afc47dd req-5d478fe7-5a7c-4434-8983-2f241cd7d3a8 service nova] Acquired lock "refresh_cache-1372f3b7-6608-43a9-b1a5-fd7dfbaf303e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:06:56 user nova-compute[75745]: DEBUG nova.network.neutron [req-8d9eaa83-3ca9-4b8d-80c4-401b2afc47dd req-5d478fe7-5a7c-4434-8983-2f241cd7d3a8 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Refreshing network info cache for port d7c02fc7-a4d9-4c86-b18b-cf12d101f22f {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:06:56 user nova-compute[75745]: DEBUG nova.network.neutron [req-8d9eaa83-3ca9-4b8d-80c4-401b2afc47dd req-5d478fe7-5a7c-4434-8983-2f241cd7d3a8 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:06:57 user nova-compute[75745]: DEBUG nova.network.neutron [req-8d9eaa83-3ca9-4b8d-80c4-401b2afc47dd req-5d478fe7-5a7c-4434-8983-2f241cd7d3a8 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:06:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8d9eaa83-3ca9-4b8d-80c4-401b2afc47dd req-5d478fe7-5a7c-4434-8983-2f241cd7d3a8 service nova] Releasing lock "refresh_cache-1372f3b7-6608-43a9-b1a5-fd7dfbaf303e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:06:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:57 user nova-compute[75745]: DEBUG nova.network.neutron [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Successfully created port: 754453de-6c68-4cdd-acc4-2307e4b6d3d2 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:06:57 user nova-compute[75745]: DEBUG nova.network.neutron [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Successfully updated port: 4024ab4b-08e5-4f1f-866d-979bb1dee426 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:06:58 user nova-compute[75745]: DEBUG nova.network.neutron [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Successfully created port: 847be9c3-c4d1-4280-8b85-56697d11a876 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:06:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-93af4ac4-ad14-41ea-8997-3fadcb6362a5 req-2e0af4c8-5c12-4235-89a0-2303bf60f422 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-changed-4024ab4b-08e5-4f1f-866d-979bb1dee426 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:06:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-93af4ac4-ad14-41ea-8997-3fadcb6362a5 req-2e0af4c8-5c12-4235-89a0-2303bf60f422 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Refreshing instance network info cache due to event network-changed-4024ab4b-08e5-4f1f-866d-979bb1dee426. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:06:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-93af4ac4-ad14-41ea-8997-3fadcb6362a5 req-2e0af4c8-5c12-4235-89a0-2303bf60f422 service nova] Acquiring lock "refresh_cache-1372f3b7-6608-43a9-b1a5-fd7dfbaf303e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:06:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-93af4ac4-ad14-41ea-8997-3fadcb6362a5 req-2e0af4c8-5c12-4235-89a0-2303bf60f422 service nova] Acquired lock "refresh_cache-1372f3b7-6608-43a9-b1a5-fd7dfbaf303e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:06:58 user nova-compute[75745]: DEBUG nova.network.neutron [req-93af4ac4-ad14-41ea-8997-3fadcb6362a5 req-2e0af4c8-5c12-4235-89a0-2303bf60f422 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Refreshing network info cache for port 4024ab4b-08e5-4f1f-866d-979bb1dee426 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:06:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:06:58 user nova-compute[75745]: DEBUG nova.network.neutron [req-93af4ac4-ad14-41ea-8997-3fadcb6362a5 req-2e0af4c8-5c12-4235-89a0-2303bf60f422 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:06:58 user nova-compute[75745]: DEBUG nova.network.neutron [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Successfully updated port: 6e1b67ad-1619-4e40-906c-df31e0eab904 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:06:59 user nova-compute[75745]: DEBUG nova.network.neutron [req-93af4ac4-ad14-41ea-8997-3fadcb6362a5 req-2e0af4c8-5c12-4235-89a0-2303bf60f422 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:06:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-93af4ac4-ad14-41ea-8997-3fadcb6362a5 req-2e0af4c8-5c12-4235-89a0-2303bf60f422 service nova] Releasing lock "refresh_cache-1372f3b7-6608-43a9-b1a5-fd7dfbaf303e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:06:59 user nova-compute[75745]: DEBUG nova.network.neutron [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Successfully created port: c6812409-296e-40f5-bdfc-b7cedf33f85b {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:07:00 user nova-compute[75745]: DEBUG nova.network.neutron [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Successfully updated port: 92b697c2-8400-4b91-9fd7-53df7f47c4e0 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:07:00 user nova-compute[75745]: DEBUG nova.network.neutron [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Successfully updated port: de0d310c-2bc9-4434-8b2b-253a88febaa0 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:07:00 user nova-compute[75745]: DEBUG nova.compute.manager [req-801ec36b-fc06-4815-9d88-dc7706058c96 req-f9e03d24-9c8e-47d5-a3b6-78cbb3134f29 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-changed-6e1b67ad-1619-4e40-906c-df31e0eab904 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:00 user nova-compute[75745]: DEBUG nova.compute.manager [req-801ec36b-fc06-4815-9d88-dc7706058c96 req-f9e03d24-9c8e-47d5-a3b6-78cbb3134f29 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Refreshing instance network info cache due to event network-changed-6e1b67ad-1619-4e40-906c-df31e0eab904. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:07:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-801ec36b-fc06-4815-9d88-dc7706058c96 req-f9e03d24-9c8e-47d5-a3b6-78cbb3134f29 service nova] Acquiring lock "refresh_cache-1372f3b7-6608-43a9-b1a5-fd7dfbaf303e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:07:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-801ec36b-fc06-4815-9d88-dc7706058c96 req-f9e03d24-9c8e-47d5-a3b6-78cbb3134f29 service nova] Acquired lock "refresh_cache-1372f3b7-6608-43a9-b1a5-fd7dfbaf303e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:07:00 user nova-compute[75745]: DEBUG nova.network.neutron [req-801ec36b-fc06-4815-9d88-dc7706058c96 req-f9e03d24-9c8e-47d5-a3b6-78cbb3134f29 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Refreshing network info cache for port 6e1b67ad-1619-4e40-906c-df31e0eab904 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:07:00 user nova-compute[75745]: DEBUG nova.network.neutron [req-801ec36b-fc06-4815-9d88-dc7706058c96 req-f9e03d24-9c8e-47d5-a3b6-78cbb3134f29 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:07:01 user nova-compute[75745]: DEBUG nova.network.neutron [req-801ec36b-fc06-4815-9d88-dc7706058c96 req-f9e03d24-9c8e-47d5-a3b6-78cbb3134f29 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:07:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-801ec36b-fc06-4815-9d88-dc7706058c96 req-f9e03d24-9c8e-47d5-a3b6-78cbb3134f29 service nova] Releasing lock "refresh_cache-1372f3b7-6608-43a9-b1a5-fd7dfbaf303e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:07:01 user nova-compute[75745]: DEBUG nova.compute.manager [req-801ec36b-fc06-4815-9d88-dc7706058c96 req-f9e03d24-9c8e-47d5-a3b6-78cbb3134f29 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-changed-92b697c2-8400-4b91-9fd7-53df7f47c4e0 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:01 user nova-compute[75745]: DEBUG nova.compute.manager [req-801ec36b-fc06-4815-9d88-dc7706058c96 req-f9e03d24-9c8e-47d5-a3b6-78cbb3134f29 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Refreshing instance network info cache due to event network-changed-92b697c2-8400-4b91-9fd7-53df7f47c4e0. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:07:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-801ec36b-fc06-4815-9d88-dc7706058c96 req-f9e03d24-9c8e-47d5-a3b6-78cbb3134f29 service nova] Acquiring lock "refresh_cache-1372f3b7-6608-43a9-b1a5-fd7dfbaf303e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:07:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-801ec36b-fc06-4815-9d88-dc7706058c96 req-f9e03d24-9c8e-47d5-a3b6-78cbb3134f29 service nova] Acquired lock "refresh_cache-1372f3b7-6608-43a9-b1a5-fd7dfbaf303e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:07:01 user nova-compute[75745]: DEBUG nova.network.neutron [req-801ec36b-fc06-4815-9d88-dc7706058c96 req-f9e03d24-9c8e-47d5-a3b6-78cbb3134f29 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Refreshing network info cache for port 92b697c2-8400-4b91-9fd7-53df7f47c4e0 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:07:01 user nova-compute[75745]: DEBUG nova.network.neutron [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Successfully updated port: 9f79cb7e-7ef6-4e1a-a241-780713de2217 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:07:01 user nova-compute[75745]: DEBUG nova.network.neutron [req-801ec36b-fc06-4815-9d88-dc7706058c96 req-f9e03d24-9c8e-47d5-a3b6-78cbb3134f29 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:07:01 user nova-compute[75745]: DEBUG nova.network.neutron [req-801ec36b-fc06-4815-9d88-dc7706058c96 req-f9e03d24-9c8e-47d5-a3b6-78cbb3134f29 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:07:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-801ec36b-fc06-4815-9d88-dc7706058c96 req-f9e03d24-9c8e-47d5-a3b6-78cbb3134f29 service nova] Releasing lock "refresh_cache-1372f3b7-6608-43a9-b1a5-fd7dfbaf303e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:07:01 user nova-compute[75745]: DEBUG nova.compute.manager [req-801ec36b-fc06-4815-9d88-dc7706058c96 req-f9e03d24-9c8e-47d5-a3b6-78cbb3134f29 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-changed-de0d310c-2bc9-4434-8b2b-253a88febaa0 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:01 user nova-compute[75745]: DEBUG nova.compute.manager [req-801ec36b-fc06-4815-9d88-dc7706058c96 req-f9e03d24-9c8e-47d5-a3b6-78cbb3134f29 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Refreshing instance network info cache due to event network-changed-de0d310c-2bc9-4434-8b2b-253a88febaa0. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:07:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-801ec36b-fc06-4815-9d88-dc7706058c96 req-f9e03d24-9c8e-47d5-a3b6-78cbb3134f29 service nova] Acquiring lock "refresh_cache-5c6c7551-7045-4129-9908-c0c6fbd93124" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:07:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-801ec36b-fc06-4815-9d88-dc7706058c96 req-f9e03d24-9c8e-47d5-a3b6-78cbb3134f29 service nova] Acquired lock "refresh_cache-5c6c7551-7045-4129-9908-c0c6fbd93124" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:07:01 user nova-compute[75745]: DEBUG nova.network.neutron [req-801ec36b-fc06-4815-9d88-dc7706058c96 req-f9e03d24-9c8e-47d5-a3b6-78cbb3134f29 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Refreshing network info cache for port de0d310c-2bc9-4434-8b2b-253a88febaa0 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:07:01 user nova-compute[75745]: DEBUG nova.network.neutron [req-801ec36b-fc06-4815-9d88-dc7706058c96 req-f9e03d24-9c8e-47d5-a3b6-78cbb3134f29 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:07:01 user nova-compute[75745]: DEBUG nova.network.neutron [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Successfully updated port: a5ecb053-fd41-42ea-8abe-4c504b6c7882 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:07:01 user nova-compute[75745]: DEBUG nova.network.neutron [req-801ec36b-fc06-4815-9d88-dc7706058c96 req-f9e03d24-9c8e-47d5-a3b6-78cbb3134f29 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:07:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-801ec36b-fc06-4815-9d88-dc7706058c96 req-f9e03d24-9c8e-47d5-a3b6-78cbb3134f29 service nova] Releasing lock "refresh_cache-5c6c7551-7045-4129-9908-c0c6fbd93124" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:07:02 user nova-compute[75745]: DEBUG nova.network.neutron [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Successfully updated port: 4b6cfe1f-9722-41e1-9679-52398359a035 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:07:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:02 user nova-compute[75745]: DEBUG nova.network.neutron [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Successfully updated port: 4bc79fe9-e1e7-4040-ae00-e231301a8c58 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:07:02 user nova-compute[75745]: DEBUG nova.compute.manager [req-dfb62625-8b4c-4e8d-94e8-7be5577c7c44 req-55fe3f4a-b4f2-4221-8f39-e757538a1ec8 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-changed-4bc79fe9-e1e7-4040-ae00-e231301a8c58 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:02 user nova-compute[75745]: DEBUG nova.compute.manager [req-dfb62625-8b4c-4e8d-94e8-7be5577c7c44 req-55fe3f4a-b4f2-4221-8f39-e757538a1ec8 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Refreshing instance network info cache due to event network-changed-4bc79fe9-e1e7-4040-ae00-e231301a8c58. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:07:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-dfb62625-8b4c-4e8d-94e8-7be5577c7c44 req-55fe3f4a-b4f2-4221-8f39-e757538a1ec8 service nova] Acquiring lock "refresh_cache-5c6c7551-7045-4129-9908-c0c6fbd93124" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:07:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-dfb62625-8b4c-4e8d-94e8-7be5577c7c44 req-55fe3f4a-b4f2-4221-8f39-e757538a1ec8 service nova] Acquired lock "refresh_cache-5c6c7551-7045-4129-9908-c0c6fbd93124" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:07:02 user nova-compute[75745]: DEBUG nova.network.neutron [req-dfb62625-8b4c-4e8d-94e8-7be5577c7c44 req-55fe3f4a-b4f2-4221-8f39-e757538a1ec8 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Refreshing network info cache for port 4bc79fe9-e1e7-4040-ae00-e231301a8c58 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:07:02 user nova-compute[75745]: DEBUG nova.network.neutron [req-dfb62625-8b4c-4e8d-94e8-7be5577c7c44 req-55fe3f4a-b4f2-4221-8f39-e757538a1ec8 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:07:02 user nova-compute[75745]: DEBUG nova.compute.manager [req-e4f9b1c5-d7fb-4ed2-8573-71b262300d85 req-5ab675d8-6657-438f-a150-ae4b6f27d767 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-changed-9f79cb7e-7ef6-4e1a-a241-780713de2217 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:02 user nova-compute[75745]: DEBUG nova.compute.manager [req-e4f9b1c5-d7fb-4ed2-8573-71b262300d85 req-5ab675d8-6657-438f-a150-ae4b6f27d767 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Refreshing instance network info cache due to event network-changed-9f79cb7e-7ef6-4e1a-a241-780713de2217. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:07:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e4f9b1c5-d7fb-4ed2-8573-71b262300d85 req-5ab675d8-6657-438f-a150-ae4b6f27d767 service nova] Acquiring lock "refresh_cache-1372f3b7-6608-43a9-b1a5-fd7dfbaf303e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:07:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e4f9b1c5-d7fb-4ed2-8573-71b262300d85 req-5ab675d8-6657-438f-a150-ae4b6f27d767 service nova] Acquired lock "refresh_cache-1372f3b7-6608-43a9-b1a5-fd7dfbaf303e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:07:02 user nova-compute[75745]: DEBUG nova.network.neutron [req-e4f9b1c5-d7fb-4ed2-8573-71b262300d85 req-5ab675d8-6657-438f-a150-ae4b6f27d767 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Refreshing network info cache for port 9f79cb7e-7ef6-4e1a-a241-780713de2217 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:07:02 user nova-compute[75745]: DEBUG nova.network.neutron [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Successfully updated port: f2f8e363-9e49-43ae-b61b-7ff8893c9f8f {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:07:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Acquiring lock "refresh_cache-1372f3b7-6608-43a9-b1a5-fd7dfbaf303e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:07:02 user nova-compute[75745]: DEBUG nova.network.neutron [req-e4f9b1c5-d7fb-4ed2-8573-71b262300d85 req-5ab675d8-6657-438f-a150-ae4b6f27d767 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:07:02 user nova-compute[75745]: DEBUG nova.network.neutron [req-dfb62625-8b4c-4e8d-94e8-7be5577c7c44 req-55fe3f4a-b4f2-4221-8f39-e757538a1ec8 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-dfb62625-8b4c-4e8d-94e8-7be5577c7c44 req-55fe3f4a-b4f2-4221-8f39-e757538a1ec8 service nova] Releasing lock "refresh_cache-5c6c7551-7045-4129-9908-c0c6fbd93124" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG nova.network.neutron [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Successfully updated port: 9d9f0b3d-a677-4db0-a8be-b19006908125 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:07:03 user nova-compute[75745]: INFO nova.virt.block_device [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Booting with volume 8751e4f8-9d97-4f54-a375-bd0f45e3862e at /dev/vdb
Dec 01 17:07:03 user nova-compute[75745]: DEBUG os_brick.utils [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a2aecb-74a5-46b4-91c2-fa47729414a5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[af812786-d69d-44de-8927-36ee86df5d29]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[020bfae4-3156-462b-bac3-69b690bd75f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb9502f-3551-454a-ac23-5891cd181240]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG nova.network.neutron [req-e4f9b1c5-d7fb-4ed2-8573-71b262300d85 req-5ab675d8-6657-438f-a150-ae4b6f27d767 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e4f9b1c5-d7fb-4ed2-8573-71b262300d85 req-5ab675d8-6657-438f-a150-ae4b6f27d767 service nova] Releasing lock "refresh_cache-1372f3b7-6608-43a9-b1a5-fd7dfbaf303e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG nova.compute.manager [req-e4f9b1c5-d7fb-4ed2-8573-71b262300d85 req-5ab675d8-6657-438f-a150-ae4b6f27d767 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-changed-a5ecb053-fd41-42ea-8abe-4c504b6c7882 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG nova.compute.manager [req-e4f9b1c5-d7fb-4ed2-8573-71b262300d85 req-5ab675d8-6657-438f-a150-ae4b6f27d767 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Refreshing instance network info cache due to event network-changed-a5ecb053-fd41-42ea-8abe-4c504b6c7882. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e4f9b1c5-d7fb-4ed2-8573-71b262300d85 req-5ab675d8-6657-438f-a150-ae4b6f27d767 service nova] Acquiring lock "refresh_cache-5c6c7551-7045-4129-9908-c0c6fbd93124" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e4f9b1c5-d7fb-4ed2-8573-71b262300d85 req-5ab675d8-6657-438f-a150-ae4b6f27d767 service nova] Acquired lock "refresh_cache-5c6c7551-7045-4129-9908-c0c6fbd93124" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG nova.network.neutron [req-e4f9b1c5-d7fb-4ed2-8573-71b262300d85 req-5ab675d8-6657-438f-a150-ae4b6f27d767 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Refreshing network info cache for port a5ecb053-fd41-42ea-8abe-4c504b6c7882 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:07:03 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:07:03 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f868ef6e-c46c-435b-870f-3fa4d6c98474]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Acquired lock "refresh_cache-1372f3b7-6608-43a9-b1a5-fd7dfbaf303e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG nova.network.neutron [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG os_brick.utils [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Updating existing volume attachment record: e9a31f68-d57e-4f59-b90a-5f4860e11b41 {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG nova.network.neutron [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Successfully updated port: 754453de-6c68-4cdd-acc4-2307e4b6d3d2 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG nova.network.neutron [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG nova.network.neutron [req-e4f9b1c5-d7fb-4ed2-8573-71b262300d85 req-5ab675d8-6657-438f-a150-ae4b6f27d767 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG nova.network.neutron [req-e4f9b1c5-d7fb-4ed2-8573-71b262300d85 req-5ab675d8-6657-438f-a150-ae4b6f27d767 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e4f9b1c5-d7fb-4ed2-8573-71b262300d85 req-5ab675d8-6657-438f-a150-ae4b6f27d767 service nova] Releasing lock "refresh_cache-5c6c7551-7045-4129-9908-c0c6fbd93124" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG nova.compute.manager [req-e4f9b1c5-d7fb-4ed2-8573-71b262300d85 req-5ab675d8-6657-438f-a150-ae4b6f27d767 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-changed-4b6cfe1f-9722-41e1-9679-52398359a035 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG nova.compute.manager [req-e4f9b1c5-d7fb-4ed2-8573-71b262300d85 req-5ab675d8-6657-438f-a150-ae4b6f27d767 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Refreshing instance network info cache due to event network-changed-4b6cfe1f-9722-41e1-9679-52398359a035. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:07:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e4f9b1c5-d7fb-4ed2-8573-71b262300d85 req-5ab675d8-6657-438f-a150-ae4b6f27d767 service nova] Acquiring lock "refresh_cache-1372f3b7-6608-43a9-b1a5-fd7dfbaf303e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG nova.network.neutron [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Successfully updated port: 847be9c3-c4d1-4280-8b85-56697d11a876 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG nova.compute.manager [req-ba1bf88a-e7ba-42ea-9d89-1ca646e1eb16 req-b30a5589-e1f0-4c5d-8d62-9e5fd5b422e0 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-changed-9d9f0b3d-a677-4db0-a8be-b19006908125 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG nova.compute.manager [req-ba1bf88a-e7ba-42ea-9d89-1ca646e1eb16 req-b30a5589-e1f0-4c5d-8d62-9e5fd5b422e0 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Refreshing instance network info cache due to event network-changed-9d9f0b3d-a677-4db0-a8be-b19006908125. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ba1bf88a-e7ba-42ea-9d89-1ca646e1eb16 req-b30a5589-e1f0-4c5d-8d62-9e5fd5b422e0 service nova] Acquiring lock "refresh_cache-5c6c7551-7045-4129-9908-c0c6fbd93124" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ba1bf88a-e7ba-42ea-9d89-1ca646e1eb16 req-b30a5589-e1f0-4c5d-8d62-9e5fd5b422e0 service nova] Acquired lock "refresh_cache-5c6c7551-7045-4129-9908-c0c6fbd93124" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG nova.network.neutron [req-ba1bf88a-e7ba-42ea-9d89-1ca646e1eb16 req-b30a5589-e1f0-4c5d-8d62-9e5fd5b422e0 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Refreshing network info cache for port 9d9f0b3d-a677-4db0-a8be-b19006908125 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:07:04 user nova-compute[75745]: INFO nova.virt.block_device [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Booting with volume beb5e348-2521-40cf-99fe-4bf8f351e749 at /dev/vdb
Dec 01 17:07:04 user nova-compute[75745]: DEBUG os_brick.utils [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[83726d87-4994-4561-9cfc-a9de91a9cb94]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[59155979-ffd2-4462-b88e-690dcf14bdb8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c32d8a-751c-4879-9f98-13ffa3924ae6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[09863161-8584-4afd-995d-84b662fe6540]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG nova.network.neutron [req-ba1bf88a-e7ba-42ea-9d89-1ca646e1eb16 req-b30a5589-e1f0-4c5d-8d62-9e5fd5b422e0 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:07:04 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:07:04 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[91235add-787e-4fc8-9351-59e87171cdeb]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG os_brick.utils [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Updating existing volume attachment record: a3b0d016-0f13-48c8-890b-edcada193236 {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG nova.compute.manager [req-c859bb30-e3dc-4361-a899-c53b82d89a28 req-273c1750-ce14-4e10-918e-2edb259e95de service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-changed-f2f8e363-9e49-43ae-b61b-7ff8893c9f8f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG nova.compute.manager [req-c859bb30-e3dc-4361-a899-c53b82d89a28 req-273c1750-ce14-4e10-918e-2edb259e95de service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Refreshing instance network info cache due to event network-changed-f2f8e363-9e49-43ae-b61b-7ff8893c9f8f. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c859bb30-e3dc-4361-a899-c53b82d89a28 req-273c1750-ce14-4e10-918e-2edb259e95de service nova] Acquiring lock "refresh_cache-1372f3b7-6608-43a9-b1a5-fd7dfbaf303e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG nova.network.neutron [req-ba1bf88a-e7ba-42ea-9d89-1ca646e1eb16 req-b30a5589-e1f0-4c5d-8d62-9e5fd5b422e0 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ba1bf88a-e7ba-42ea-9d89-1ca646e1eb16 req-b30a5589-e1f0-4c5d-8d62-9e5fd5b422e0 service nova] Releasing lock "refresh_cache-5c6c7551-7045-4129-9908-c0c6fbd93124" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG nova.compute.manager [req-ba1bf88a-e7ba-42ea-9d89-1ca646e1eb16 req-b30a5589-e1f0-4c5d-8d62-9e5fd5b422e0 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-changed-754453de-6c68-4cdd-acc4-2307e4b6d3d2 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG nova.compute.manager [req-ba1bf88a-e7ba-42ea-9d89-1ca646e1eb16 req-b30a5589-e1f0-4c5d-8d62-9e5fd5b422e0 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Refreshing instance network info cache due to event network-changed-754453de-6c68-4cdd-acc4-2307e4b6d3d2. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ba1bf88a-e7ba-42ea-9d89-1ca646e1eb16 req-b30a5589-e1f0-4c5d-8d62-9e5fd5b422e0 service nova] Acquiring lock "refresh_cache-5c6c7551-7045-4129-9908-c0c6fbd93124" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ba1bf88a-e7ba-42ea-9d89-1ca646e1eb16 req-b30a5589-e1f0-4c5d-8d62-9e5fd5b422e0 service nova] Acquired lock "refresh_cache-5c6c7551-7045-4129-9908-c0c6fbd93124" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:07:04 user nova-compute[75745]: DEBUG nova.network.neutron [req-ba1bf88a-e7ba-42ea-9d89-1ca646e1eb16 req-b30a5589-e1f0-4c5d-8d62-9e5fd5b422e0 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Refreshing network info cache for port 754453de-6c68-4cdd-acc4-2307e4b6d3d2 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:07:05 user nova-compute[75745]: DEBUG nova.network.neutron [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Successfully updated port: c6812409-296e-40f5-bdfc-b7cedf33f85b {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:07:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Acquiring lock "refresh_cache-5c6c7551-7045-4129-9908-c0c6fbd93124" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:07:05 user nova-compute[75745]: DEBUG nova.network.neutron [req-ba1bf88a-e7ba-42ea-9d89-1ca646e1eb16 req-b30a5589-e1f0-4c5d-8d62-9e5fd5b422e0 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:07:05 user nova-compute[75745]: DEBUG nova.network.neutron [req-ba1bf88a-e7ba-42ea-9d89-1ca646e1eb16 req-b30a5589-e1f0-4c5d-8d62-9e5fd5b422e0 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:07:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ba1bf88a-e7ba-42ea-9d89-1ca646e1eb16 req-b30a5589-e1f0-4c5d-8d62-9e5fd5b422e0 service nova] Releasing lock "refresh_cache-5c6c7551-7045-4129-9908-c0c6fbd93124" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:07:05 user nova-compute[75745]: DEBUG nova.compute.manager [req-ba1bf88a-e7ba-42ea-9d89-1ca646e1eb16 req-b30a5589-e1f0-4c5d-8d62-9e5fd5b422e0 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-changed-847be9c3-c4d1-4280-8b85-56697d11a876 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:05 user nova-compute[75745]: DEBUG nova.compute.manager [req-ba1bf88a-e7ba-42ea-9d89-1ca646e1eb16 req-b30a5589-e1f0-4c5d-8d62-9e5fd5b422e0 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Refreshing instance network info cache due to event network-changed-847be9c3-c4d1-4280-8b85-56697d11a876. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:07:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ba1bf88a-e7ba-42ea-9d89-1ca646e1eb16 req-b30a5589-e1f0-4c5d-8d62-9e5fd5b422e0 service nova] Acquiring lock "refresh_cache-5c6c7551-7045-4129-9908-c0c6fbd93124" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:07:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ba1bf88a-e7ba-42ea-9d89-1ca646e1eb16 req-b30a5589-e1f0-4c5d-8d62-9e5fd5b422e0 service nova] Acquired lock "refresh_cache-5c6c7551-7045-4129-9908-c0c6fbd93124" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:07:05 user nova-compute[75745]: DEBUG nova.network.neutron [req-ba1bf88a-e7ba-42ea-9d89-1ca646e1eb16 req-b30a5589-e1f0-4c5d-8d62-9e5fd5b422e0 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Refreshing network info cache for port 847be9c3-c4d1-4280-8b85-56697d11a876 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:07:05 user nova-compute[75745]: DEBUG nova.network.neutron [req-ba1bf88a-e7ba-42ea-9d89-1ca646e1eb16 req-b30a5589-e1f0-4c5d-8d62-9e5fd5b422e0 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:07:05 user nova-compute[75745]: DEBUG nova.network.neutron [req-ba1bf88a-e7ba-42ea-9d89-1ca646e1eb16 req-b30a5589-e1f0-4c5d-8d62-9e5fd5b422e0 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:07:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ba1bf88a-e7ba-42ea-9d89-1ca646e1eb16 req-b30a5589-e1f0-4c5d-8d62-9e5fd5b422e0 service nova] Releasing lock "refresh_cache-5c6c7551-7045-4129-9908-c0c6fbd93124" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:07:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Acquired lock "refresh_cache-5c6c7551-7045-4129-9908-c0c6fbd93124" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:07:05 user nova-compute[75745]: DEBUG nova.network.neutron [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:07:05 user nova-compute[75745]: DEBUG nova.network.neutron [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:07:05 user nova-compute[75745]: DEBUG nova.network.neutron [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Updating instance_info_cache with network_info: [{"id": "d7c02fc7-a4d9-4c86-b18b-cf12d101f22f", "address": "fa:16:3e:09:96:2e", "network": {"id": "b1af6a14-56fa-4052-8593-93b13dc6a9a1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1377780155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7c02fc7-a4", "ovs_interfaceid": "d7c02fc7-a4d9-4c86-b18b-cf12d101f22f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4024ab4b-08e5-4f1f-866d-979bb1dee426", "address": "fa:16:3e:bc:fa:09", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4024ab4b-08", "ovs_interfaceid": "4024ab4b-08e5-4f1f-866d-979bb1dee426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6e1b67ad-1619-4e40-906c-df31e0eab904", "address": "fa:16:3e:a7:3f:00", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e1b67ad-16", "ovs_interfaceid": "6e1b67ad-1619-4e40-906c-df31e0eab904", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "92b697c2-8400-4b91-9fd7-53df7f47c4e0", "address": "fa:16:3e:95:8f:8d", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b697c2-84", "ovs_interfaceid": "92b697c2-8400-4b91-9fd7-53df7f47c4e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f79cb7e-7ef6-4e1a-a241-780713de2217", "address": "fa:16:3e:ef:c2:b4", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f79cb7e-7e", "ovs_interfaceid": "9f79cb7e-7ef6-4e1a-a241-780713de2217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b6cfe1f-9722-41e1-9679-52398359a035", "address": "fa:16:3e:7c:30:af", "network": {"id": "32d435b7-174b-4e6c-9165-315876fea12a", "bridge": "br-int", "label": "tempest-device-tagging-net2-658876998", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6cfe1f-97", "ovs_interfaceid": "4b6cfe1f-9722-41e1-9679-52398359a035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2f8e363-9e49-43ae-b61b-7ff8893c9f8f", "address": "fa:16:3e:20:41:d6", "network": {"id": "32d435b7-174b-4e6c-9165-315876fea12a", "bridge": "br-int", "label": "tempest-device-tagging-net2-658876998", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f8e363-9e", "ovs_interfaceid": "f2f8e363-9e49-43ae-b61b-7ff8893c9f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:07:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Releasing lock "refresh_cache-1372f3b7-6608-43a9-b1a5-fd7dfbaf303e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:07:05 user nova-compute[75745]: DEBUG nova.compute.manager [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Instance network_info: |[{"id": "d7c02fc7-a4d9-4c86-b18b-cf12d101f22f", "address": "fa:16:3e:09:96:2e", "network": {"id": "b1af6a14-56fa-4052-8593-93b13dc6a9a1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1377780155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7c02fc7-a4", "ovs_interfaceid": "d7c02fc7-a4d9-4c86-b18b-cf12d101f22f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4024ab4b-08e5-4f1f-866d-979bb1dee426", "address": "fa:16:3e:bc:fa:09", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4024ab4b-08", "ovs_interfaceid": "4024ab4b-08e5-4f1f-866d-979bb1dee426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6e1b67ad-1619-4e40-906c-df31e0eab904", "address": "fa:16:3e:a7:3f:00", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e1b67ad-16", "ovs_interfaceid": "6e1b67ad-1619-4e40-906c-df31e0eab904", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "92b697c2-8400-4b91-9fd7-53df7f47c4e0", "address": "fa:16:3e:95:8f:8d", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b697c2-84", "ovs_interfaceid": "92b697c2-8400-4b91-9fd7-53df7f47c4e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f79cb7e-7ef6-4e1a-a241-780713de2217", "address": "fa:16:3e:ef:c2:b4", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f79cb7e-7e", "ovs_interfaceid": "9f79cb7e-7ef6-4e1a-a241-780713de2217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b6cfe1f-9722-41e1-9679-52398359a035", "address": "fa:16:3e:7c:30:af", "network": {"id": "32d435b7-174b-4e6c-9165-315876fea12a", "bridge": "br-int", "label": "tempest-device-tagging-net2-658876998", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6cfe1f-97", "ovs_interfaceid": "4b6cfe1f-9722-41e1-9679-52398359a035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2f8e363-9e49-43ae-b61b-7ff8893c9f8f", "address": "fa:16:3e:20:41:d6", "network": {"id": "32d435b7-174b-4e6c-9165-315876fea12a", "bridge": "br-int", "label": "tempest-device-tagging-net2-658876998", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f8e363-9e", "ovs_interfaceid": "f2f8e363-9e49-43ae-b61b-7ff8893c9f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:07:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e4f9b1c5-d7fb-4ed2-8573-71b262300d85 req-5ab675d8-6657-438f-a150-ae4b6f27d767 service nova] Acquired lock "refresh_cache-1372f3b7-6608-43a9-b1a5-fd7dfbaf303e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:07:05 user nova-compute[75745]: DEBUG nova.network.neutron [req-e4f9b1c5-d7fb-4ed2-8573-71b262300d85 req-5ab675d8-6657-438f-a150-ae4b6f27d767 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Refreshing network info cache for port 4b6cfe1f-9722-41e1-9679-52398359a035 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:07:06 user nova-compute[75745]: DEBUG nova.network.neutron [req-e4f9b1c5-d7fb-4ed2-8573-71b262300d85 req-5ab675d8-6657-438f-a150-ae4b6f27d767 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Updated VIF entry in instance network info cache for port 4b6cfe1f-9722-41e1-9679-52398359a035. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:07:06 user nova-compute[75745]: DEBUG nova.network.neutron [req-e4f9b1c5-d7fb-4ed2-8573-71b262300d85 req-5ab675d8-6657-438f-a150-ae4b6f27d767 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Updating instance_info_cache with network_info: [{"id": "d7c02fc7-a4d9-4c86-b18b-cf12d101f22f", "address": "fa:16:3e:09:96:2e", "network": {"id": "b1af6a14-56fa-4052-8593-93b13dc6a9a1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1377780155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7c02fc7-a4", "ovs_interfaceid": "d7c02fc7-a4d9-4c86-b18b-cf12d101f22f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4024ab4b-08e5-4f1f-866d-979bb1dee426", "address": "fa:16:3e:bc:fa:09", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4024ab4b-08", "ovs_interfaceid": "4024ab4b-08e5-4f1f-866d-979bb1dee426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6e1b67ad-1619-4e40-906c-df31e0eab904", "address": "fa:16:3e:a7:3f:00", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e1b67ad-16", "ovs_interfaceid": "6e1b67ad-1619-4e40-906c-df31e0eab904", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "92b697c2-8400-4b91-9fd7-53df7f47c4e0", "address": "fa:16:3e:95:8f:8d", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b697c2-84", "ovs_interfaceid": "92b697c2-8400-4b91-9fd7-53df7f47c4e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f79cb7e-7ef6-4e1a-a241-780713de2217", "address": "fa:16:3e:ef:c2:b4", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f79cb7e-7e", "ovs_interfaceid": "9f79cb7e-7ef6-4e1a-a241-780713de2217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b6cfe1f-9722-41e1-9679-52398359a035", "address": "fa:16:3e:7c:30:af", "network": {"id": "32d435b7-174b-4e6c-9165-315876fea12a", "bridge": "br-int", "label": "tempest-device-tagging-net2-658876998", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6cfe1f-97", "ovs_interfaceid": "4b6cfe1f-9722-41e1-9679-52398359a035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2f8e363-9e49-43ae-b61b-7ff8893c9f8f", "address": "fa:16:3e:20:41:d6", "network": {"id": "32d435b7-174b-4e6c-9165-315876fea12a", "bridge": "br-int", "label": "tempest-device-tagging-net2-658876998", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f8e363-9e", "ovs_interfaceid": "f2f8e363-9e49-43ae-b61b-7ff8893c9f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:07:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e4f9b1c5-d7fb-4ed2-8573-71b262300d85 req-5ab675d8-6657-438f-a150-ae4b6f27d767 service nova] Releasing lock "refresh_cache-1372f3b7-6608-43a9-b1a5-fd7dfbaf303e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:07:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c859bb30-e3dc-4361-a899-c53b82d89a28 req-273c1750-ce14-4e10-918e-2edb259e95de service nova] Acquired lock "refresh_cache-1372f3b7-6608-43a9-b1a5-fd7dfbaf303e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:07:06 user nova-compute[75745]: DEBUG nova.network.neutron [req-c859bb30-e3dc-4361-a899-c53b82d89a28 req-273c1750-ce14-4e10-918e-2edb259e95de service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Refreshing network info cache for port f2f8e363-9e49-43ae-b61b-7ff8893c9f8f {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:07:06 user nova-compute[75745]: DEBUG nova.compute.manager [req-596fcd30-06b1-4abb-abe2-349e328aad12 req-cc1cab8a-0da8-44e7-9e3c-e5a5f77b2e3d service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-changed-c6812409-296e-40f5-bdfc-b7cedf33f85b {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:06 user nova-compute[75745]: DEBUG nova.compute.manager [req-596fcd30-06b1-4abb-abe2-349e328aad12 req-cc1cab8a-0da8-44e7-9e3c-e5a5f77b2e3d service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Refreshing instance network info cache due to event network-changed-c6812409-296e-40f5-bdfc-b7cedf33f85b. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:07:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-596fcd30-06b1-4abb-abe2-349e328aad12 req-cc1cab8a-0da8-44e7-9e3c-e5a5f77b2e3d service nova] Acquiring lock "refresh_cache-5c6c7551-7045-4129-9908-c0c6fbd93124" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:07:06 user nova-compute[75745]: DEBUG nova.network.neutron [req-c859bb30-e3dc-4361-a899-c53b82d89a28 req-273c1750-ce14-4e10-918e-2edb259e95de service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Updated VIF entry in instance network info cache for port f2f8e363-9e49-43ae-b61b-7ff8893c9f8f. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:07:06 user nova-compute[75745]: DEBUG nova.network.neutron [req-c859bb30-e3dc-4361-a899-c53b82d89a28 req-273c1750-ce14-4e10-918e-2edb259e95de service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Updating instance_info_cache with network_info: [{"id": "d7c02fc7-a4d9-4c86-b18b-cf12d101f22f", "address": "fa:16:3e:09:96:2e", "network": {"id": "b1af6a14-56fa-4052-8593-93b13dc6a9a1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1377780155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7c02fc7-a4", "ovs_interfaceid": "d7c02fc7-a4d9-4c86-b18b-cf12d101f22f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4024ab4b-08e5-4f1f-866d-979bb1dee426", "address": "fa:16:3e:bc:fa:09", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4024ab4b-08", "ovs_interfaceid": "4024ab4b-08e5-4f1f-866d-979bb1dee426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6e1b67ad-1619-4e40-906c-df31e0eab904", "address": "fa:16:3e:a7:3f:00", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e1b67ad-16", "ovs_interfaceid": "6e1b67ad-1619-4e40-906c-df31e0eab904", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "92b697c2-8400-4b91-9fd7-53df7f47c4e0", "address": "fa:16:3e:95:8f:8d", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b697c2-84", "ovs_interfaceid": "92b697c2-8400-4b91-9fd7-53df7f47c4e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f79cb7e-7ef6-4e1a-a241-780713de2217", "address": "fa:16:3e:ef:c2:b4", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f79cb7e-7e", "ovs_interfaceid": "9f79cb7e-7ef6-4e1a-a241-780713de2217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b6cfe1f-9722-41e1-9679-52398359a035", "address": "fa:16:3e:7c:30:af", "network": {"id": "32d435b7-174b-4e6c-9165-315876fea12a", "bridge": "br-int", "label": "tempest-device-tagging-net2-658876998", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6cfe1f-97", "ovs_interfaceid": "4b6cfe1f-9722-41e1-9679-52398359a035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2f8e363-9e49-43ae-b61b-7ff8893c9f8f", "address": "fa:16:3e:20:41:d6", "network": {"id": "32d435b7-174b-4e6c-9165-315876fea12a", "bridge": "br-int", "label": "tempest-device-tagging-net2-658876998", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f8e363-9e", "ovs_interfaceid": "f2f8e363-9e49-43ae-b61b-7ff8893c9f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:07:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c859bb30-e3dc-4361-a899-c53b82d89a28 req-273c1750-ce14-4e10-918e-2edb259e95de service nova] Releasing lock "refresh_cache-1372f3b7-6608-43a9-b1a5-fd7dfbaf303e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:07:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:07 user nova-compute[75745]: DEBUG nova.network.neutron [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Updating instance_info_cache with network_info: [{"id": "de0d310c-2bc9-4434-8b2b-253a88febaa0", "address": "fa:16:3e:3f:e1:39", "network": {"id": "8d239238-e90b-4408-86f0-a143eb9ac337", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1071206325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0d310c-2b", "ovs_interfaceid": "de0d310c-2bc9-4434-8b2b-253a88febaa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5ecb053-fd41-42ea-8abe-4c504b6c7882", "address": "fa:16:3e:56:bb:b9", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5ecb053-fd", "ovs_interfaceid": "a5ecb053-fd41-42ea-8abe-4c504b6c7882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4bc79fe9-e1e7-4040-ae00-e231301a8c58", "address": "fa:16:3e:b8:6d:f8", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc79fe9-e1", "ovs_interfaceid": "4bc79fe9-e1e7-4040-ae00-e231301a8c58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9d9f0b3d-a677-4db0-a8be-b19006908125", "address": "fa:16:3e:d2:26:2b", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d9f0b3d-a6", "ovs_interfaceid": "9d9f0b3d-a677-4db0-a8be-b19006908125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "754453de-6c68-4cdd-acc4-2307e4b6d3d2", "address": "fa:16:3e:e2:b2:aa", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap754453de-6c", "ovs_interfaceid": "754453de-6c68-4cdd-acc4-2307e4b6d3d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "847be9c3-c4d1-4280-8b85-56697d11a876", "address": "fa:16:3e:67:52:ab", "network": {"id": "2a7db2ed-f938-42c6-b85c-8a94ac2717a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-811431562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap847be9c3-c4", "ovs_interfaceid": "847be9c3-c4d1-4280-8b85-56697d11a876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6812409-296e-40f5-bdfc-b7cedf33f85b", "address": "fa:16:3e:db:bf:df", "network": {"id": "2a7db2ed-f938-42c6-b85c-8a94ac2717a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-811431562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6812409-29", "ovs_interfaceid": "c6812409-296e-40f5-bdfc-b7cedf33f85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:07:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Releasing lock "refresh_cache-5c6c7551-7045-4129-9908-c0c6fbd93124" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:07:07 user nova-compute[75745]: DEBUG nova.compute.manager [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Instance network_info: |[{"id": "de0d310c-2bc9-4434-8b2b-253a88febaa0", "address": "fa:16:3e:3f:e1:39", "network": {"id": "8d239238-e90b-4408-86f0-a143eb9ac337", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1071206325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0d310c-2b", "ovs_interfaceid": "de0d310c-2bc9-4434-8b2b-253a88febaa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5ecb053-fd41-42ea-8abe-4c504b6c7882", "address": "fa:16:3e:56:bb:b9", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5ecb053-fd", "ovs_interfaceid": "a5ecb053-fd41-42ea-8abe-4c504b6c7882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4bc79fe9-e1e7-4040-ae00-e231301a8c58", "address": "fa:16:3e:b8:6d:f8", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc79fe9-e1", "ovs_interfaceid": "4bc79fe9-e1e7-4040-ae00-e231301a8c58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9d9f0b3d-a677-4db0-a8be-b19006908125", "address": "fa:16:3e:d2:26:2b", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d9f0b3d-a6", "ovs_interfaceid": "9d9f0b3d-a677-4db0-a8be-b19006908125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "754453de-6c68-4cdd-acc4-2307e4b6d3d2", "address": "fa:16:3e:e2:b2:aa", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap754453de-6c", "ovs_interfaceid": "754453de-6c68-4cdd-acc4-2307e4b6d3d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "847be9c3-c4d1-4280-8b85-56697d11a876", "address": "fa:16:3e:67:52:ab", "network": {"id": "2a7db2ed-f938-42c6-b85c-8a94ac2717a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-811431562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap847be9c3-c4", "ovs_interfaceid": "847be9c3-c4d1-4280-8b85-56697d11a876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6812409-296e-40f5-bdfc-b7cedf33f85b", "address": "fa:16:3e:db:bf:df", "network": {"id": "2a7db2ed-f938-42c6-b85c-8a94ac2717a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-811431562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6812409-29", "ovs_interfaceid": "c6812409-296e-40f5-bdfc-b7cedf33f85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:07:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-596fcd30-06b1-4abb-abe2-349e328aad12 req-cc1cab8a-0da8-44e7-9e3c-e5a5f77b2e3d service nova] Acquired lock "refresh_cache-5c6c7551-7045-4129-9908-c0c6fbd93124" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:07:07 user nova-compute[75745]: DEBUG nova.network.neutron [req-596fcd30-06b1-4abb-abe2-349e328aad12 req-cc1cab8a-0da8-44e7-9e3c-e5a5f77b2e3d service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Refreshing network info cache for port c6812409-296e-40f5-bdfc-b7cedf33f85b {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:07:07 user nova-compute[75745]: DEBUG nova.network.neutron [req-596fcd30-06b1-4abb-abe2-349e328aad12 req-cc1cab8a-0da8-44e7-9e3c-e5a5f77b2e3d service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Updated VIF entry in instance network info cache for port c6812409-296e-40f5-bdfc-b7cedf33f85b. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:07:07 user nova-compute[75745]: DEBUG nova.network.neutron [req-596fcd30-06b1-4abb-abe2-349e328aad12 req-cc1cab8a-0da8-44e7-9e3c-e5a5f77b2e3d service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Updating instance_info_cache with network_info: [{"id": "de0d310c-2bc9-4434-8b2b-253a88febaa0", "address": "fa:16:3e:3f:e1:39", "network": {"id": "8d239238-e90b-4408-86f0-a143eb9ac337", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1071206325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0d310c-2b", "ovs_interfaceid": "de0d310c-2bc9-4434-8b2b-253a88febaa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5ecb053-fd41-42ea-8abe-4c504b6c7882", "address": "fa:16:3e:56:bb:b9", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5ecb053-fd", "ovs_interfaceid": "a5ecb053-fd41-42ea-8abe-4c504b6c7882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4bc79fe9-e1e7-4040-ae00-e231301a8c58", "address": "fa:16:3e:b8:6d:f8", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc79fe9-e1", "ovs_interfaceid": "4bc79fe9-e1e7-4040-ae00-e231301a8c58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9d9f0b3d-a677-4db0-a8be-b19006908125", "address": "fa:16:3e:d2:26:2b", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d9f0b3d-a6", "ovs_interfaceid": "9d9f0b3d-a677-4db0-a8be-b19006908125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "754453de-6c68-4cdd-acc4-2307e4b6d3d2", "address": "fa:16:3e:e2:b2:aa", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap754453de-6c", "ovs_interfaceid": "754453de-6c68-4cdd-acc4-2307e4b6d3d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "847be9c3-c4d1-4280-8b85-56697d11a876", "address": "fa:16:3e:67:52:ab", "network": {"id": "2a7db2ed-f938-42c6-b85c-8a94ac2717a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-811431562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap847be9c3-c4", "ovs_interfaceid": "847be9c3-c4d1-4280-8b85-56697d11a876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6812409-296e-40f5-bdfc-b7cedf33f85b", "address": "fa:16:3e:db:bf:df", "network": {"id": "2a7db2ed-f938-42c6-b85c-8a94ac2717a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-811431562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6812409-29", "ovs_interfaceid": "c6812409-296e-40f5-bdfc-b7cedf33f85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:07:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-596fcd30-06b1-4abb-abe2-349e328aad12 req-cc1cab8a-0da8-44e7-9e3c-e5a5f77b2e3d service nova] Releasing lock "refresh_cache-5c6c7551-7045-4129-9908-c0c6fbd93124" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:07:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:12 user nova-compute[75745]: INFO nova.virt.block_device [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Booting with volume c89cdf46-af77-47c8-a1fc-7a9a26f4b05c at /dev/vdc
Dec 01 17:07:12 user nova-compute[75745]: DEBUG os_brick.utils [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:07:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:12 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1211263a-b29c-4e10-8c78-97937ebc81c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:12 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[450c5570-f498-4dcd-985a-4fcc00da25ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:12 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0a2d3e-01f4-4547-bbd5-cf7a91b62e18]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:12 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8d0d83-57fd-4062-a6bf-ff644de7d640]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:07:12 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:07:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:07:12 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:07:12 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b713c2b1-28e6-4144-b94d-cc3f54f2b60c]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:12 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:07:12 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:07:12 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:07:12 user nova-compute[75745]: DEBUG os_brick.utils [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:07:12 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Updating existing volume attachment record: 37c5a326-8baf-46aa-a467-437b19e08d27 {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:07:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:13 user nova-compute[75745]: INFO nova.virt.block_device [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Booting with volume 7b42faef-d887-46fe-b858-224dcdfad762 at /dev/vdc
Dec 01 17:07:13 user nova-compute[75745]: DEBUG os_brick.utils [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:07:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad99154a-a967-41db-9e2f-b9e62a435088]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22c6479-5367-4c47-8f15-524cce857e34]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa802bf-4c65-49d3-96bb-05ae173dc2b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[756e3779-9eed-492b-b6dc-c29eb6a456e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:07:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:07:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:07:14 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:07:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f757a200-f04b-4c4e-abc6-1a790b4e3164]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:07:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:07:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:07:14 user nova-compute[75745]: DEBUG os_brick.utils [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:07:14 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Updating existing volume attachment record: 6b1a27b9-22cf-4912-b316-d93dac346b05 {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:07:17 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:18 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG nova.compute.manager [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:07:22 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Creating image(s)
Dec 01 17:07:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Did not create local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Ensure instance console log exists: /opt/stack/data/nova/instances/1372f3b7-6608-43a9-b1a5-fd7dfbaf303e/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Start _get_guest_xml network_info=[{"id": "d7c02fc7-a4d9-4c86-b18b-cf12d101f22f", "address": "fa:16:3e:09:96:2e", "network": {"id": "b1af6a14-56fa-4052-8593-93b13dc6a9a1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1377780155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7c02fc7-a4", "ovs_interfaceid": "d7c02fc7-a4d9-4c86-b18b-cf12d101f22f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4024ab4b-08e5-4f1f-866d-979bb1dee426", "address": "fa:16:3e:bc:fa:09", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4024ab4b-08", "ovs_interfaceid": "4024ab4b-08e5-4f1f-866d-979bb1dee426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6e1b67ad-1619-4e40-906c-df31e0eab904", "address": "fa:16:3e:a7:3f:00", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e1b67ad-16", "ovs_interfaceid": "6e1b67ad-1619-4e40-906c-df31e0eab904", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "92b697c2-8400-4b91-9fd7-53df7f47c4e0", "address": "fa:16:3e:95:8f:8d", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b697c2-84", "ovs_interfaceid": "92b697c2-8400-4b91-9fd7-53df7f47c4e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f79cb7e-7ef6-4e1a-a241-780713de2217", "address": "fa:16:3e:ef:c2:b4", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f79cb7e-7e", "ovs_interfaceid": "9f79cb7e-7ef6-4e1a-a241-780713de2217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b6cfe1f-9722-41e1-9679-52398359a035", "address": "fa:16:3e:7c:30:af", "network": {"id": "32d435b7-174b-4e6c-9165-315876fea12a", "bridge": "br-int", "label": "tempest-device-tagging-net2-658876998", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6cfe1f-97", "ovs_interfaceid": "4b6cfe1f-9722-41e1-9679-52398359a035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2f8e363-9e49-43ae-b61b-7ff8893c9f8f", "address": "fa:16:3e:20:41:d6", "network": {"id": "32d435b7-174b-4e6c-9165-315876fea12a", "bridge": "br-int", "label": "tempest-device-tagging-net2-658876998", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f8e363-9e", "ovs_interfaceid": "f2f8e363-9e49-43ae-b61b-7ff8893c9f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': '46a5225a-f794-43fb-8251-06a81550313e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TbdYMtaf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1372f3b7-6608-43a9-b1a5-fd7dfbaf303e', 'attached_at': '', 'detached_at': '', 'volume_id': 'e3a909f6-670c-4801-83b3-67dcc39f18b9', 'serial': 'e3a909f6-670c-4801-83b3-67dcc39f18b9'}, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None}, {'disk_bus': 'virtio', 'attachment_id': 'e9a31f68-d57e-4f59-b90a-5f4860e11b41', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FbIkLqxs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1372f3b7-6608-43a9-b1a5-fd7dfbaf303e', 'attached_at': '', 'detached_at': '', 'volume_id': '8751e4f8-9d97-4f54-a375-bd0f45e3862e', 'serial': '8751e4f8-9d97-4f54-a375-bd0f45e3862e'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 1, 'device_type': 'disk', 'volume_type': None}, {'disk_bus': 'virtio', 'attachment_id': '37c5a326-8baf-46aa-a467-437b19e08d27', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xMsYFESW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1372f3b7-6608-43a9-b1a5-fd7dfbaf303e', 'attached_at': '', 'detached_at': '', 'volume_id': 'c89cdf46-af77-47c8-a1fc-7a9a26f4b05c', 'serial': 'c89cdf46-af77-47c8-a1fc-7a9a26f4b05c'}, 'mount_device': '/dev/vdc', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 2, 'device_type': 'disk', 'volume_type': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:07:22 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:07:22 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:07:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG os_brick.initiator.connector [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Factory for ISCSI on None {{(pid=75745) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TbdYMtaf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:07:22 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:07:22 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:07:22 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:07:22 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:07:22 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 -p 172.16.0.220:3260" returned: 21 in 0.035s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7853772b-d322-45e9-8f73-ebf020bbf97a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:07:22 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e72b06-24fb-4f2b-ae68-2ed98854866e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9] added
Dec 01 17:07:22 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea922c9-1256-4b8f-871c-390e2de6cc51]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21f26ca-cfb1-40aa-ae62-9b86dde8de72]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TbdYMtaf {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TbdYMtaf" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35f0b26-10df-435d-8891-fa515f6346d0]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TbdYMtaf'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bbdf59-4f4b-4500-a29e-c0331a2cd5ea]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5f99af-ccf9-449b-9a36-74a6d2d8f2af]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 01 17:07:22 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 01 17:07:22 user nova-compute[75745]:  {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:07:22 user nova-compute[75745]: WARNING os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 01 17:07:22 user nova-compute[75745]: 
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf6c36b-372a-496f-a382-de9d5e06a3e5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9, portal: 172.16.0.220,3260]
Dec 01 17:07:22 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9, portal: 172.16.0.220,3260] successful.
Dec 01 17:07:22 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac069f7-5cdc-42cb-9666-536cfbbf7d31]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5540a3b6-3b04-4847-b4e9-1c99f83caa97]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:07:22 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:07:22 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:07:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:23 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c4b62e-2129-48b0-9f54-d4aa7f560f39]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:23 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:07:23 user nova-compute[75745]: DEBUG nova.compute.manager [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:07:23 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:07:23 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Creating image(s)
Dec 01 17:07:23 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Did not create local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 17:07:23 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Ensure instance console log exists: /opt/stack/data/nova/instances/5c6c7551-7045-4129-9908-c0c6fbd93124/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:07:23 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:23 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:23 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:23 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Start _get_guest_xml network_info=[{"id": "de0d310c-2bc9-4434-8b2b-253a88febaa0", "address": "fa:16:3e:3f:e1:39", "network": {"id": "8d239238-e90b-4408-86f0-a143eb9ac337", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1071206325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0d310c-2b", "ovs_interfaceid": "de0d310c-2bc9-4434-8b2b-253a88febaa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5ecb053-fd41-42ea-8abe-4c504b6c7882", "address": "fa:16:3e:56:bb:b9", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5ecb053-fd", "ovs_interfaceid": "a5ecb053-fd41-42ea-8abe-4c504b6c7882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4bc79fe9-e1e7-4040-ae00-e231301a8c58", "address": "fa:16:3e:b8:6d:f8", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc79fe9-e1", "ovs_interfaceid": "4bc79fe9-e1e7-4040-ae00-e231301a8c58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9d9f0b3d-a677-4db0-a8be-b19006908125", "address": "fa:16:3e:d2:26:2b", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d9f0b3d-a6", "ovs_interfaceid": "9d9f0b3d-a677-4db0-a8be-b19006908125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "754453de-6c68-4cdd-acc4-2307e4b6d3d2", "address": "fa:16:3e:e2:b2:aa", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap754453de-6c", "ovs_interfaceid": "754453de-6c68-4cdd-acc4-2307e4b6d3d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "847be9c3-c4d1-4280-8b85-56697d11a876", "address": "fa:16:3e:67:52:ab", "network": {"id": "2a7db2ed-f938-42c6-b85c-8a94ac2717a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-811431562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap847be9c3-c4", "ovs_interfaceid": "847be9c3-c4d1-4280-8b85-56697d11a876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6812409-296e-40f5-bdfc-b7cedf33f85b", "address": "fa:16:3e:db:bf:df", "network": {"id": "2a7db2ed-f938-42c6-b85c-8a94ac2717a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-811431562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6812409-29", "ovs_interfaceid": "c6812409-296e-40f5-bdfc-b7cedf33f85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': '4627b361-d67b-4050-9700-24cad4da5dfa', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tYLBabph', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5c6c7551-7045-4129-9908-c0c6fbd93124', 'attached_at': '', 'detached_at': '', 'volume_id': '40deba30-bea8-4474-9760-b572f1f764de', 'serial': '40deba30-bea8-4474-9760-b572f1f764de'}, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None}, {'disk_bus': 'virtio', 'attachment_id': 'a3b0d016-0f13-48c8-890b-edcada193236', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JgsWeCyl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5c6c7551-7045-4129-9908-c0c6fbd93124', 'attached_at': '', 'detached_at': '', 'volume_id': 'beb5e348-2521-40cf-99fe-4bf8f351e749', 'serial': 'beb5e348-2521-40cf-99fe-4bf8f351e749'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 1, 'device_type': 'disk', 'volume_type': None}, {'disk_bus': 'virtio', 'attachment_id': '6b1a27b9-22cf-4912-b316-d93dac346b05', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jCHLSPqX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5c6c7551-7045-4129-9908-c0c6fbd93124', 'attached_at': '', 'detached_at': '', 'volume_id': '7b42faef-d887-46fe-b858-224dcdfad762', 'serial': '7b42faef-d887-46fe-b858-224dcdfad762'}, 'mount_device': '/dev/vdc', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 2, 'device_type': 'disk', 'volume_type': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:07:23 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:07:23 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:07:23 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:07:23 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:07:23 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:07:23 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:07:23 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:07:23 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:07:23 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:07:23 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:07:23 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:07:23 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:07:23 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:07:23 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:07:23 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:07:23 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:07:23 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:07:23 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:07:23 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:07:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tYLBabph', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:07:23 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:07:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:07:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TbdYMtaf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23064376331326166', 'path': '/dev/sdb'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064376331326166', 'path': '/dev/sdb'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.288s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:07:24 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:07:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:07:24 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:07:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bc96cc-504d-43c5-9c6a-b0cff432313c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:07:24 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FbIkLqxs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:07:24 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:07:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f50a54-7087-430f-8667-aab033d641c6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de] added
Dec 01 17:07:24 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed031bce-06ca-49d4-bc00-750929b8fe83]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58d5b50-33d7-4efd-98e2-07a4287fae6c]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tYLBabph {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tYLBabph" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9e0473-1c50-4d0b-91a9-9c8dd2a13243]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tYLBabph'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e52c474-a83c-4e5f-a1a1-e650fb8ba49d]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3d1180-2535-49a7-84ef-75d0989372c6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:07:24 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:07:24 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[317e1dca-ae45-4210-87c5-758a09c29fe6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de, portal: 172.16.0.220,3260]
Dec 01 17:07:24 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de, portal: 172.16.0.220,3260] successful.
Dec 01 17:07:24 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc1b790-c2ed-4e74-8a64-8e88e5405f92]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[970988ed-0c35-4831-8ec2-f98b2f50e30d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:07:24 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:07:24 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:07:24 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:07:24 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee80f751-c141-4f5b-8b96-50b498cab82e]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:24 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tYLBabph', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] <== connect_volume: return (1574ms) {'type': 'block', 'scsi_wwn': '26330623966613762', 'path': '/dev/sdc'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330623966613762', 'path': '/dev/sdc'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.259s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:07:25 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:07:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:07:25 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:07:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d00548b-6039-4e13-a99f-019451b1863d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:07:25 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JgsWeCyl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:07:25 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:07:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[943d8bca-9932-4080-a767-8692d4a49559]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e] added
Dec 01 17:07:25 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6755bb7-795a-4998-864d-6c2d9242203b]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[52121523-b5ad-4a4b-8197-1f37b2a3a01f]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FbIkLqxs {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FbIkLqxs" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9408a87e-1057-4fd7-977a-122c7a677e2b]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FbIkLqxs'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3a1503-80f3-4cc1-852b-ecc97aac69c0]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e0afaf-dc1f-4393-aed5-792b82695f6f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:07:25 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:07:25 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:07:25 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:07:25 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a042ea-3d31-4879-9761-f7314e51c562]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e, portal: 172.16.0.220,3260]
Dec 01 17:07:25 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e, portal: 172.16.0.220,3260] successful.
Dec 01 17:07:25 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6711a7c6-76e0-4723-9867-20aff6f598ef]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e018ad-40b0-4986-911a-a8ef5d4790fb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:07:25 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:07:25 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:07:25 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:07:25 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:07:25 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:07:25 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d426c0-e610-4bfe-9397-4eed9d13d93c]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:07:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FbIkLqxs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] <== connect_volume: return (2559ms) {'type': 'block', 'scsi_wwn': '26166663466656662', 'path': '/dev/sdd'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166663466656662', 'path': '/dev/sdd'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.276s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:07:26 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:07:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:07:26 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:07:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0283dc54-16e1-4069-80fd-f27608e7278c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:07:26 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xMsYFESW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:07:26 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:07:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af8b462-d681-4235-a433-1a10382320b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749] added
Dec 01 17:07:26 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[00bfae1c-4464-4a38-a687-60cabf464310]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93e62de-cd88-42bc-a90f-df9b7baebf40]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JgsWeCyl {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JgsWeCyl" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[09911363-3e3a-42de-a6c0-277ff4f67145]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JgsWeCyl'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0587ab5-cc4b-459f-b242-e716f1e9a296]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ade4856-3967-4fbf-a0bf-170f7caea67a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:07:26 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:07:26 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:07:26 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:07:26 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:07:26 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:07:26 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2cb9c9-9f76-49c4-8110-445f4238e51c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749, portal: 172.16.0.220,3260]
Dec 01 17:07:26 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749, portal: 172.16.0.220,3260] successful.
Dec 01 17:07:26 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[097fda49-4aee-4858-8c9d-73d24b83aa60]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[828afbc9-0411-42a0-a6e5-7874353c912e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:07:26 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:07:26 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:07:26 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:07:26 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:07:26 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:07:26 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:07:26 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:07:26 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf46612-7b04-471f-a379-1c2f7977d229]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:07:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JgsWeCyl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:07:27 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:07:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] <== connect_volume: return (2586ms) {'type': 'block', 'scsi_wwn': '26635346434373832', 'path': '/dev/sde'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:07:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635346434373832', 'path': '/dev/sde'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:07:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.283s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:07:27 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:07:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:07:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:07:27 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:07:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:27 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6bfb7e-5b8f-4120-a2d7-0036ad1e6b40]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:07:27 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:07:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jCHLSPqX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:07:27 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:07:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:07:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:27 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7356c4cd-bb2e-4400-adfc-bf9e6bb7a0e6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c] added
Dec 01 17:07:27 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:27 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bdc633-2667-42be-9bbf-6f16e07b92aa]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9b178b-61d3-496d-8a36-b575db1cf0ae]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xMsYFESW {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xMsYFESW" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f79d49c-b30e-4e33-8c26-cc551b77d52f]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xMsYFESW'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[123865e1-c8df-442f-8dea-e15457dffaf9]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb2c214-d7b2-44a3-bc8b-8c876453db60]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:07:28 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:07:28 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:07:28 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:07:28 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:07:28 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:07:28 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:07:28 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:07:28 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f705ef56-6361-4801-8936-976d8f12beff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c, portal: 172.16.0.220,3260]
Dec 01 17:07:28 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c, portal: 172.16.0.220,3260] successful.
Dec 01 17:07:28 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d465d9-8ee1-4e7f-bcf8-7235e5b30bce]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d73860a-cac8-4cc9-90d5-6a13ddc3425b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:07:28 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:07:28 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:07:28 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:07:28 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:07:28 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:07:28 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:07:28 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:07:28 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:07:28 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:07:28 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3463b53-724c-4034-b5a3-913b7f9ed77e]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: None {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:07:28 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xMsYFESW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] <== connect_volume: return (2596ms) {'type': 'block', 'scsi_wwn': '23033363262656666', 'path': '/dev/sdf'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033363262656666', 'path': '/dev/sdf'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.284s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:07:29 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:07:29 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:07:29 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:07:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-967863949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-967863949',id=10,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNJQ6Ls85E20B9JwJyODLi6L5WLfy6H87RMs9k8eKydMJ8U7Bv+G1AO3XADEvyUXeKa4DqapDG0KKZB6o4L4oqqYYcjzoS5y0Gkw1mDGthLvWBxAnOCXC13OwMrt/AWCA==',key_name='tempest-keypair-2600959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='586f7ce69de240cb9e2d110530c2c7ef',ramdisk_id='',reservation_id='r-e9tvthiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-744386326',owner_user_name='tempest-TaggedBootDevicesTest-744386326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9840763db2774692ae52f8a689ed9083',uuid=1372f3b7-6608-43a9-b1a5-fd7dfbaf303e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7c02fc7-a4d9-4c86-b18b-cf12d101f22f", "address": "fa:16:3e:09:96:2e", "network": {"id": "b1af6a14-56fa-4052-8593-93b13dc6a9a1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1377780155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7c02fc7-a4", "ovs_interfaceid": "d7c02fc7-a4d9-4c86-b18b-cf12d101f22f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converting VIF {"id": "d7c02fc7-a4d9-4c86-b18b-cf12d101f22f", "address": "fa:16:3e:09:96:2e", "network": {"id": "b1af6a14-56fa-4052-8593-93b13dc6a9a1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1377780155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7c02fc7-a4", "ovs_interfaceid": "d7c02fc7-a4d9-4c86-b18b-cf12d101f22f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:96:2e,bridge_name='br-int',has_traffic_filtering=True,id=d7c02fc7-a4d9-4c86-b18b-cf12d101f22f,network=Network(b1af6a14-56fa-4052-8593-93b13dc6a9a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7c02fc7-a4') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-967863949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-967863949',id=10,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNJQ6Ls85E20B9JwJyODLi6L5WLfy6H87RMs9k8eKydMJ8U7Bv+G1AO3XADEvyUXeKa4DqapDG0KKZB6o4L4oqqYYcjzoS5y0Gkw1mDGthLvWBxAnOCXC13OwMrt/AWCA==',key_name='tempest-keypair-2600959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='586f7ce69de240cb9e2d110530c2c7ef',ramdisk_id='',reservation_id='r-e9tvthiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-744386326',owner_user_name='tempest-TaggedBootDevicesTest-744386326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9840763db2774692ae52f8a689ed9083',uuid=1372f3b7-6608-43a9-b1a5-fd7dfbaf303e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4024ab4b-08e5-4f1f-866d-979bb1dee426", "address": "fa:16:3e:bc:fa:09", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4024ab4b-08", "ovs_interfaceid": "4024ab4b-08e5-4f1f-866d-979bb1dee426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converting VIF {"id": "4024ab4b-08e5-4f1f-866d-979bb1dee426", "address": "fa:16:3e:bc:fa:09", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4024ab4b-08", "ovs_interfaceid": "4024ab4b-08e5-4f1f-866d-979bb1dee426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:fa:09,bridge_name='br-int',has_traffic_filtering=True,id=4024ab4b-08e5-4f1f-866d-979bb1dee426,network=Network(a0d9c591-842a-4fcd-93e5-62cacb3f1d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4024ab4b-08') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-967863949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-967863949',id=10,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNJQ6Ls85E20B9JwJyODLi6L5WLfy6H87RMs9k8eKydMJ8U7Bv+G1AO3XADEvyUXeKa4DqapDG0KKZB6o4L4oqqYYcjzoS5y0Gkw1mDGthLvWBxAnOCXC13OwMrt/AWCA==',key_name='tempest-keypair-2600959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='586f7ce69de240cb9e2d110530c2c7ef',ramdisk_id='',reservation_id='r-e9tvthiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-744386326',owner_user_name='tempest-TaggedBootDevicesTest-744386326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9840763db2774692ae52f8a689ed9083',uuid=1372f3b7-6608-43a9-b1a5-fd7dfbaf303e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e1b67ad-1619-4e40-906c-df31e0eab904", "address": "fa:16:3e:a7:3f:00", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e1b67ad-16", "ovs_interfaceid": "6e1b67ad-1619-4e40-906c-df31e0eab904", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converting VIF {"id": "6e1b67ad-1619-4e40-906c-df31e0eab904", "address": "fa:16:3e:a7:3f:00", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e1b67ad-16", "ovs_interfaceid": "6e1b67ad-1619-4e40-906c-df31e0eab904", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:3f:00,bridge_name='br-int',has_traffic_filtering=True,id=6e1b67ad-1619-4e40-906c-df31e0eab904,network=Network(a0d9c591-842a-4fcd-93e5-62cacb3f1d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e1b67ad-16') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-967863949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-967863949',id=10,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNJQ6Ls85E20B9JwJyODLi6L5WLfy6H87RMs9k8eKydMJ8U7Bv+G1AO3XADEvyUXeKa4DqapDG0KKZB6o4L4oqqYYcjzoS5y0Gkw1mDGthLvWBxAnOCXC13OwMrt/AWCA==',key_name='tempest-keypair-2600959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='586f7ce69de240cb9e2d110530c2c7ef',ramdisk_id='',reservation_id='r-e9tvthiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-744386326',owner_user_name='tempest-TaggedBootDevicesTest-744386326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9840763db2774692ae52f8a689ed9083',uuid=1372f3b7-6608-43a9-b1a5-fd7dfbaf303e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92b697c2-8400-4b91-9fd7-53df7f47c4e0", "address": "fa:16:3e:95:8f:8d", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b697c2-84", "ovs_interfaceid": "92b697c2-8400-4b91-9fd7-53df7f47c4e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converting VIF {"id": "92b697c2-8400-4b91-9fd7-53df7f47c4e0", "address": "fa:16:3e:95:8f:8d", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b697c2-84", "ovs_interfaceid": "92b697c2-8400-4b91-9fd7-53df7f47c4e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:8f:8d,bridge_name='br-int',has_traffic_filtering=True,id=92b697c2-8400-4b91-9fd7-53df7f47c4e0,network=Network(a0d9c591-842a-4fcd-93e5-62cacb3f1d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92b697c2-84') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-967863949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-967863949',id=10,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNJQ6Ls85E20B9JwJyODLi6L5WLfy6H87RMs9k8eKydMJ8U7Bv+G1AO3XADEvyUXeKa4DqapDG0KKZB6o4L4oqqYYcjzoS5y0Gkw1mDGthLvWBxAnOCXC13OwMrt/AWCA==',key_name='tempest-keypair-2600959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='586f7ce69de240cb9e2d110530c2c7ef',ramdisk_id='',reservation_id='r-e9tvthiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-744386326',owner_user_name='tempest-TaggedBootDevicesTest-744386326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9840763db2774692ae52f8a689ed9083',uuid=1372f3b7-6608-43a9-b1a5-fd7dfbaf303e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f79cb7e-7ef6-4e1a-a241-780713de2217", "address": "fa:16:3e:ef:c2:b4", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f79cb7e-7e", "ovs_interfaceid": "9f79cb7e-7ef6-4e1a-a241-780713de2217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converting VIF {"id": "9f79cb7e-7ef6-4e1a-a241-780713de2217", "address": "fa:16:3e:ef:c2:b4", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f79cb7e-7e", "ovs_interfaceid": "9f79cb7e-7ef6-4e1a-a241-780713de2217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c2:b4,bridge_name='br-int',has_traffic_filtering=True,id=9f79cb7e-7ef6-4e1a-a241-780713de2217,network=Network(a0d9c591-842a-4fcd-93e5-62cacb3f1d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f79cb7e-7e') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-967863949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-967863949',id=10,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNJQ6Ls85E20B9JwJyODLi6L5WLfy6H87RMs9k8eKydMJ8U7Bv+G1AO3XADEvyUXeKa4DqapDG0KKZB6o4L4oqqYYcjzoS5y0Gkw1mDGthLvWBxAnOCXC13OwMrt/AWCA==',key_name='tempest-keypair-2600959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='586f7ce69de240cb9e2d110530c2c7ef',ramdisk_id='',reservation_id='r-e9tvthiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-744386326',owner_user_name='tempest-TaggedBootDevicesTest-744386326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9840763db2774692ae52f8a689ed9083',uuid=1372f3b7-6608-43a9-b1a5-fd7dfbaf303e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b6cfe1f-9722-41e1-9679-52398359a035", "address": "fa:16:3e:7c:30:af", "network": {"id": "32d435b7-174b-4e6c-9165-315876fea12a", "bridge": "br-int", "label": "tempest-device-tagging-net2-658876998", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6cfe1f-97", "ovs_interfaceid": "4b6cfe1f-9722-41e1-9679-52398359a035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converting VIF {"id": "4b6cfe1f-9722-41e1-9679-52398359a035", "address": "fa:16:3e:7c:30:af", "network": {"id": "32d435b7-174b-4e6c-9165-315876fea12a", "bridge": "br-int", "label": "tempest-device-tagging-net2-658876998", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6cfe1f-97", "ovs_interfaceid": "4b6cfe1f-9722-41e1-9679-52398359a035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:30:af,bridge_name='br-int',has_traffic_filtering=True,id=4b6cfe1f-9722-41e1-9679-52398359a035,network=Network(32d435b7-174b-4e6c-9165-315876fea12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b6cfe1f-97') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-967863949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-967863949',id=10,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNJQ6Ls85E20B9JwJyODLi6L5WLfy6H87RMs9k8eKydMJ8U7Bv+G1AO3XADEvyUXeKa4DqapDG0KKZB6o4L4oqqYYcjzoS5y0Gkw1mDGthLvWBxAnOCXC13OwMrt/AWCA==',key_name='tempest-keypair-2600959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='586f7ce69de240cb9e2d110530c2c7ef',ramdisk_id='',reservation_id='r-e9tvthiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-744386326',owner_user_name='tempest-TaggedBootDevicesTest-744386326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9840763db2774692ae52f8a689ed9083',uuid=1372f3b7-6608-43a9-b1a5-fd7dfbaf303e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2f8e363-9e49-43ae-b61b-7ff8893c9f8f", "address": "fa:16:3e:20:41:d6", "network": {"id": "32d435b7-174b-4e6c-9165-315876fea12a", "bridge": "br-int", "label": "tempest-device-tagging-net2-658876998", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f8e363-9e", "ovs_interfaceid": "f2f8e363-9e49-43ae-b61b-7ff8893c9f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converting VIF {"id": "f2f8e363-9e49-43ae-b61b-7ff8893c9f8f", "address": "fa:16:3e:20:41:d6", "network": {"id": "32d435b7-174b-4e6c-9165-315876fea12a", "bridge": "br-int", "label": "tempest-device-tagging-net2-658876998", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f8e363-9e", "ovs_interfaceid": "f2f8e363-9e49-43ae-b61b-7ff8893c9f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:41:d6,bridge_name='br-int',has_traffic_filtering=True,id=f2f8e363-9e49-43ae-b61b-7ff8893c9f8f,network=Network(32d435b7-174b-4e6c-9165-315876fea12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2f8e363-9e') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.objects.instance [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Lazy-loading 'pci_devices' on Instance uuid 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e6b4a5-151b-4d21-a90f-85c8aeb41a16]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:07:29 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:07:29 user nova-compute[75745]:   <uuid>1372f3b7-6608-43a9-b1a5-fd7dfbaf303e</uuid>
Dec 01 17:07:29 user nova-compute[75745]:   <name>instance-0000000a</name>
Dec 01 17:07:29 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:07:29 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:07:29 user nova-compute[75745]:   <metadata>
Dec 01 17:07:29 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:07:29 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:07:29 user nova-compute[75745]:       <nova:name>tempest-device-tagging-server-967863949</nova:name>
Dec 01 17:07:29 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:07:22</nova:creationTime>
Dec 01 17:07:29 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:07:29 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:07:29 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:07:29 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:07:29 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:07:29 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:07:29 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:07:29 user nova-compute[75745]:       <nova:owner>
Dec 01 17:07:29 user nova-compute[75745]:         <nova:user uuid="9840763db2774692ae52f8a689ed9083">tempest-TaggedBootDevicesTest-744386326-project-member</nova:user>
Dec 01 17:07:29 user nova-compute[75745]:         <nova:project uuid="586f7ce69de240cb9e2d110530c2c7ef">tempest-TaggedBootDevicesTest-744386326</nova:project>
Dec 01 17:07:29 user nova-compute[75745]:       </nova:owner>
Dec 01 17:07:29 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:07:29 user nova-compute[75745]:       <nova:ports>
Dec 01 17:07:29 user nova-compute[75745]:         <nova:port uuid="d7c02fc7-a4d9-4c86-b18b-cf12d101f22f">
Dec 01 17:07:29 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 01 17:07:29 user nova-compute[75745]:         </nova:port>
Dec 01 17:07:29 user nova-compute[75745]:         <nova:port uuid="4024ab4b-08e5-4f1f-866d-979bb1dee426">
Dec 01 17:07:29 user nova-compute[75745]:           <nova:ip type="fixed" address="10.1.1.220" ipVersion="4"/>
Dec 01 17:07:29 user nova-compute[75745]:         </nova:port>
Dec 01 17:07:29 user nova-compute[75745]:         <nova:port uuid="6e1b67ad-1619-4e40-906c-df31e0eab904">
Dec 01 17:07:29 user nova-compute[75745]:           <nova:ip type="fixed" address="10.1.1.187" ipVersion="4"/>
Dec 01 17:07:29 user nova-compute[75745]:         </nova:port>
Dec 01 17:07:29 user nova-compute[75745]:         <nova:port uuid="92b697c2-8400-4b91-9fd7-53df7f47c4e0">
Dec 01 17:07:29 user nova-compute[75745]:           <nova:ip type="fixed" address="10.1.1.229" ipVersion="4"/>
Dec 01 17:07:29 user nova-compute[75745]:         </nova:port>
Dec 01 17:07:29 user nova-compute[75745]:         <nova:port uuid="9f79cb7e-7ef6-4e1a-a241-780713de2217">
Dec 01 17:07:29 user nova-compute[75745]:           <nova:ip type="fixed" address="10.1.1.47" ipVersion="4"/>
Dec 01 17:07:29 user nova-compute[75745]:         </nova:port>
Dec 01 17:07:29 user nova-compute[75745]:         <nova:port uuid="4b6cfe1f-9722-41e1-9679-52398359a035">
Dec 01 17:07:29 user nova-compute[75745]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Dec 01 17:07:29 user nova-compute[75745]:         </nova:port>
Dec 01 17:07:29 user nova-compute[75745]:         <nova:port uuid="f2f8e363-9e49-43ae-b61b-7ff8893c9f8f">
Dec 01 17:07:29 user nova-compute[75745]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Dec 01 17:07:29 user nova-compute[75745]:         </nova:port>
Dec 01 17:07:29 user nova-compute[75745]:       </nova:ports>
Dec 01 17:07:29 user nova-compute[75745]:     </nova:instance>
Dec 01 17:07:29 user nova-compute[75745]:   </metadata>
Dec 01 17:07:29 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:07:29 user nova-compute[75745]:     <system>
Dec 01 17:07:29 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:07:29 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:07:29 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:07:29 user nova-compute[75745]:       <entry name="serial">1372f3b7-6608-43a9-b1a5-fd7dfbaf303e</entry>
Dec 01 17:07:29 user nova-compute[75745]:       <entry name="uuid">1372f3b7-6608-43a9-b1a5-fd7dfbaf303e</entry>
Dec 01 17:07:29 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:07:29 user nova-compute[75745]:     </system>
Dec 01 17:07:29 user nova-compute[75745]:   </sysinfo>
Dec 01 17:07:29 user nova-compute[75745]:   <os>
Dec 01 17:07:29 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:07:29 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:07:29 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:07:29 user nova-compute[75745]:   </os>
Dec 01 17:07:29 user nova-compute[75745]:   <features>
Dec 01 17:07:29 user nova-compute[75745]:     <acpi/>
Dec 01 17:07:29 user nova-compute[75745]:     <apic/>
Dec 01 17:07:29 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:07:29 user nova-compute[75745]:   </features>
Dec 01 17:07:29 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:07:29 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:07:29 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:07:29 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:07:29 user nova-compute[75745]:   </clock>
Dec 01 17:07:29 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:07:29 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:07:29 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:07:29 user nova-compute[75745]:   </cpu>
Dec 01 17:07:29 user nova-compute[75745]:   <devices>
Dec 01 17:07:29 user nova-compute[75745]:     <disk type="file" device="cdrom">
Dec 01 17:07:29 user nova-compute[75745]:       <driver name="qemu" type="raw" cache="none"/>
Dec 01 17:07:29 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/1372f3b7-6608-43a9-b1a5-fd7dfbaf303e/disk.config"/>
Dec 01 17:07:29 user nova-compute[75745]:       <target dev="hda" bus="ide"/>
Dec 01 17:07:29 user nova-compute[75745]:     </disk>
Dec 01 17:07:29 user nova-compute[75745]:     <disk type="block" device="disk">
Dec 01 17:07:29 user nova-compute[75745]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:07:29 user nova-compute[75745]:       <source dev="/dev/sdb"/>
Dec 01 17:07:29 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:07:29 user nova-compute[75745]:       <serial>e3a909f6-670c-4801-83b3-67dcc39f18b9</serial>
Dec 01 17:07:29 user nova-compute[75745]:     </disk>
Dec 01 17:07:29 user nova-compute[75745]:     <disk type="block" device="disk">
Dec 01 17:07:29 user nova-compute[75745]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:07:29 user nova-compute[75745]:       <source dev="/dev/sdd"/>
Dec 01 17:07:29 user nova-compute[75745]:       <target dev="vdb" bus="virtio"/>
Dec 01 17:07:29 user nova-compute[75745]:       <serial>8751e4f8-9d97-4f54-a375-bd0f45e3862e</serial>
Dec 01 17:07:29 user nova-compute[75745]:     </disk>
Dec 01 17:07:29 user nova-compute[75745]:     <disk type="block" device="disk">
Dec 01 17:07:29 user nova-compute[75745]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:07:29 user nova-compute[75745]:       <source dev="/dev/sdf"/>
Dec 01 17:07:29 user nova-compute[75745]:       <target dev="vdc" bus="virtio"/>
Dec 01 17:07:29 user nova-compute[75745]:       <serial>c89cdf46-af77-47c8-a1fc-7a9a26f4b05c</serial>
Dec 01 17:07:29 user nova-compute[75745]:     </disk>
Dec 01 17:07:29 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:07:29 user nova-compute[75745]:       <mac address="fa:16:3e:09:96:2e"/>
Dec 01 17:07:29 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:07:29 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:07:29 user nova-compute[75745]:       <target dev="tapd7c02fc7-a4"/>
Dec 01 17:07:29 user nova-compute[75745]:     </interface>
Dec 01 17:07:29 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:07:29 user nova-compute[75745]:       <mac address="fa:16:3e:bc:fa:09"/>
Dec 01 17:07:29 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:07:29 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:07:29 user nova-compute[75745]:       <target dev="tap4024ab4b-08"/>
Dec 01 17:07:29 user nova-compute[75745]:     </interface>
Dec 01 17:07:29 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:07:29 user nova-compute[75745]:       <mac address="fa:16:3e:a7:3f:00"/>
Dec 01 17:07:29 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:07:29 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:07:29 user nova-compute[75745]:       <target dev="tap6e1b67ad-16"/>
Dec 01 17:07:29 user nova-compute[75745]:     </interface>
Dec 01 17:07:29 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:07:29 user nova-compute[75745]:       <mac address="fa:16:3e:95:8f:8d"/>
Dec 01 17:07:29 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:07:29 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:07:29 user nova-compute[75745]:       <target dev="tap92b697c2-84"/>
Dec 01 17:07:29 user nova-compute[75745]:     </interface>
Dec 01 17:07:29 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:07:29 user nova-compute[75745]:       <mac address="fa:16:3e:ef:c2:b4"/>
Dec 01 17:07:29 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:07:29 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:07:29 user nova-compute[75745]:       <target dev="tap9f79cb7e-7e"/>
Dec 01 17:07:29 user nova-compute[75745]:     </interface>
Dec 01 17:07:29 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:07:29 user nova-compute[75745]:       <mac address="fa:16:3e:7c:30:af"/>
Dec 01 17:07:29 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:07:29 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:07:29 user nova-compute[75745]:       <target dev="tap4b6cfe1f-97"/>
Dec 01 17:07:29 user nova-compute[75745]:     </interface>
Dec 01 17:07:29 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:07:29 user nova-compute[75745]:       <mac address="fa:16:3e:20:41:d6"/>
Dec 01 17:07:29 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:07:29 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:07:29 user nova-compute[75745]:       <target dev="tapf2f8e363-9e"/>
Dec 01 17:07:29 user nova-compute[75745]:     </interface>
Dec 01 17:07:29 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:07:29 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/1372f3b7-6608-43a9-b1a5-fd7dfbaf303e/console.log" append="off"/>
Dec 01 17:07:29 user nova-compute[75745]:     </serial>
Dec 01 17:07:29 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:07:29 user nova-compute[75745]:     <video>
Dec 01 17:07:29 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:07:29 user nova-compute[75745]:     </video>
Dec 01 17:07:29 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:07:29 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:07:29 user nova-compute[75745]:     </rng>
Dec 01 17:07:29 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:07:29 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:07:29 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:07:29 user nova-compute[75745]:     </memballoon>
Dec 01 17:07:29 user nova-compute[75745]:   </devices>
Dec 01 17:07:29 user nova-compute[75745]: </domain>
Dec 01 17:07:29 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-967863949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-967863949',id=10,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNJQ6Ls85E20B9JwJyODLi6L5WLfy6H87RMs9k8eKydMJ8U7Bv+G1AO3XADEvyUXeKa4DqapDG0KKZB6o4L4oqqYYcjzoS5y0Gkw1mDGthLvWBxAnOCXC13OwMrt/AWCA==',key_name='tempest-keypair-2600959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='586f7ce69de240cb9e2d110530c2c7ef',ramdisk_id='',reservation_id='r-e9tvthiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-744386326',owner_user_name='tempest-TaggedBootDevicesTest-744386326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9840763db2774692ae52f8a689ed9083',uuid=1372f3b7-6608-43a9-b1a5-fd7dfbaf303e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7c02fc7-a4d9-4c86-b18b-cf12d101f22f", "address": "fa:16:3e:09:96:2e", "network": {"id": "b1af6a14-56fa-4052-8593-93b13dc6a9a1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1377780155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7c02fc7-a4", "ovs_interfaceid": "d7c02fc7-a4d9-4c86-b18b-cf12d101f22f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converting VIF {"id": "d7c02fc7-a4d9-4c86-b18b-cf12d101f22f", "address": "fa:16:3e:09:96:2e", "network": {"id": "b1af6a14-56fa-4052-8593-93b13dc6a9a1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1377780155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7c02fc7-a4", "ovs_interfaceid": "d7c02fc7-a4d9-4c86-b18b-cf12d101f22f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:96:2e,bridge_name='br-int',has_traffic_filtering=True,id=d7c02fc7-a4d9-4c86-b18b-cf12d101f22f,network=Network(b1af6a14-56fa-4052-8593-93b13dc6a9a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7c02fc7-a4') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG os_vif [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:96:2e,bridge_name='br-int',has_traffic_filtering=True,id=d7c02fc7-a4d9-4c86-b18b-cf12d101f22f,network=Network(b1af6a14-56fa-4052-8593-93b13dc6a9a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7c02fc7-a4') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '96d546c2-8e62-5b41-a6b9-e2fcb1148727', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e330e0-9464-4556-8c52-ead313750673]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762] added
Dec 01 17:07:29 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7c02fc7-a4, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd7c02fc7-a4, col_values=(('qos', UUID('de630e01-2288-4059-b514-a7fc7e657da0')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd7c02fc7-a4, col_values=(('external_ids', {'iface-id': 'd7c02fc7-a4d9-4c86-b18b-cf12d101f22f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:96:2e', 'vm-uuid': '1372f3b7-6608-43a9-b1a5-fd7dfbaf303e'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.039s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5f3ab1-081d-4de7-b130-f109bf77f7ea]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: INFO os_vif [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:96:2e,bridge_name='br-int',has_traffic_filtering=True,id=d7c02fc7-a4d9-4c86-b18b-cf12d101f22f,network=Network(b1af6a14-56fa-4052-8593-93b13dc6a9a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7c02fc7-a4')
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-967863949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-967863949',id=10,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNJQ6Ls85E20B9JwJyODLi6L5WLfy6H87RMs9k8eKydMJ8U7Bv+G1AO3XADEvyUXeKa4DqapDG0KKZB6o4L4oqqYYcjzoS5y0Gkw1mDGthLvWBxAnOCXC13OwMrt/AWCA==',key_name='tempest-keypair-2600959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='586f7ce69de240cb9e2d110530c2c7ef',ramdisk_id='',reservation_id='r-e9tvthiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-744386326',owner_user_name='tempest-TaggedBootDevicesTest-744386326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9840763db2774692ae52f8a689ed9083',uuid=1372f3b7-6608-43a9-b1a5-fd7dfbaf303e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4024ab4b-08e5-4f1f-866d-979bb1dee426", "address": "fa:16:3e:bc:fa:09", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4024ab4b-08", "ovs_interfaceid": "4024ab4b-08e5-4f1f-866d-979bb1dee426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converting VIF {"id": "4024ab4b-08e5-4f1f-866d-979bb1dee426", "address": "fa:16:3e:bc:fa:09", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4024ab4b-08", "ovs_interfaceid": "4024ab4b-08e5-4f1f-866d-979bb1dee426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:fa:09,bridge_name='br-int',has_traffic_filtering=True,id=4024ab4b-08e5-4f1f-866d-979bb1dee426,network=Network(a0d9c591-842a-4fcd-93e5-62cacb3f1d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4024ab4b-08') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG os_vif [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:fa:09,bridge_name='br-int',has_traffic_filtering=True,id=4024ab4b-08e5-4f1f-866d-979bb1dee426,network=Network(a0d9c591-842a-4fcd-93e5-62cacb3f1d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4024ab4b-08') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '91d627db-ca0c-5d8c-a9a0-7196dab978ac', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea60d29-f5a2-4056-8712-539638c5f8b0]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jCHLSPqX {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4024ab4b-08, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4024ab4b-08, col_values=(('qos', UUID('d3352ca0-0163-4a2f-9bf8-b3a9c9b44041')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4024ab4b-08, col_values=(('external_ids', {'iface-id': '4024ab4b-08e5-4f1f-866d-979bb1dee426', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:fa:09', 'vm-uuid': '1372f3b7-6608-43a9-b1a5-fd7dfbaf303e'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jCHLSPqX" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e886d1-2321-4e74-88ab-47f443855951]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jCHLSPqX'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: INFO os_vif [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:fa:09,bridge_name='br-int',has_traffic_filtering=True,id=4024ab4b-08e5-4f1f-866d-979bb1dee426,network=Network(a0d9c591-842a-4fcd-93e5-62cacb3f1d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4024ab4b-08')
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-967863949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-967863949',id=10,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNJQ6Ls85E20B9JwJyODLi6L5WLfy6H87RMs9k8eKydMJ8U7Bv+G1AO3XADEvyUXeKa4DqapDG0KKZB6o4L4oqqYYcjzoS5y0Gkw1mDGthLvWBxAnOCXC13OwMrt/AWCA==',key_name='tempest-keypair-2600959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='586f7ce69de240cb9e2d110530c2c7ef',ramdisk_id='',reservation_id='r-e9tvthiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-744386326',owner_user_name='tempest-TaggedBootDevicesTest-744386326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9840763db2774692ae52f8a689ed9083',uuid=1372f3b7-6608-43a9-b1a5-fd7dfbaf303e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e1b67ad-1619-4e40-906c-df31e0eab904", "address": "fa:16:3e:a7:3f:00", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e1b67ad-16", "ovs_interfaceid": "6e1b67ad-1619-4e40-906c-df31e0eab904", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converting VIF {"id": "6e1b67ad-1619-4e40-906c-df31e0eab904", "address": "fa:16:3e:a7:3f:00", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e1b67ad-16", "ovs_interfaceid": "6e1b67ad-1619-4e40-906c-df31e0eab904", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:3f:00,bridge_name='br-int',has_traffic_filtering=True,id=6e1b67ad-1619-4e40-906c-df31e0eab904,network=Network(a0d9c591-842a-4fcd-93e5-62cacb3f1d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e1b67ad-16') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG os_vif [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:3f:00,bridge_name='br-int',has_traffic_filtering=True,id=6e1b67ad-1619-4e40-906c-df31e0eab904,network=Network(a0d9c591-842a-4fcd-93e5-62cacb3f1d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e1b67ad-16') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '38cc37f1-858c-570c-be42-f0ae022c6583', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[594369fc-6cbb-449b-bfc7-c57b25d0b8ac]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e1b67ad-16, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e1b67ad-16, col_values=(('qos', UUID('5625952c-a882-43a1-a322-bb931e598e59')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e1b67ad-16, col_values=(('external_ids', {'iface-id': '6e1b67ad-1619-4e40-906c-df31e0eab904', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:3f:00', 'vm-uuid': '1372f3b7-6608-43a9-b1a5-fd7dfbaf303e'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[785a2a47-d2a1-4045-a9cb-82c69fbfa7f5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:07:29 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:07:29 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:07:29 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:07:29 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:07:29 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:07:29 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:07:29 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:07:29 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:07:29 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:07:29 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: INFO os_vif [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:3f:00,bridge_name='br-int',has_traffic_filtering=True,id=6e1b67ad-1619-4e40-906c-df31e0eab904,network=Network(a0d9c591-842a-4fcd-93e5-62cacb3f1d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e1b67ad-16')
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-967863949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-967863949',id=10,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNJQ6Ls85E20B9JwJyODLi6L5WLfy6H87RMs9k8eKydMJ8U7Bv+G1AO3XADEvyUXeKa4DqapDG0KKZB6o4L4oqqYYcjzoS5y0Gkw1mDGthLvWBxAnOCXC13OwMrt/AWCA==',key_name='tempest-keypair-2600959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='586f7ce69de240cb9e2d110530c2c7ef',ramdisk_id='',reservation_id='r-e9tvthiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-744386326',owner_user_name='tempest-TaggedBootDevicesTest-744386326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9840763db2774692ae52f8a689ed9083',uuid=1372f3b7-6608-43a9-b1a5-fd7dfbaf303e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92b697c2-8400-4b91-9fd7-53df7f47c4e0", "address": "fa:16:3e:95:8f:8d", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b697c2-84", "ovs_interfaceid": "92b697c2-8400-4b91-9fd7-53df7f47c4e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converting VIF {"id": "92b697c2-8400-4b91-9fd7-53df7f47c4e0", "address": "fa:16:3e:95:8f:8d", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b697c2-84", "ovs_interfaceid": "92b697c2-8400-4b91-9fd7-53df7f47c4e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:8f:8d,bridge_name='br-int',has_traffic_filtering=True,id=92b697c2-8400-4b91-9fd7-53df7f47c4e0,network=Network(a0d9c591-842a-4fcd-93e5-62cacb3f1d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92b697c2-84') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG os_vif [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:8f:8d,bridge_name='br-int',has_traffic_filtering=True,id=92b697c2-8400-4b91-9fd7-53df7f47c4e0,network=Network(a0d9c591-842a-4fcd-93e5-62cacb3f1d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92b697c2-84') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f528bef7-4ff1-50c4-a237-c4f16e5b0a5c', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92b697c2-84, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap92b697c2-84, col_values=(('qos', UUID('6ba55ac2-a4e2-4c2f-ad2c-d99aa527a515')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap92b697c2-84, col_values=(('external_ids', {'iface-id': '92b697c2-8400-4b91-9fd7-53df7f47c4e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:8f:8d', 'vm-uuid': '1372f3b7-6608-43a9-b1a5-fd7dfbaf303e'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a0e13f-fbdc-46c9-8a1e-78f6db6f49d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762, portal: 172.16.0.220,3260]
Dec 01 17:07:29 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762, portal: 172.16.0.220,3260] successful.
Dec 01 17:07:29 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cab4e8-6470-4032-9298-c124c659940e]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: INFO os_vif [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:8f:8d,bridge_name='br-int',has_traffic_filtering=True,id=92b697c2-8400-4b91-9fd7-53df7f47c4e0,network=Network(a0d9c591-842a-4fcd-93e5-62cacb3f1d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92b697c2-84')
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-967863949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-967863949',id=10,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNJQ6Ls85E20B9JwJyODLi6L5WLfy6H87RMs9k8eKydMJ8U7Bv+G1AO3XADEvyUXeKa4DqapDG0KKZB6o4L4oqqYYcjzoS5y0Gkw1mDGthLvWBxAnOCXC13OwMrt/AWCA==',key_name='tempest-keypair-2600959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='586f7ce69de240cb9e2d110530c2c7ef',ramdisk_id='',reservation_id='r-e9tvthiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-744386326',owner_user_name='tempest-TaggedBootDevicesTest-744386326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9840763db2774692ae52f8a689ed9083',uuid=1372f3b7-6608-43a9-b1a5-fd7dfbaf303e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f79cb7e-7ef6-4e1a-a241-780713de2217", "address": "fa:16:3e:ef:c2:b4", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f79cb7e-7e", "ovs_interfaceid": "9f79cb7e-7ef6-4e1a-a241-780713de2217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converting VIF {"id": "9f79cb7e-7ef6-4e1a-a241-780713de2217", "address": "fa:16:3e:ef:c2:b4", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f79cb7e-7e", "ovs_interfaceid": "9f79cb7e-7ef6-4e1a-a241-780713de2217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c2:b4,bridge_name='br-int',has_traffic_filtering=True,id=9f79cb7e-7ef6-4e1a-a241-780713de2217,network=Network(a0d9c591-842a-4fcd-93e5-62cacb3f1d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f79cb7e-7e') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG os_vif [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c2:b4,bridge_name='br-int',has_traffic_filtering=True,id=9f79cb7e-7ef6-4e1a-a241-780713de2217,network=Network(a0d9c591-842a-4fcd-93e5-62cacb3f1d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f79cb7e-7e') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1da9b8d8-0d08-5eb1-bacd-29d21d9101c7', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ebbaae-84f1-4309-9212-5e9c89a3bf23]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:07:29 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:07:29 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:07:29 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:07:29 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:07:29 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:07:29 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:07:29 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:07:29 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:07:29 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:07:29 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:07:29 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:07:29 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[48168245-326a-4c11-b062-468ebb055234]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jCHLSPqX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f79cb7e-7e, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9f79cb7e-7e, col_values=(('qos', UUID('7beb321c-7567-4411-a378-4c964b4d233e')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9f79cb7e-7e, col_values=(('external_ids', {'iface-id': '9f79cb7e-7ef6-4e1a-a241-780713de2217', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:c2:b4', 'vm-uuid': '1372f3b7-6608-43a9-b1a5-fd7dfbaf303e'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: INFO os_vif [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c2:b4,bridge_name='br-int',has_traffic_filtering=True,id=9f79cb7e-7ef6-4e1a-a241-780713de2217,network=Network(a0d9c591-842a-4fcd-93e5-62cacb3f1d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f79cb7e-7e')
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-967863949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-967863949',id=10,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNJQ6Ls85E20B9JwJyODLi6L5WLfy6H87RMs9k8eKydMJ8U7Bv+G1AO3XADEvyUXeKa4DqapDG0KKZB6o4L4oqqYYcjzoS5y0Gkw1mDGthLvWBxAnOCXC13OwMrt/AWCA==',key_name='tempest-keypair-2600959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='586f7ce69de240cb9e2d110530c2c7ef',ramdisk_id='',reservation_id='r-e9tvthiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-744386326',owner_user_name='tempest-TaggedBootDevicesTest-744386326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9840763db2774692ae52f8a689ed9083',uuid=1372f3b7-6608-43a9-b1a5-fd7dfbaf303e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b6cfe1f-9722-41e1-9679-52398359a035", "address": "fa:16:3e:7c:30:af", "network": {"id": "32d435b7-174b-4e6c-9165-315876fea12a", "bridge": "br-int", "label": "tempest-device-tagging-net2-658876998", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6cfe1f-97", "ovs_interfaceid": "4b6cfe1f-9722-41e1-9679-52398359a035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converting VIF {"id": "4b6cfe1f-9722-41e1-9679-52398359a035", "address": "fa:16:3e:7c:30:af", "network": {"id": "32d435b7-174b-4e6c-9165-315876fea12a", "bridge": "br-int", "label": "tempest-device-tagging-net2-658876998", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6cfe1f-97", "ovs_interfaceid": "4b6cfe1f-9722-41e1-9679-52398359a035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:30:af,bridge_name='br-int',has_traffic_filtering=True,id=4b6cfe1f-9722-41e1-9679-52398359a035,network=Network(32d435b7-174b-4e6c-9165-315876fea12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b6cfe1f-97') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG os_vif [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:30:af,bridge_name='br-int',has_traffic_filtering=True,id=4b6cfe1f-9722-41e1-9679-52398359a035,network=Network(32d435b7-174b-4e6c-9165-315876fea12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b6cfe1f-97') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b7564f02-a2d6-58af-aabd-5c4b4b2354ef', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b6cfe1f-97, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4b6cfe1f-97, col_values=(('qos', UUID('fd3c2b47-836f-45b6-8d18-ab576de2a50e')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4b6cfe1f-97, col_values=(('external_ids', {'iface-id': '4b6cfe1f-9722-41e1-9679-52398359a035', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:30:af', 'vm-uuid': '1372f3b7-6608-43a9-b1a5-fd7dfbaf303e'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: INFO os_vif [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:30:af,bridge_name='br-int',has_traffic_filtering=True,id=4b6cfe1f-9722-41e1-9679-52398359a035,network=Network(32d435b7-174b-4e6c-9165-315876fea12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b6cfe1f-97')
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-967863949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-967863949',id=10,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNJQ6Ls85E20B9JwJyODLi6L5WLfy6H87RMs9k8eKydMJ8U7Bv+G1AO3XADEvyUXeKa4DqapDG0KKZB6o4L4oqqYYcjzoS5y0Gkw1mDGthLvWBxAnOCXC13OwMrt/AWCA==',key_name='tempest-keypair-2600959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='586f7ce69de240cb9e2d110530c2c7ef',ramdisk_id='',reservation_id='r-e9tvthiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-744386326',owner_user_name='tempest-TaggedBootDevicesTest-744386326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9840763db2774692ae52f8a689ed9083',uuid=1372f3b7-6608-43a9-b1a5-fd7dfbaf303e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2f8e363-9e49-43ae-b61b-7ff8893c9f8f", "address": "fa:16:3e:20:41:d6", "network": {"id": "32d435b7-174b-4e6c-9165-315876fea12a", "bridge": "br-int", "label": "tempest-device-tagging-net2-658876998", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f8e363-9e", "ovs_interfaceid": "f2f8e363-9e49-43ae-b61b-7ff8893c9f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converting VIF {"id": "f2f8e363-9e49-43ae-b61b-7ff8893c9f8f", "address": "fa:16:3e:20:41:d6", "network": {"id": "32d435b7-174b-4e6c-9165-315876fea12a", "bridge": "br-int", "label": "tempest-device-tagging-net2-658876998", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f8e363-9e", "ovs_interfaceid": "f2f8e363-9e49-43ae-b61b-7ff8893c9f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:41:d6,bridge_name='br-int',has_traffic_filtering=True,id=f2f8e363-9e49-43ae-b61b-7ff8893c9f8f,network=Network(32d435b7-174b-4e6c-9165-315876fea12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2f8e363-9e') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG os_vif [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:41:d6,bridge_name='br-int',has_traffic_filtering=True,id=f2f8e363-9e49-43ae-b61b-7ff8893c9f8f,network=Network(32d435b7-174b-4e6c-9165-315876fea12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2f8e363-9e') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e305cf65-7e73-52cc-941e-631874680c34', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2f8e363-9e, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf2f8e363-9e, col_values=(('qos', UUID('faf0ac2e-6a08-46bf-b139-9488a7cf16d8')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf2f8e363-9e, col_values=(('external_ids', {'iface-id': 'f2f8e363-9e49-43ae-b61b-7ff8893c9f8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:41:d6', 'vm-uuid': '1372f3b7-6608-43a9-b1a5-fd7dfbaf303e'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:29 user nova-compute[75745]: INFO os_vif [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:41:d6,bridge_name='br-int',has_traffic_filtering=True,id=f2f8e363-9e49-43ae-b61b-7ff8893c9f8f,network=Network(32d435b7-174b-4e6c-9165-315876fea12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2f8e363-9e')
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] No BDM found with device name hda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] No VIF found with MAC fa:16:3e:09:96:2e, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:07:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] No VIF found with MAC fa:16:3e:ef:c2:b4, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:07:29 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Using config drive
Dec 01 17:07:30 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Creating config drive at /opt/stack/data/nova/instances/1372f3b7-6608-43a9-b1a5-fd7dfbaf303e/disk.config
Dec 01 17:07:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1372f3b7-6608-43a9-b1a5-fd7dfbaf303e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmph66jykn4 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1372f3b7-6608-43a9-b1a5-fd7dfbaf303e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmph66jykn4" returned: 0 in 0.061s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] <== connect_volume: return (2653ms) {'type': 'block', 'scsi_wwn': '26461363765633263', 'path': '/dev/sdg'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461363765633263', 'path': '/dev/sdg'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-167593192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-167593192',id=11,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2S2wrkFBC9gY+Oe2HeW09yg38m59m78rYiqY7RnrDbPltQD4fWEhA5ttMZ/yujzCosNKXVpUVdmyGZKVGT7vN2JsjNz8AoSe3JK/sCACYt+isKHoPZHOig/W1x5tQ1pA==',key_name='tempest-keypair-2095316425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75997c4cca1f4ebc9037a6dfc36a92b4',ramdisk_id='',reservation_id='r-z06l84ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-310064596',owner_user_name='tempest-TaggedBootDevicesTest_v242-310064596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c78ca75618254393ab729856fb8905b7',uuid=5c6c7551-7045-4129-9908-c0c6fbd93124,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de0d310c-2bc9-4434-8b2b-253a88febaa0", "address": "fa:16:3e:3f:e1:39", "network": {"id": "8d239238-e90b-4408-86f0-a143eb9ac337", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1071206325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0d310c-2b", "ovs_interfaceid": "de0d310c-2bc9-4434-8b2b-253a88febaa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converting VIF {"id": "de0d310c-2bc9-4434-8b2b-253a88febaa0", "address": "fa:16:3e:3f:e1:39", "network": {"id": "8d239238-e90b-4408-86f0-a143eb9ac337", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1071206325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0d310c-2b", "ovs_interfaceid": "de0d310c-2bc9-4434-8b2b-253a88febaa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:e1:39,bridge_name='br-int',has_traffic_filtering=True,id=de0d310c-2bc9-4434-8b2b-253a88febaa0,network=Network(8d239238-e90b-4408-86f0-a143eb9ac337),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde0d310c-2b') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-167593192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-167593192',id=11,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2S2wrkFBC9gY+Oe2HeW09yg38m59m78rYiqY7RnrDbPltQD4fWEhA5ttMZ/yujzCosNKXVpUVdmyGZKVGT7vN2JsjNz8AoSe3JK/sCACYt+isKHoPZHOig/W1x5tQ1pA==',key_name='tempest-keypair-2095316425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75997c4cca1f4ebc9037a6dfc36a92b4',ramdisk_id='',reservation_id='r-z06l84ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-310064596',owner_user_name='tempest-TaggedBootDevicesTest_v242-310064596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c78ca75618254393ab729856fb8905b7',uuid=5c6c7551-7045-4129-9908-c0c6fbd93124,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5ecb053-fd41-42ea-8abe-4c504b6c7882", "address": "fa:16:3e:56:bb:b9", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5ecb053-fd", "ovs_interfaceid": "a5ecb053-fd41-42ea-8abe-4c504b6c7882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converting VIF {"id": "a5ecb053-fd41-42ea-8abe-4c504b6c7882", "address": "fa:16:3e:56:bb:b9", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5ecb053-fd", "ovs_interfaceid": "a5ecb053-fd41-42ea-8abe-4c504b6c7882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:bb:b9,bridge_name='br-int',has_traffic_filtering=True,id=a5ecb053-fd41-42ea-8abe-4c504b6c7882,network=Network(027c842b-831c-4cd4-8a9f-cca60bb6b647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa5ecb053-fd') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-167593192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-167593192',id=11,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2S2wrkFBC9gY+Oe2HeW09yg38m59m78rYiqY7RnrDbPltQD4fWEhA5ttMZ/yujzCosNKXVpUVdmyGZKVGT7vN2JsjNz8AoSe3JK/sCACYt+isKHoPZHOig/W1x5tQ1pA==',key_name='tempest-keypair-2095316425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75997c4cca1f4ebc9037a6dfc36a92b4',ramdisk_id='',reservation_id='r-z06l84ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-310064596',owner_user_name='tempest-TaggedBootDevicesTest_v242-310064596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c78ca75618254393ab729856fb8905b7',uuid=5c6c7551-7045-4129-9908-c0c6fbd93124,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4bc79fe9-e1e7-4040-ae00-e231301a8c58", "address": "fa:16:3e:b8:6d:f8", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc79fe9-e1", "ovs_interfaceid": "4bc79fe9-e1e7-4040-ae00-e231301a8c58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converting VIF {"id": "4bc79fe9-e1e7-4040-ae00-e231301a8c58", "address": "fa:16:3e:b8:6d:f8", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc79fe9-e1", "ovs_interfaceid": "4bc79fe9-e1e7-4040-ae00-e231301a8c58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:6d:f8,bridge_name='br-int',has_traffic_filtering=True,id=4bc79fe9-e1e7-4040-ae00-e231301a8c58,network=Network(027c842b-831c-4cd4-8a9f-cca60bb6b647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4bc79fe9-e1') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-167593192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-167593192',id=11,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2S2wrkFBC9gY+Oe2HeW09yg38m59m78rYiqY7RnrDbPltQD4fWEhA5ttMZ/yujzCosNKXVpUVdmyGZKVGT7vN2JsjNz8AoSe3JK/sCACYt+isKHoPZHOig/W1x5tQ1pA==',key_name='tempest-keypair-2095316425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75997c4cca1f4ebc9037a6dfc36a92b4',ramdisk_id='',reservation_id='r-z06l84ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-310064596',owner_user_name='tempest-TaggedBootDevicesTest_v242-310064596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c78ca75618254393ab729856fb8905b7',uuid=5c6c7551-7045-4129-9908-c0c6fbd93124,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d9f0b3d-a677-4db0-a8be-b19006908125", "address": "fa:16:3e:d2:26:2b", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d9f0b3d-a6", "ovs_interfaceid": "9d9f0b3d-a677-4db0-a8be-b19006908125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converting VIF {"id": "9d9f0b3d-a677-4db0-a8be-b19006908125", "address": "fa:16:3e:d2:26:2b", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d9f0b3d-a6", "ovs_interfaceid": "9d9f0b3d-a677-4db0-a8be-b19006908125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:26:2b,bridge_name='br-int',has_traffic_filtering=True,id=9d9f0b3d-a677-4db0-a8be-b19006908125,network=Network(027c842b-831c-4cd4-8a9f-cca60bb6b647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d9f0b3d-a6') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-167593192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-167593192',id=11,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2S2wrkFBC9gY+Oe2HeW09yg38m59m78rYiqY7RnrDbPltQD4fWEhA5ttMZ/yujzCosNKXVpUVdmyGZKVGT7vN2JsjNz8AoSe3JK/sCACYt+isKHoPZHOig/W1x5tQ1pA==',key_name='tempest-keypair-2095316425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75997c4cca1f4ebc9037a6dfc36a92b4',ramdisk_id='',reservation_id='r-z06l84ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-310064596',owner_user_name='tempest-TaggedBootDevicesTest_v242-310064596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c78ca75618254393ab729856fb8905b7',uuid=5c6c7551-7045-4129-9908-c0c6fbd93124,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "754453de-6c68-4cdd-acc4-2307e4b6d3d2", "address": "fa:16:3e:e2:b2:aa", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap754453de-6c", "ovs_interfaceid": "754453de-6c68-4cdd-acc4-2307e4b6d3d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converting VIF {"id": "754453de-6c68-4cdd-acc4-2307e4b6d3d2", "address": "fa:16:3e:e2:b2:aa", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap754453de-6c", "ovs_interfaceid": "754453de-6c68-4cdd-acc4-2307e4b6d3d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:b2:aa,bridge_name='br-int',has_traffic_filtering=True,id=754453de-6c68-4cdd-acc4-2307e4b6d3d2,network=Network(027c842b-831c-4cd4-8a9f-cca60bb6b647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap754453de-6c') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-167593192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-167593192',id=11,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2S2wrkFBC9gY+Oe2HeW09yg38m59m78rYiqY7RnrDbPltQD4fWEhA5ttMZ/yujzCosNKXVpUVdmyGZKVGT7vN2JsjNz8AoSe3JK/sCACYt+isKHoPZHOig/W1x5tQ1pA==',key_name='tempest-keypair-2095316425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75997c4cca1f4ebc9037a6dfc36a92b4',ramdisk_id='',reservation_id='r-z06l84ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-310064596',owner_user_name='tempest-TaggedBootDevicesTest_v242-310064596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c78ca75618254393ab729856fb8905b7',uuid=5c6c7551-7045-4129-9908-c0c6fbd93124,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "847be9c3-c4d1-4280-8b85-56697d11a876", "address": "fa:16:3e:67:52:ab", "network": {"id": "2a7db2ed-f938-42c6-b85c-8a94ac2717a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-811431562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap847be9c3-c4", "ovs_interfaceid": "847be9c3-c4d1-4280-8b85-56697d11a876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converting VIF {"id": "847be9c3-c4d1-4280-8b85-56697d11a876", "address": "fa:16:3e:67:52:ab", "network": {"id": "2a7db2ed-f938-42c6-b85c-8a94ac2717a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-811431562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap847be9c3-c4", "ovs_interfaceid": "847be9c3-c4d1-4280-8b85-56697d11a876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:52:ab,bridge_name='br-int',has_traffic_filtering=True,id=847be9c3-c4d1-4280-8b85-56697d11a876,network=Network(2a7db2ed-f938-42c6-b85c-8a94ac2717a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap847be9c3-c4') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-167593192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-167593192',id=11,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2S2wrkFBC9gY+Oe2HeW09yg38m59m78rYiqY7RnrDbPltQD4fWEhA5ttMZ/yujzCosNKXVpUVdmyGZKVGT7vN2JsjNz8AoSe3JK/sCACYt+isKHoPZHOig/W1x5tQ1pA==',key_name='tempest-keypair-2095316425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75997c4cca1f4ebc9037a6dfc36a92b4',ramdisk_id='',reservation_id='r-z06l84ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-310064596',owner_user_name='tempest-TaggedBootDevicesTest_v242-310064596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c78ca75618254393ab729856fb8905b7',uuid=5c6c7551-7045-4129-9908-c0c6fbd93124,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6812409-296e-40f5-bdfc-b7cedf33f85b", "address": "fa:16:3e:db:bf:df", "network": {"id": "2a7db2ed-f938-42c6-b85c-8a94ac2717a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-811431562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6812409-29", "ovs_interfaceid": "c6812409-296e-40f5-bdfc-b7cedf33f85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converting VIF {"id": "c6812409-296e-40f5-bdfc-b7cedf33f85b", "address": "fa:16:3e:db:bf:df", "network": {"id": "2a7db2ed-f938-42c6-b85c-8a94ac2717a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-811431562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6812409-29", "ovs_interfaceid": "c6812409-296e-40f5-bdfc-b7cedf33f85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:bf:df,bridge_name='br-int',has_traffic_filtering=True,id=c6812409-296e-40f5-bdfc-b7cedf33f85b,network=Network(2a7db2ed-f938-42c6-b85c-8a94ac2717a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6812409-29') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG nova.objects.instance [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c6c7551-7045-4129-9908-c0c6fbd93124 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:07:30 user nova-compute[75745]:   <uuid>5c6c7551-7045-4129-9908-c0c6fbd93124</uuid>
Dec 01 17:07:30 user nova-compute[75745]:   <name>instance-0000000b</name>
Dec 01 17:07:30 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:07:30 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:07:30 user nova-compute[75745]:   <metadata>
Dec 01 17:07:30 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:07:30 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:07:30 user nova-compute[75745]:       <nova:name>tempest-device-tagging-server-167593192</nova:name>
Dec 01 17:07:30 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:07:23</nova:creationTime>
Dec 01 17:07:30 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:07:30 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:07:30 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:07:30 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:07:30 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:07:30 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:07:30 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:07:30 user nova-compute[75745]:       <nova:owner>
Dec 01 17:07:30 user nova-compute[75745]:         <nova:user uuid="c78ca75618254393ab729856fb8905b7">tempest-TaggedBootDevicesTest_v242-310064596-project-member</nova:user>
Dec 01 17:07:30 user nova-compute[75745]:         <nova:project uuid="75997c4cca1f4ebc9037a6dfc36a92b4">tempest-TaggedBootDevicesTest_v242-310064596</nova:project>
Dec 01 17:07:30 user nova-compute[75745]:       </nova:owner>
Dec 01 17:07:30 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:07:30 user nova-compute[75745]:       <nova:ports>
Dec 01 17:07:30 user nova-compute[75745]:         <nova:port uuid="de0d310c-2bc9-4434-8b2b-253a88febaa0">
Dec 01 17:07:30 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 01 17:07:30 user nova-compute[75745]:         </nova:port>
Dec 01 17:07:30 user nova-compute[75745]:         <nova:port uuid="a5ecb053-fd41-42ea-8abe-4c504b6c7882">
Dec 01 17:07:30 user nova-compute[75745]:           <nova:ip type="fixed" address="10.1.1.179" ipVersion="4"/>
Dec 01 17:07:30 user nova-compute[75745]:         </nova:port>
Dec 01 17:07:30 user nova-compute[75745]:         <nova:port uuid="4bc79fe9-e1e7-4040-ae00-e231301a8c58">
Dec 01 17:07:30 user nova-compute[75745]:           <nova:ip type="fixed" address="10.1.1.230" ipVersion="4"/>
Dec 01 17:07:30 user nova-compute[75745]:         </nova:port>
Dec 01 17:07:30 user nova-compute[75745]:         <nova:port uuid="9d9f0b3d-a677-4db0-a8be-b19006908125">
Dec 01 17:07:30 user nova-compute[75745]:           <nova:ip type="fixed" address="10.1.1.12" ipVersion="4"/>
Dec 01 17:07:30 user nova-compute[75745]:         </nova:port>
Dec 01 17:07:30 user nova-compute[75745]:         <nova:port uuid="754453de-6c68-4cdd-acc4-2307e4b6d3d2">
Dec 01 17:07:30 user nova-compute[75745]:           <nova:ip type="fixed" address="10.1.1.149" ipVersion="4"/>
Dec 01 17:07:30 user nova-compute[75745]:         </nova:port>
Dec 01 17:07:30 user nova-compute[75745]:         <nova:port uuid="847be9c3-c4d1-4280-8b85-56697d11a876">
Dec 01 17:07:30 user nova-compute[75745]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Dec 01 17:07:30 user nova-compute[75745]:         </nova:port>
Dec 01 17:07:30 user nova-compute[75745]:         <nova:port uuid="c6812409-296e-40f5-bdfc-b7cedf33f85b">
Dec 01 17:07:30 user nova-compute[75745]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Dec 01 17:07:30 user nova-compute[75745]:         </nova:port>
Dec 01 17:07:30 user nova-compute[75745]:       </nova:ports>
Dec 01 17:07:30 user nova-compute[75745]:     </nova:instance>
Dec 01 17:07:30 user nova-compute[75745]:   </metadata>
Dec 01 17:07:30 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:07:30 user nova-compute[75745]:     <system>
Dec 01 17:07:30 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:07:30 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:07:30 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:07:30 user nova-compute[75745]:       <entry name="serial">5c6c7551-7045-4129-9908-c0c6fbd93124</entry>
Dec 01 17:07:30 user nova-compute[75745]:       <entry name="uuid">5c6c7551-7045-4129-9908-c0c6fbd93124</entry>
Dec 01 17:07:30 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:07:30 user nova-compute[75745]:     </system>
Dec 01 17:07:30 user nova-compute[75745]:   </sysinfo>
Dec 01 17:07:30 user nova-compute[75745]:   <os>
Dec 01 17:07:30 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:07:30 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:07:30 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:07:30 user nova-compute[75745]:   </os>
Dec 01 17:07:30 user nova-compute[75745]:   <features>
Dec 01 17:07:30 user nova-compute[75745]:     <acpi/>
Dec 01 17:07:30 user nova-compute[75745]:     <apic/>
Dec 01 17:07:30 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:07:30 user nova-compute[75745]:   </features>
Dec 01 17:07:30 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:07:30 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:07:30 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:07:30 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:07:30 user nova-compute[75745]:   </clock>
Dec 01 17:07:30 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:07:30 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:07:30 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:07:30 user nova-compute[75745]:   </cpu>
Dec 01 17:07:30 user nova-compute[75745]:   <devices>
Dec 01 17:07:30 user nova-compute[75745]:     <disk type="file" device="cdrom">
Dec 01 17:07:30 user nova-compute[75745]:       <driver name="qemu" type="raw" cache="none"/>
Dec 01 17:07:30 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/5c6c7551-7045-4129-9908-c0c6fbd93124/disk.config"/>
Dec 01 17:07:30 user nova-compute[75745]:       <target dev="hda" bus="ide"/>
Dec 01 17:07:30 user nova-compute[75745]:     </disk>
Dec 01 17:07:30 user nova-compute[75745]:     <disk type="block" device="disk">
Dec 01 17:07:30 user nova-compute[75745]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:07:30 user nova-compute[75745]:       <source dev="/dev/sdc"/>
Dec 01 17:07:30 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:07:30 user nova-compute[75745]:       <serial>40deba30-bea8-4474-9760-b572f1f764de</serial>
Dec 01 17:07:30 user nova-compute[75745]:     </disk>
Dec 01 17:07:30 user nova-compute[75745]:     <disk type="block" device="disk">
Dec 01 17:07:30 user nova-compute[75745]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:07:30 user nova-compute[75745]:       <source dev="/dev/sde"/>
Dec 01 17:07:30 user nova-compute[75745]:       <target dev="vdb" bus="virtio"/>
Dec 01 17:07:30 user nova-compute[75745]:       <serial>beb5e348-2521-40cf-99fe-4bf8f351e749</serial>
Dec 01 17:07:30 user nova-compute[75745]:     </disk>
Dec 01 17:07:30 user nova-compute[75745]:     <disk type="block" device="disk">
Dec 01 17:07:30 user nova-compute[75745]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:07:30 user nova-compute[75745]:       <source dev="/dev/sdg"/>
Dec 01 17:07:30 user nova-compute[75745]:       <target dev="vdc" bus="virtio"/>
Dec 01 17:07:30 user nova-compute[75745]:       <serial>7b42faef-d887-46fe-b858-224dcdfad762</serial>
Dec 01 17:07:30 user nova-compute[75745]:     </disk>
Dec 01 17:07:30 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:07:30 user nova-compute[75745]:       <mac address="fa:16:3e:3f:e1:39"/>
Dec 01 17:07:30 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:07:30 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:07:30 user nova-compute[75745]:       <target dev="tapde0d310c-2b"/>
Dec 01 17:07:30 user nova-compute[75745]:     </interface>
Dec 01 17:07:30 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:07:30 user nova-compute[75745]:       <mac address="fa:16:3e:56:bb:b9"/>
Dec 01 17:07:30 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:07:30 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:07:30 user nova-compute[75745]:       <target dev="tapa5ecb053-fd"/>
Dec 01 17:07:30 user nova-compute[75745]:     </interface>
Dec 01 17:07:30 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:07:30 user nova-compute[75745]:       <mac address="fa:16:3e:b8:6d:f8"/>
Dec 01 17:07:30 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:07:30 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:07:30 user nova-compute[75745]:       <target dev="tap4bc79fe9-e1"/>
Dec 01 17:07:30 user nova-compute[75745]:     </interface>
Dec 01 17:07:30 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:07:30 user nova-compute[75745]:       <mac address="fa:16:3e:d2:26:2b"/>
Dec 01 17:07:30 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:07:30 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:07:30 user nova-compute[75745]:       <target dev="tap9d9f0b3d-a6"/>
Dec 01 17:07:30 user nova-compute[75745]:     </interface>
Dec 01 17:07:30 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:07:30 user nova-compute[75745]:       <mac address="fa:16:3e:e2:b2:aa"/>
Dec 01 17:07:30 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:07:30 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:07:30 user nova-compute[75745]:       <target dev="tap754453de-6c"/>
Dec 01 17:07:30 user nova-compute[75745]:     </interface>
Dec 01 17:07:30 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:07:30 user nova-compute[75745]:       <mac address="fa:16:3e:67:52:ab"/>
Dec 01 17:07:30 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:07:30 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:07:30 user nova-compute[75745]:       <target dev="tap847be9c3-c4"/>
Dec 01 17:07:30 user nova-compute[75745]:     </interface>
Dec 01 17:07:30 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:07:30 user nova-compute[75745]:       <mac address="fa:16:3e:db:bf:df"/>
Dec 01 17:07:30 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:07:30 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:07:30 user nova-compute[75745]:       <target dev="tapc6812409-29"/>
Dec 01 17:07:30 user nova-compute[75745]:     </interface>
Dec 01 17:07:30 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:07:30 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/5c6c7551-7045-4129-9908-c0c6fbd93124/console.log" append="off"/>
Dec 01 17:07:30 user nova-compute[75745]:     </serial>
Dec 01 17:07:30 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:07:30 user nova-compute[75745]:     <video>
Dec 01 17:07:30 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:07:30 user nova-compute[75745]:     </video>
Dec 01 17:07:30 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:07:30 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:07:30 user nova-compute[75745]:     </rng>
Dec 01 17:07:30 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:07:30 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:07:30 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:07:30 user nova-compute[75745]:     </memballoon>
Dec 01 17:07:30 user nova-compute[75745]:   </devices>
Dec 01 17:07:30 user nova-compute[75745]: </domain>
Dec 01 17:07:30 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-167593192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-167593192',id=11,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2S2wrkFBC9gY+Oe2HeW09yg38m59m78rYiqY7RnrDbPltQD4fWEhA5ttMZ/yujzCosNKXVpUVdmyGZKVGT7vN2JsjNz8AoSe3JK/sCACYt+isKHoPZHOig/W1x5tQ1pA==',key_name='tempest-keypair-2095316425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75997c4cca1f4ebc9037a6dfc36a92b4',ramdisk_id='',reservation_id='r-z06l84ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-310064596',owner_user_name='tempest-TaggedBootDevicesTest_v242-310064596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c78ca75618254393ab729856fb8905b7',uuid=5c6c7551-7045-4129-9908-c0c6fbd93124,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de0d310c-2bc9-4434-8b2b-253a88febaa0", "address": "fa:16:3e:3f:e1:39", "network": {"id": "8d239238-e90b-4408-86f0-a143eb9ac337", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1071206325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0d310c-2b", "ovs_interfaceid": "de0d310c-2bc9-4434-8b2b-253a88febaa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converting VIF {"id": "de0d310c-2bc9-4434-8b2b-253a88febaa0", "address": "fa:16:3e:3f:e1:39", "network": {"id": "8d239238-e90b-4408-86f0-a143eb9ac337", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1071206325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0d310c-2b", "ovs_interfaceid": "de0d310c-2bc9-4434-8b2b-253a88febaa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:e1:39,bridge_name='br-int',has_traffic_filtering=True,id=de0d310c-2bc9-4434-8b2b-253a88febaa0,network=Network(8d239238-e90b-4408-86f0-a143eb9ac337),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde0d310c-2b') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG os_vif [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:e1:39,bridge_name='br-int',has_traffic_filtering=True,id=de0d310c-2bc9-4434-8b2b-253a88febaa0,network=Network(8d239238-e90b-4408-86f0-a143eb9ac337),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde0d310c-2b') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '54053279-8cca-5fa1-b16e-214717e84d0a', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde0d310c-2b, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapde0d310c-2b, col_values=(('qos', UUID('30c02b78-ea89-4ca8-8dcc-8582af0ed0ee')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapde0d310c-2b, col_values=(('external_ids', {'iface-id': 'de0d310c-2bc9-4434-8b2b-253a88febaa0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:e1:39', 'vm-uuid': '5c6c7551-7045-4129-9908-c0c6fbd93124'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:30 user nova-compute[75745]: INFO os_vif [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:e1:39,bridge_name='br-int',has_traffic_filtering=True,id=de0d310c-2bc9-4434-8b2b-253a88febaa0,network=Network(8d239238-e90b-4408-86f0-a143eb9ac337),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde0d310c-2b')
Dec 01 17:07:30 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-167593192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-167593192',id=11,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2S2wrkFBC9gY+Oe2HeW09yg38m59m78rYiqY7RnrDbPltQD4fWEhA5ttMZ/yujzCosNKXVpUVdmyGZKVGT7vN2JsjNz8AoSe3JK/sCACYt+isKHoPZHOig/W1x5tQ1pA==',key_name='tempest-keypair-2095316425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75997c4cca1f4ebc9037a6dfc36a92b4',ramdisk_id='',reservation_id='r-z06l84ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-310064596',owner_user_name='tempest-TaggedBootDevicesTest_v242-310064596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c78ca75618254393ab729856fb8905b7',uuid=5c6c7551-7045-4129-9908-c0c6fbd93124,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5ecb053-fd41-42ea-8abe-4c504b6c7882", "address": "fa:16:3e:56:bb:b9", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5ecb053-fd", "ovs_interfaceid": "a5ecb053-fd41-42ea-8abe-4c504b6c7882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converting VIF {"id": "a5ecb053-fd41-42ea-8abe-4c504b6c7882", "address": "fa:16:3e:56:bb:b9", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5ecb053-fd", "ovs_interfaceid": "a5ecb053-fd41-42ea-8abe-4c504b6c7882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:bb:b9,bridge_name='br-int',has_traffic_filtering=True,id=a5ecb053-fd41-42ea-8abe-4c504b6c7882,network=Network(027c842b-831c-4cd4-8a9f-cca60bb6b647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa5ecb053-fd') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG os_vif [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:bb:b9,bridge_name='br-int',has_traffic_filtering=True,id=a5ecb053-fd41-42ea-8abe-4c504b6c7882,network=Network(027c842b-831c-4cd4-8a9f-cca60bb6b647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa5ecb053-fd') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7d6058bb-53ad-5204-83f8-3d6a05c5844c', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5ecb053-fd, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa5ecb053-fd, col_values=(('qos', UUID('22471f14-ecdb-48a3-b8f0-504d8ff9b4fc')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa5ecb053-fd, col_values=(('external_ids', {'iface-id': 'a5ecb053-fd41-42ea-8abe-4c504b6c7882', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:bb:b9', 'vm-uuid': '5c6c7551-7045-4129-9908-c0c6fbd93124'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:31 user nova-compute[75745]: INFO os_vif [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:bb:b9,bridge_name='br-int',has_traffic_filtering=True,id=a5ecb053-fd41-42ea-8abe-4c504b6c7882,network=Network(027c842b-831c-4cd4-8a9f-cca60bb6b647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa5ecb053-fd')
Dec 01 17:07:31 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-167593192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-167593192',id=11,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2S2wrkFBC9gY+Oe2HeW09yg38m59m78rYiqY7RnrDbPltQD4fWEhA5ttMZ/yujzCosNKXVpUVdmyGZKVGT7vN2JsjNz8AoSe3JK/sCACYt+isKHoPZHOig/W1x5tQ1pA==',key_name='tempest-keypair-2095316425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75997c4cca1f4ebc9037a6dfc36a92b4',ramdisk_id='',reservation_id='r-z06l84ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-310064596',owner_user_name='tempest-TaggedBootDevicesTest_v242-310064596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c78ca75618254393ab729856fb8905b7',uuid=5c6c7551-7045-4129-9908-c0c6fbd93124,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4bc79fe9-e1e7-4040-ae00-e231301a8c58", "address": "fa:16:3e:b8:6d:f8", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc79fe9-e1", "ovs_interfaceid": "4bc79fe9-e1e7-4040-ae00-e231301a8c58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converting VIF {"id": "4bc79fe9-e1e7-4040-ae00-e231301a8c58", "address": "fa:16:3e:b8:6d:f8", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc79fe9-e1", "ovs_interfaceid": "4bc79fe9-e1e7-4040-ae00-e231301a8c58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:6d:f8,bridge_name='br-int',has_traffic_filtering=True,id=4bc79fe9-e1e7-4040-ae00-e231301a8c58,network=Network(027c842b-831c-4cd4-8a9f-cca60bb6b647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4bc79fe9-e1') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG os_vif [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:6d:f8,bridge_name='br-int',has_traffic_filtering=True,id=4bc79fe9-e1e7-4040-ae00-e231301a8c58,network=Network(027c842b-831c-4cd4-8a9f-cca60bb6b647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4bc79fe9-e1') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa780efb-d090-5919-abb4-d42c33504623', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4bc79fe9-e1, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4bc79fe9-e1, col_values=(('qos', UUID('28c2586f-087a-4be6-88dc-5cda86df6d39')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4bc79fe9-e1, col_values=(('external_ids', {'iface-id': '4bc79fe9-e1e7-4040-ae00-e231301a8c58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:6d:f8', 'vm-uuid': '5c6c7551-7045-4129-9908-c0c6fbd93124'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:31 user nova-compute[75745]: INFO os_vif [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:6d:f8,bridge_name='br-int',has_traffic_filtering=True,id=4bc79fe9-e1e7-4040-ae00-e231301a8c58,network=Network(027c842b-831c-4cd4-8a9f-cca60bb6b647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4bc79fe9-e1')
Dec 01 17:07:31 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-167593192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-167593192',id=11,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2S2wrkFBC9gY+Oe2HeW09yg38m59m78rYiqY7RnrDbPltQD4fWEhA5ttMZ/yujzCosNKXVpUVdmyGZKVGT7vN2JsjNz8AoSe3JK/sCACYt+isKHoPZHOig/W1x5tQ1pA==',key_name='tempest-keypair-2095316425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75997c4cca1f4ebc9037a6dfc36a92b4',ramdisk_id='',reservation_id='r-z06l84ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-310064596',owner_user_name='tempest-TaggedBootDevicesTest_v242-310064596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c78ca75618254393ab729856fb8905b7',uuid=5c6c7551-7045-4129-9908-c0c6fbd93124,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d9f0b3d-a677-4db0-a8be-b19006908125", "address": "fa:16:3e:d2:26:2b", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d9f0b3d-a6", "ovs_interfaceid": "9d9f0b3d-a677-4db0-a8be-b19006908125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converting VIF {"id": "9d9f0b3d-a677-4db0-a8be-b19006908125", "address": "fa:16:3e:d2:26:2b", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d9f0b3d-a6", "ovs_interfaceid": "9d9f0b3d-a677-4db0-a8be-b19006908125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:26:2b,bridge_name='br-int',has_traffic_filtering=True,id=9d9f0b3d-a677-4db0-a8be-b19006908125,network=Network(027c842b-831c-4cd4-8a9f-cca60bb6b647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d9f0b3d-a6') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG os_vif [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:26:2b,bridge_name='br-int',has_traffic_filtering=True,id=9d9f0b3d-a677-4db0-a8be-b19006908125,network=Network(027c842b-831c-4cd4-8a9f-cca60bb6b647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d9f0b3d-a6') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e18b496-b379-584e-9488-3f47efd930aa', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d9f0b3d-a6, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9d9f0b3d-a6, col_values=(('qos', UUID('2ecd3204-b327-4a1a-9a9a-bc7be83c6f19')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9d9f0b3d-a6, col_values=(('external_ids', {'iface-id': '9d9f0b3d-a677-4db0-a8be-b19006908125', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:26:2b', 'vm-uuid': '5c6c7551-7045-4129-9908-c0c6fbd93124'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:31 user nova-compute[75745]: INFO os_vif [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:26:2b,bridge_name='br-int',has_traffic_filtering=True,id=9d9f0b3d-a677-4db0-a8be-b19006908125,network=Network(027c842b-831c-4cd4-8a9f-cca60bb6b647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d9f0b3d-a6')
Dec 01 17:07:31 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-167593192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-167593192',id=11,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2S2wrkFBC9gY+Oe2HeW09yg38m59m78rYiqY7RnrDbPltQD4fWEhA5ttMZ/yujzCosNKXVpUVdmyGZKVGT7vN2JsjNz8AoSe3JK/sCACYt+isKHoPZHOig/W1x5tQ1pA==',key_name='tempest-keypair-2095316425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75997c4cca1f4ebc9037a6dfc36a92b4',ramdisk_id='',reservation_id='r-z06l84ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-310064596',owner_user_name='tempest-TaggedBootDevicesTest_v242-310064596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c78ca75618254393ab729856fb8905b7',uuid=5c6c7551-7045-4129-9908-c0c6fbd93124,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "754453de-6c68-4cdd-acc4-2307e4b6d3d2", "address": "fa:16:3e:e2:b2:aa", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap754453de-6c", "ovs_interfaceid": "754453de-6c68-4cdd-acc4-2307e4b6d3d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converting VIF {"id": "754453de-6c68-4cdd-acc4-2307e4b6d3d2", "address": "fa:16:3e:e2:b2:aa", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap754453de-6c", "ovs_interfaceid": "754453de-6c68-4cdd-acc4-2307e4b6d3d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:b2:aa,bridge_name='br-int',has_traffic_filtering=True,id=754453de-6c68-4cdd-acc4-2307e4b6d3d2,network=Network(027c842b-831c-4cd4-8a9f-cca60bb6b647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap754453de-6c') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG os_vif [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:b2:aa,bridge_name='br-int',has_traffic_filtering=True,id=754453de-6c68-4cdd-acc4-2307e4b6d3d2,network=Network(027c842b-831c-4cd4-8a9f-cca60bb6b647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap754453de-6c') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a8d3fb3e-84df-5197-8ecc-cb9c21b8375c', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap754453de-6c, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap754453de-6c, col_values=(('qos', UUID('7fb0c8ff-3840-4638-b514-f092cc45abf7')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap754453de-6c, col_values=(('external_ids', {'iface-id': '754453de-6c68-4cdd-acc4-2307e4b6d3d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:b2:aa', 'vm-uuid': '5c6c7551-7045-4129-9908-c0c6fbd93124'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:31 user nova-compute[75745]: INFO os_vif [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:b2:aa,bridge_name='br-int',has_traffic_filtering=True,id=754453de-6c68-4cdd-acc4-2307e4b6d3d2,network=Network(027c842b-831c-4cd4-8a9f-cca60bb6b647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap754453de-6c')
Dec 01 17:07:31 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-167593192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-167593192',id=11,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2S2wrkFBC9gY+Oe2HeW09yg38m59m78rYiqY7RnrDbPltQD4fWEhA5ttMZ/yujzCosNKXVpUVdmyGZKVGT7vN2JsjNz8AoSe3JK/sCACYt+isKHoPZHOig/W1x5tQ1pA==',key_name='tempest-keypair-2095316425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75997c4cca1f4ebc9037a6dfc36a92b4',ramdisk_id='',reservation_id='r-z06l84ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-310064596',owner_user_name='tempest-TaggedBootDevicesTest_v242-310064596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c78ca75618254393ab729856fb8905b7',uuid=5c6c7551-7045-4129-9908-c0c6fbd93124,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "847be9c3-c4d1-4280-8b85-56697d11a876", "address": "fa:16:3e:67:52:ab", "network": {"id": "2a7db2ed-f938-42c6-b85c-8a94ac2717a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-811431562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap847be9c3-c4", "ovs_interfaceid": "847be9c3-c4d1-4280-8b85-56697d11a876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converting VIF {"id": "847be9c3-c4d1-4280-8b85-56697d11a876", "address": "fa:16:3e:67:52:ab", "network": {"id": "2a7db2ed-f938-42c6-b85c-8a94ac2717a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-811431562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap847be9c3-c4", "ovs_interfaceid": "847be9c3-c4d1-4280-8b85-56697d11a876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:52:ab,bridge_name='br-int',has_traffic_filtering=True,id=847be9c3-c4d1-4280-8b85-56697d11a876,network=Network(2a7db2ed-f938-42c6-b85c-8a94ac2717a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap847be9c3-c4') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG os_vif [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:52:ab,bridge_name='br-int',has_traffic_filtering=True,id=847be9c3-c4d1-4280-8b85-56697d11a876,network=Network(2a7db2ed-f938-42c6-b85c-8a94ac2717a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap847be9c3-c4') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e4457f1-8c25-5553-9bd5-8d091c4c45ef', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap847be9c3-c4, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap847be9c3-c4, col_values=(('qos', UUID('3af1acbb-9c3d-456c-982c-77fda28058ca')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap847be9c3-c4, col_values=(('external_ids', {'iface-id': '847be9c3-c4d1-4280-8b85-56697d11a876', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:52:ab', 'vm-uuid': '5c6c7551-7045-4129-9908-c0c6fbd93124'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG nova.compute.manager [req-003a95c4-16bf-4fcf-ae5f-d8de7ee9fbbb req-e7b992ca-e86f-4cf5-aacb-64284cd48e03 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-plugged-d7c02fc7-a4d9-4c86-b18b-cf12d101f22f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-003a95c4-16bf-4fcf-ae5f-d8de7ee9fbbb req-e7b992ca-e86f-4cf5-aacb-64284cd48e03 service nova] Acquiring lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-003a95c4-16bf-4fcf-ae5f-d8de7ee9fbbb req-e7b992ca-e86f-4cf5-aacb-64284cd48e03 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-003a95c4-16bf-4fcf-ae5f-d8de7ee9fbbb req-e7b992ca-e86f-4cf5-aacb-64284cd48e03 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG nova.compute.manager [req-003a95c4-16bf-4fcf-ae5f-d8de7ee9fbbb req-e7b992ca-e86f-4cf5-aacb-64284cd48e03 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] No waiting events found dispatching network-vif-plugged-d7c02fc7-a4d9-4c86-b18b-cf12d101f22f {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:07:32 user nova-compute[75745]: WARNING nova.compute.manager [req-003a95c4-16bf-4fcf-ae5f-d8de7ee9fbbb req-e7b992ca-e86f-4cf5-aacb-64284cd48e03 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received unexpected event network-vif-plugged-d7c02fc7-a4d9-4c86-b18b-cf12d101f22f for instance with vm_state building and task_state spawning.
Dec 01 17:07:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:32 user nova-compute[75745]: INFO os_vif [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:52:ab,bridge_name='br-int',has_traffic_filtering=True,id=847be9c3-c4d1-4280-8b85-56697d11a876,network=Network(2a7db2ed-f938-42c6-b85c-8a94ac2717a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap847be9c3-c4')
Dec 01 17:07:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-167593192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-167593192',id=11,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2S2wrkFBC9gY+Oe2HeW09yg38m59m78rYiqY7RnrDbPltQD4fWEhA5ttMZ/yujzCosNKXVpUVdmyGZKVGT7vN2JsjNz8AoSe3JK/sCACYt+isKHoPZHOig/W1x5tQ1pA==',key_name='tempest-keypair-2095316425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75997c4cca1f4ebc9037a6dfc36a92b4',ramdisk_id='',reservation_id='r-z06l84ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-310064596',owner_user_name='tempest-TaggedBootDevicesTest_v242-310064596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c78ca75618254393ab729856fb8905b7',uuid=5c6c7551-7045-4129-9908-c0c6fbd93124,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6812409-296e-40f5-bdfc-b7cedf33f85b", "address": "fa:16:3e:db:bf:df", "network": {"id": "2a7db2ed-f938-42c6-b85c-8a94ac2717a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-811431562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6812409-29", "ovs_interfaceid": "c6812409-296e-40f5-bdfc-b7cedf33f85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converting VIF {"id": "c6812409-296e-40f5-bdfc-b7cedf33f85b", "address": "fa:16:3e:db:bf:df", "network": {"id": "2a7db2ed-f938-42c6-b85c-8a94ac2717a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-811431562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6812409-29", "ovs_interfaceid": "c6812409-296e-40f5-bdfc-b7cedf33f85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:bf:df,bridge_name='br-int',has_traffic_filtering=True,id=c6812409-296e-40f5-bdfc-b7cedf33f85b,network=Network(2a7db2ed-f938-42c6-b85c-8a94ac2717a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6812409-29') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG os_vif [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:bf:df,bridge_name='br-int',has_traffic_filtering=True,id=c6812409-296e-40f5-bdfc-b7cedf33f85b,network=Network(2a7db2ed-f938-42c6-b85c-8a94ac2717a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6812409-29') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8eacf19e-43e7-5f8a-bb7b-372dff867df1', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc6812409-29, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc6812409-29, col_values=(('qos', UUID('544e9ba8-f7e4-408f-bfe6-3b67789370b3')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc6812409-29, col_values=(('external_ids', {'iface-id': 'c6812409-296e-40f5-bdfc-b7cedf33f85b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:bf:df', 'vm-uuid': '5c6c7551-7045-4129-9908-c0c6fbd93124'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:32 user nova-compute[75745]: INFO os_vif [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:bf:df,bridge_name='br-int',has_traffic_filtering=True,id=c6812409-296e-40f5-bdfc-b7cedf33f85b,network=Network(2a7db2ed-f938-42c6-b85c-8a94ac2717a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6812409-29')
Dec 01 17:07:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG nova.compute.manager [req-23b4a779-398f-4762-815b-e95c064033e5 req-fcf66a33-d9df-4f03-9294-c29ad5f8b615 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-plugged-4024ab4b-08e5-4f1f-866d-979bb1dee426 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-23b4a779-398f-4762-815b-e95c064033e5 req-fcf66a33-d9df-4f03-9294-c29ad5f8b615 service nova] Acquiring lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-23b4a779-398f-4762-815b-e95c064033e5 req-fcf66a33-d9df-4f03-9294-c29ad5f8b615 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-23b4a779-398f-4762-815b-e95c064033e5 req-fcf66a33-d9df-4f03-9294-c29ad5f8b615 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG nova.compute.manager [req-23b4a779-398f-4762-815b-e95c064033e5 req-fcf66a33-d9df-4f03-9294-c29ad5f8b615 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] No waiting events found dispatching network-vif-plugged-4024ab4b-08e5-4f1f-866d-979bb1dee426 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:07:32 user nova-compute[75745]: WARNING nova.compute.manager [req-23b4a779-398f-4762-815b-e95c064033e5 req-fcf66a33-d9df-4f03-9294-c29ad5f8b615 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received unexpected event network-vif-plugged-4024ab4b-08e5-4f1f-866d-979bb1dee426 for instance with vm_state building and task_state spawning.
Dec 01 17:07:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] No BDM found with device name hda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] No VIF found with MAC fa:16:3e:3f:e1:39, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] No VIF found with MAC fa:16:3e:e2:b2:aa, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:07:32 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Using config drive
Dec 01 17:07:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG nova.compute.manager [req-3d0cb2c7-5a18-4837-8697-93c2c04b4bc3 req-f7eda6ee-013c-469e-8b58-957f8a567f89 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-plugged-6e1b67ad-1619-4e40-906c-df31e0eab904 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3d0cb2c7-5a18-4837-8697-93c2c04b4bc3 req-f7eda6ee-013c-469e-8b58-957f8a567f89 service nova] Acquiring lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3d0cb2c7-5a18-4837-8697-93c2c04b4bc3 req-f7eda6ee-013c-469e-8b58-957f8a567f89 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3d0cb2c7-5a18-4837-8697-93c2c04b4bc3 req-f7eda6ee-013c-469e-8b58-957f8a567f89 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG nova.compute.manager [req-3d0cb2c7-5a18-4837-8697-93c2c04b4bc3 req-f7eda6ee-013c-469e-8b58-957f8a567f89 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] No waiting events found dispatching network-vif-plugged-6e1b67ad-1619-4e40-906c-df31e0eab904 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:07:32 user nova-compute[75745]: WARNING nova.compute.manager [req-3d0cb2c7-5a18-4837-8697-93c2c04b4bc3 req-f7eda6ee-013c-469e-8b58-957f8a567f89 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received unexpected event network-vif-plugged-6e1b67ad-1619-4e40-906c-df31e0eab904 for instance with vm_state building and task_state spawning.
Dec 01 17:07:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:32 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Creating config drive at /opt/stack/data/nova/instances/5c6c7551-7045-4129-9908-c0c6fbd93124/disk.config
Dec 01 17:07:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5c6c7551-7045-4129-9908-c0c6fbd93124/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpq873lyft {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5c6c7551-7045-4129-9908-c0c6fbd93124/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpq873lyft" returned: 0 in 0.073s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-cf0e9a0e-6011-4621-a2ad-4760bb28741f req-44853f5b-5649-49e7-9cc9-775ee530b092 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-plugged-d7c02fc7-a4d9-4c86-b18b-cf12d101f22f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-cf0e9a0e-6011-4621-a2ad-4760bb28741f req-44853f5b-5649-49e7-9cc9-775ee530b092 service nova] Acquiring lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-cf0e9a0e-6011-4621-a2ad-4760bb28741f req-44853f5b-5649-49e7-9cc9-775ee530b092 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-cf0e9a0e-6011-4621-a2ad-4760bb28741f req-44853f5b-5649-49e7-9cc9-775ee530b092 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-cf0e9a0e-6011-4621-a2ad-4760bb28741f req-44853f5b-5649-49e7-9cc9-775ee530b092 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] No waiting events found dispatching network-vif-plugged-d7c02fc7-a4d9-4c86-b18b-cf12d101f22f {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:07:34 user nova-compute[75745]: WARNING nova.compute.manager [req-cf0e9a0e-6011-4621-a2ad-4760bb28741f req-44853f5b-5649-49e7-9cc9-775ee530b092 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received unexpected event network-vif-plugged-d7c02fc7-a4d9-4c86-b18b-cf12d101f22f for instance with vm_state building and task_state spawning.
Dec 01 17:07:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-5d84ea62-c807-42c0-9a6b-5606191d67b6 req-f5374c32-9dc1-4be3-8e0e-49116fae2285 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-plugged-4024ab4b-08e5-4f1f-866d-979bb1dee426 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5d84ea62-c807-42c0-9a6b-5606191d67b6 req-f5374c32-9dc1-4be3-8e0e-49116fae2285 service nova] Acquiring lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5d84ea62-c807-42c0-9a6b-5606191d67b6 req-f5374c32-9dc1-4be3-8e0e-49116fae2285 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5d84ea62-c807-42c0-9a6b-5606191d67b6 req-f5374c32-9dc1-4be3-8e0e-49116fae2285 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-5d84ea62-c807-42c0-9a6b-5606191d67b6 req-f5374c32-9dc1-4be3-8e0e-49116fae2285 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] No waiting events found dispatching network-vif-plugged-4024ab4b-08e5-4f1f-866d-979bb1dee426 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:07:34 user nova-compute[75745]: WARNING nova.compute.manager [req-5d84ea62-c807-42c0-9a6b-5606191d67b6 req-f5374c32-9dc1-4be3-8e0e-49116fae2285 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received unexpected event network-vif-plugged-4024ab4b-08e5-4f1f-866d-979bb1dee426 for instance with vm_state building and task_state spawning.
Dec 01 17:07:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-5d84ea62-c807-42c0-9a6b-5606191d67b6 req-f5374c32-9dc1-4be3-8e0e-49116fae2285 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-plugged-4b6cfe1f-9722-41e1-9679-52398359a035 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5d84ea62-c807-42c0-9a6b-5606191d67b6 req-f5374c32-9dc1-4be3-8e0e-49116fae2285 service nova] Acquiring lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5d84ea62-c807-42c0-9a6b-5606191d67b6 req-f5374c32-9dc1-4be3-8e0e-49116fae2285 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5d84ea62-c807-42c0-9a6b-5606191d67b6 req-f5374c32-9dc1-4be3-8e0e-49116fae2285 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-5d84ea62-c807-42c0-9a6b-5606191d67b6 req-f5374c32-9dc1-4be3-8e0e-49116fae2285 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] No waiting events found dispatching network-vif-plugged-4b6cfe1f-9722-41e1-9679-52398359a035 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:07:34 user nova-compute[75745]: WARNING nova.compute.manager [req-5d84ea62-c807-42c0-9a6b-5606191d67b6 req-f5374c32-9dc1-4be3-8e0e-49116fae2285 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received unexpected event network-vif-plugged-4b6cfe1f-9722-41e1-9679-52398359a035 for instance with vm_state building and task_state spawning.
Dec 01 17:07:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-eb2130b3-2f76-4353-865e-a16ff1d7333f req-8f2e9ca7-6235-4a95-8209-10ba897b7c41 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-plugged-6e1b67ad-1619-4e40-906c-df31e0eab904 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-eb2130b3-2f76-4353-865e-a16ff1d7333f req-8f2e9ca7-6235-4a95-8209-10ba897b7c41 service nova] Acquiring lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-eb2130b3-2f76-4353-865e-a16ff1d7333f req-8f2e9ca7-6235-4a95-8209-10ba897b7c41 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-eb2130b3-2f76-4353-865e-a16ff1d7333f req-8f2e9ca7-6235-4a95-8209-10ba897b7c41 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-eb2130b3-2f76-4353-865e-a16ff1d7333f req-8f2e9ca7-6235-4a95-8209-10ba897b7c41 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] No waiting events found dispatching network-vif-plugged-6e1b67ad-1619-4e40-906c-df31e0eab904 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:07:34 user nova-compute[75745]: WARNING nova.compute.manager [req-eb2130b3-2f76-4353-865e-a16ff1d7333f req-8f2e9ca7-6235-4a95-8209-10ba897b7c41 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received unexpected event network-vif-plugged-6e1b67ad-1619-4e40-906c-df31e0eab904 for instance with vm_state building and task_state spawning.
Dec 01 17:07:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-eb2130b3-2f76-4353-865e-a16ff1d7333f req-8f2e9ca7-6235-4a95-8209-10ba897b7c41 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-plugged-92b697c2-8400-4b91-9fd7-53df7f47c4e0 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-eb2130b3-2f76-4353-865e-a16ff1d7333f req-8f2e9ca7-6235-4a95-8209-10ba897b7c41 service nova] Acquiring lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-eb2130b3-2f76-4353-865e-a16ff1d7333f req-8f2e9ca7-6235-4a95-8209-10ba897b7c41 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-eb2130b3-2f76-4353-865e-a16ff1d7333f req-8f2e9ca7-6235-4a95-8209-10ba897b7c41 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-eb2130b3-2f76-4353-865e-a16ff1d7333f req-8f2e9ca7-6235-4a95-8209-10ba897b7c41 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] No waiting events found dispatching network-vif-plugged-92b697c2-8400-4b91-9fd7-53df7f47c4e0 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:07:34 user nova-compute[75745]: WARNING nova.compute.manager [req-eb2130b3-2f76-4353-865e-a16ff1d7333f req-8f2e9ca7-6235-4a95-8209-10ba897b7c41 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received unexpected event network-vif-plugged-92b697c2-8400-4b91-9fd7-53df7f47c4e0 for instance with vm_state building and task_state spawning.
Dec 01 17:07:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-eb2130b3-2f76-4353-865e-a16ff1d7333f req-8f2e9ca7-6235-4a95-8209-10ba897b7c41 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-plugged-92b697c2-8400-4b91-9fd7-53df7f47c4e0 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-eb2130b3-2f76-4353-865e-a16ff1d7333f req-8f2e9ca7-6235-4a95-8209-10ba897b7c41 service nova] Acquiring lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-eb2130b3-2f76-4353-865e-a16ff1d7333f req-8f2e9ca7-6235-4a95-8209-10ba897b7c41 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-eb2130b3-2f76-4353-865e-a16ff1d7333f req-8f2e9ca7-6235-4a95-8209-10ba897b7c41 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-eb2130b3-2f76-4353-865e-a16ff1d7333f req-8f2e9ca7-6235-4a95-8209-10ba897b7c41 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] No waiting events found dispatching network-vif-plugged-92b697c2-8400-4b91-9fd7-53df7f47c4e0 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:07:34 user nova-compute[75745]: WARNING nova.compute.manager [req-eb2130b3-2f76-4353-865e-a16ff1d7333f req-8f2e9ca7-6235-4a95-8209-10ba897b7c41 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received unexpected event network-vif-plugged-92b697c2-8400-4b91-9fd7-53df7f47c4e0 for instance with vm_state building and task_state spawning.
Dec 01 17:07:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-eb2130b3-2f76-4353-865e-a16ff1d7333f req-8f2e9ca7-6235-4a95-8209-10ba897b7c41 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-plugged-9f79cb7e-7ef6-4e1a-a241-780713de2217 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-eb2130b3-2f76-4353-865e-a16ff1d7333f req-8f2e9ca7-6235-4a95-8209-10ba897b7c41 service nova] Acquiring lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-eb2130b3-2f76-4353-865e-a16ff1d7333f req-8f2e9ca7-6235-4a95-8209-10ba897b7c41 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-eb2130b3-2f76-4353-865e-a16ff1d7333f req-8f2e9ca7-6235-4a95-8209-10ba897b7c41 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-eb2130b3-2f76-4353-865e-a16ff1d7333f req-8f2e9ca7-6235-4a95-8209-10ba897b7c41 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] No waiting events found dispatching network-vif-plugged-9f79cb7e-7ef6-4e1a-a241-780713de2217 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:07:34 user nova-compute[75745]: WARNING nova.compute.manager [req-eb2130b3-2f76-4353-865e-a16ff1d7333f req-8f2e9ca7-6235-4a95-8209-10ba897b7c41 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received unexpected event network-vif-plugged-9f79cb7e-7ef6-4e1a-a241-780713de2217 for instance with vm_state building and task_state spawning.
Dec 01 17:07:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-eb2130b3-2f76-4353-865e-a16ff1d7333f req-8f2e9ca7-6235-4a95-8209-10ba897b7c41 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-plugged-9f79cb7e-7ef6-4e1a-a241-780713de2217 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-eb2130b3-2f76-4353-865e-a16ff1d7333f req-8f2e9ca7-6235-4a95-8209-10ba897b7c41 service nova] Acquiring lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-eb2130b3-2f76-4353-865e-a16ff1d7333f req-8f2e9ca7-6235-4a95-8209-10ba897b7c41 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-eb2130b3-2f76-4353-865e-a16ff1d7333f req-8f2e9ca7-6235-4a95-8209-10ba897b7c41 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-eb2130b3-2f76-4353-865e-a16ff1d7333f req-8f2e9ca7-6235-4a95-8209-10ba897b7c41 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] No waiting events found dispatching network-vif-plugged-9f79cb7e-7ef6-4e1a-a241-780713de2217 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:07:34 user nova-compute[75745]: WARNING nova.compute.manager [req-eb2130b3-2f76-4353-865e-a16ff1d7333f req-8f2e9ca7-6235-4a95-8209-10ba897b7c41 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received unexpected event network-vif-plugged-9f79cb7e-7ef6-4e1a-a241-780713de2217 for instance with vm_state building and task_state spawning.
Dec 01 17:07:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Acquiring lock "b566a6fd-2ea6-4df7-8866-eab5b4d398a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Lock "b566a6fd-2ea6-4df7-8866-eab5b4d398a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:35 user nova-compute[75745]: DEBUG nova.objects.instance [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Lazy-loading 'flavor' on Instance uuid b566a6fd-2ea6-4df7-8866-eab5b4d398a7 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:07:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Lock "b566a6fd-2ea6-4df7-8866-eab5b4d398a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.148s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG nova.compute.manager [req-97d2928a-2148-4fc0-89da-4309d97e0919 req-9d37db19-241b-461c-bec7-24fd323d65c9 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-plugged-f2f8e363-9e49-43ae-b61b-7ff8893c9f8f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-97d2928a-2148-4fc0-89da-4309d97e0919 req-9d37db19-241b-461c-bec7-24fd323d65c9 service nova] Acquiring lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-97d2928a-2148-4fc0-89da-4309d97e0919 req-9d37db19-241b-461c-bec7-24fd323d65c9 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.015s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-97d2928a-2148-4fc0-89da-4309d97e0919 req-9d37db19-241b-461c-bec7-24fd323d65c9 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG nova.compute.manager [req-97d2928a-2148-4fc0-89da-4309d97e0919 req-9d37db19-241b-461c-bec7-24fd323d65c9 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] No waiting events found dispatching network-vif-plugged-f2f8e363-9e49-43ae-b61b-7ff8893c9f8f {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:07:36 user nova-compute[75745]: WARNING nova.compute.manager [req-97d2928a-2148-4fc0-89da-4309d97e0919 req-9d37db19-241b-461c-bec7-24fd323d65c9 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received unexpected event network-vif-plugged-f2f8e363-9e49-43ae-b61b-7ff8893c9f8f for instance with vm_state building and task_state spawning.
Dec 01 17:07:36 user nova-compute[75745]: DEBUG nova.compute.manager [req-97d2928a-2148-4fc0-89da-4309d97e0919 req-9d37db19-241b-461c-bec7-24fd323d65c9 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-plugged-f2f8e363-9e49-43ae-b61b-7ff8893c9f8f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-97d2928a-2148-4fc0-89da-4309d97e0919 req-9d37db19-241b-461c-bec7-24fd323d65c9 service nova] Acquiring lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-97d2928a-2148-4fc0-89da-4309d97e0919 req-9d37db19-241b-461c-bec7-24fd323d65c9 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-97d2928a-2148-4fc0-89da-4309d97e0919 req-9d37db19-241b-461c-bec7-24fd323d65c9 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG nova.compute.manager [req-97d2928a-2148-4fc0-89da-4309d97e0919 req-9d37db19-241b-461c-bec7-24fd323d65c9 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] No waiting events found dispatching network-vif-plugged-f2f8e363-9e49-43ae-b61b-7ff8893c9f8f {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:07:36 user nova-compute[75745]: WARNING nova.compute.manager [req-97d2928a-2148-4fc0-89da-4309d97e0919 req-9d37db19-241b-461c-bec7-24fd323d65c9 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received unexpected event network-vif-plugged-f2f8e363-9e49-43ae-b61b-7ff8893c9f8f for instance with vm_state building and task_state spawning.
Dec 01 17:07:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Acquiring lock "b566a6fd-2ea6-4df7-8866-eab5b4d398a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Lock "b566a6fd-2ea6-4df7-8866-eab5b4d398a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:36 user nova-compute[75745]: INFO nova.compute.manager [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Attaching volume 43a3784d-ea83-44e2-af2d-91edb059fa72 to /dev/vdb
Dec 01 17:07:36 user nova-compute[75745]: DEBUG os_brick.utils [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38278fc-f3cb-47dd-97b8-f16a6726eaa9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[473d19a7-1f5e-44d5-bad3-9b9d494c4e30]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46e1cb4-5f92-4700-82cf-27e819d7c59d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c06cc23-9db6-498b-8e54-6da1bed25974]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:07:36 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:07:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[54955c51-ee98-4d2b-9441-0aa1c6626bfc]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG os_brick.utils [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Updating existing volume attachment record: 0e85e1f4-80aa-43a9-97e9-5241f15c4f25 {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG nova.compute.manager [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-plugged-4b6cfe1f-9722-41e1-9679-52398359a035 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] Acquiring lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG nova.compute.manager [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] No waiting events found dispatching network-vif-plugged-4b6cfe1f-9722-41e1-9679-52398359a035 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:07:36 user nova-compute[75745]: WARNING nova.compute.manager [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received unexpected event network-vif-plugged-4b6cfe1f-9722-41e1-9679-52398359a035 for instance with vm_state building and task_state spawning.
Dec 01 17:07:36 user nova-compute[75745]: DEBUG nova.compute.manager [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Received event network-changed-7b52d740-f797-4bc8-9e0c-d9f4744e4a4f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG nova.compute.manager [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Refreshing instance network info cache due to event network-changed-7b52d740-f797-4bc8-9e0c-d9f4744e4a4f. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] Acquiring lock "refresh_cache-dc78dcf1-f005-415c-ac27-798cab8f52fb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] Acquired lock "refresh_cache-dc78dcf1-f005-415c-ac27-798cab8f52fb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:07:36 user nova-compute[75745]: DEBUG nova.network.neutron [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Refreshing network info cache for port 7b52d740-f797-4bc8-9e0c-d9f4744e4a4f {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-b566a6fd-2ea6-4df7-8866-eab5b4d398a7" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-b566a6fd-2ea6-4df7-8866-eab5b4d398a7" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG nova.network.neutron [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Updated VIF entry in instance network info cache for port 7b52d740-f797-4bc8-9e0c-d9f4744e4a4f. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG nova.network.neutron [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Updating instance_info_cache with network_info: [{"id": "7b52d740-f797-4bc8-9e0c-d9f4744e4a4f", "address": "fa:16:3e:9e:67:88", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b52d740-f7", "ovs_interfaceid": "7b52d740-f797-4bc8-9e0c-d9f4744e4a4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] Releasing lock "refresh_cache-dc78dcf1-f005-415c-ac27-798cab8f52fb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG nova.compute.manager [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-plugged-de0d310c-2bc9-4434-8b2b-253a88febaa0 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] Acquiring lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG nova.compute.manager [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] No waiting events found dispatching network-vif-plugged-de0d310c-2bc9-4434-8b2b-253a88febaa0 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:07:37 user nova-compute[75745]: WARNING nova.compute.manager [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received unexpected event network-vif-plugged-de0d310c-2bc9-4434-8b2b-253a88febaa0 for instance with vm_state building and task_state spawning.
Dec 01 17:07:37 user nova-compute[75745]: DEBUG nova.compute.manager [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-plugged-de0d310c-2bc9-4434-8b2b-253a88febaa0 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] Acquiring lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG nova.compute.manager [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] No waiting events found dispatching network-vif-plugged-de0d310c-2bc9-4434-8b2b-253a88febaa0 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:07:37 user nova-compute[75745]: WARNING nova.compute.manager [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received unexpected event network-vif-plugged-de0d310c-2bc9-4434-8b2b-253a88febaa0 for instance with vm_state building and task_state spawning.
Dec 01 17:07:37 user nova-compute[75745]: DEBUG nova.compute.manager [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-plugged-a5ecb053-fd41-42ea-8abe-4c504b6c7882 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] Acquiring lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG nova.compute.manager [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] No waiting events found dispatching network-vif-plugged-a5ecb053-fd41-42ea-8abe-4c504b6c7882 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:07:37 user nova-compute[75745]: WARNING nova.compute.manager [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received unexpected event network-vif-plugged-a5ecb053-fd41-42ea-8abe-4c504b6c7882 for instance with vm_state building and task_state spawning.
Dec 01 17:07:37 user nova-compute[75745]: DEBUG nova.compute.manager [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-plugged-a5ecb053-fd41-42ea-8abe-4c504b6c7882 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] Acquiring lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG nova.compute.manager [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] No waiting events found dispatching network-vif-plugged-a5ecb053-fd41-42ea-8abe-4c504b6c7882 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:07:37 user nova-compute[75745]: WARNING nova.compute.manager [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received unexpected event network-vif-plugged-a5ecb053-fd41-42ea-8abe-4c504b6c7882 for instance with vm_state building and task_state spawning.
Dec 01 17:07:37 user nova-compute[75745]: DEBUG nova.compute.manager [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-plugged-9d9f0b3d-a677-4db0-a8be-b19006908125 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] Acquiring lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG nova.compute.manager [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] No waiting events found dispatching network-vif-plugged-9d9f0b3d-a677-4db0-a8be-b19006908125 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:07:37 user nova-compute[75745]: WARNING nova.compute.manager [req-66acce8a-eb0f-4fd9-9ea3-ad53fc5c1fcf req-eecfa04b-797d-46c7-b5e9-fd30f2038a0b service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received unexpected event network-vif-plugged-9d9f0b3d-a677-4db0-a8be-b19006908125 for instance with vm_state building and task_state spawning.
Dec 01 17:07:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG nova.compute.manager [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:37 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Instance spawned successfully.
Dec 01 17:07:37 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG nova.compute.manager [req-c96f214b-597b-4b93-b33c-af15ae98e0cb req-7662d48a-059b-444e-9da5-d6c283defc19 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-plugged-c6812409-296e-40f5-bdfc-b7cedf33f85b {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c96f214b-597b-4b93-b33c-af15ae98e0cb req-7662d48a-059b-444e-9da5-d6c283defc19 service nova] Acquiring lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c96f214b-597b-4b93-b33c-af15ae98e0cb req-7662d48a-059b-444e-9da5-d6c283defc19 service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c96f214b-597b-4b93-b33c-af15ae98e0cb req-7662d48a-059b-444e-9da5-d6c283defc19 service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG nova.compute.manager [req-c96f214b-597b-4b93-b33c-af15ae98e0cb req-7662d48a-059b-444e-9da5-d6c283defc19 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] No waiting events found dispatching network-vif-plugged-c6812409-296e-40f5-bdfc-b7cedf33f85b {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:07:37 user nova-compute[75745]: WARNING nova.compute.manager [req-c96f214b-597b-4b93-b33c-af15ae98e0cb req-7662d48a-059b-444e-9da5-d6c283defc19 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received unexpected event network-vif-plugged-c6812409-296e-40f5-bdfc-b7cedf33f85b for instance with vm_state building and task_state spawning.
Dec 01 17:07:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:07:37 user nova-compute[75745]: INFO nova.compute.manager [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Took 15.11 seconds to spawn the instance on the hypervisor.
Dec 01 17:07:37 user nova-compute[75745]: DEBUG nova.compute.manager [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:07:37 user nova-compute[75745]: INFO nova.compute.manager [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Took 47.80 seconds to build instance.
Dec 01 17:07:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ebcd303f-f4e9-4c8a-b36e-a24705147d3c tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 47.910s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Updating instance_info_cache with network_info: [{"id": "ea70774b-9342-49b5-b596-1da083140c0a", "address": "fa:16:3e:48:5d:1c", "network": {"id": "004342e4-e51d-4e72-bda8-00a8e88f5e0a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2037576247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e08f6fe2b83b488ca3febd45986ed592", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea70774b-93", "ovs_interfaceid": "ea70774b-9342-49b5-b596-1da083140c0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-b566a6fd-2ea6-4df7-8866-eab5b4d398a7" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG nova.compute.manager [req-ea835656-21b5-4e6b-be29-3dc552ac35f2 req-bf5c9bb8-217d-4c8e-8ca5-c44f6e8820b1 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-plugged-4bc79fe9-e1e7-4040-ae00-e231301a8c58 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ea835656-21b5-4e6b-be29-3dc552ac35f2 req-bf5c9bb8-217d-4c8e-8ca5-c44f6e8820b1 service nova] Acquiring lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ea835656-21b5-4e6b-be29-3dc552ac35f2 req-bf5c9bb8-217d-4c8e-8ca5-c44f6e8820b1 service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ea835656-21b5-4e6b-be29-3dc552ac35f2 req-bf5c9bb8-217d-4c8e-8ca5-c44f6e8820b1 service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG nova.compute.manager [req-ea835656-21b5-4e6b-be29-3dc552ac35f2 req-bf5c9bb8-217d-4c8e-8ca5-c44f6e8820b1 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] No waiting events found dispatching network-vif-plugged-4bc79fe9-e1e7-4040-ae00-e231301a8c58 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:07:38 user nova-compute[75745]: WARNING nova.compute.manager [req-ea835656-21b5-4e6b-be29-3dc552ac35f2 req-bf5c9bb8-217d-4c8e-8ca5-c44f6e8820b1 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received unexpected event network-vif-plugged-4bc79fe9-e1e7-4040-ae00-e231301a8c58 for instance with vm_state building and task_state spawning.
Dec 01 17:07:38 user nova-compute[75745]: DEBUG nova.compute.manager [req-ea835656-21b5-4e6b-be29-3dc552ac35f2 req-bf5c9bb8-217d-4c8e-8ca5-c44f6e8820b1 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-plugged-4bc79fe9-e1e7-4040-ae00-e231301a8c58 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ea835656-21b5-4e6b-be29-3dc552ac35f2 req-bf5c9bb8-217d-4c8e-8ca5-c44f6e8820b1 service nova] Acquiring lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ea835656-21b5-4e6b-be29-3dc552ac35f2 req-bf5c9bb8-217d-4c8e-8ca5-c44f6e8820b1 service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ea835656-21b5-4e6b-be29-3dc552ac35f2 req-bf5c9bb8-217d-4c8e-8ca5-c44f6e8820b1 service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG nova.compute.manager [req-ea835656-21b5-4e6b-be29-3dc552ac35f2 req-bf5c9bb8-217d-4c8e-8ca5-c44f6e8820b1 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] No waiting events found dispatching network-vif-plugged-4bc79fe9-e1e7-4040-ae00-e231301a8c58 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:07:38 user nova-compute[75745]: WARNING nova.compute.manager [req-ea835656-21b5-4e6b-be29-3dc552ac35f2 req-bf5c9bb8-217d-4c8e-8ca5-c44f6e8820b1 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received unexpected event network-vif-plugged-4bc79fe9-e1e7-4040-ae00-e231301a8c58 for instance with vm_state building and task_state spawning.
Dec 01 17:07:38 user nova-compute[75745]: DEBUG nova.compute.manager [req-ea835656-21b5-4e6b-be29-3dc552ac35f2 req-bf5c9bb8-217d-4c8e-8ca5-c44f6e8820b1 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-plugged-754453de-6c68-4cdd-acc4-2307e4b6d3d2 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ea835656-21b5-4e6b-be29-3dc552ac35f2 req-bf5c9bb8-217d-4c8e-8ca5-c44f6e8820b1 service nova] Acquiring lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ea835656-21b5-4e6b-be29-3dc552ac35f2 req-bf5c9bb8-217d-4c8e-8ca5-c44f6e8820b1 service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ea835656-21b5-4e6b-be29-3dc552ac35f2 req-bf5c9bb8-217d-4c8e-8ca5-c44f6e8820b1 service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG nova.compute.manager [req-ea835656-21b5-4e6b-be29-3dc552ac35f2 req-bf5c9bb8-217d-4c8e-8ca5-c44f6e8820b1 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] No waiting events found dispatching network-vif-plugged-754453de-6c68-4cdd-acc4-2307e4b6d3d2 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:07:38 user nova-compute[75745]: WARNING nova.compute.manager [req-ea835656-21b5-4e6b-be29-3dc552ac35f2 req-bf5c9bb8-217d-4c8e-8ca5-c44f6e8820b1 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received unexpected event network-vif-plugged-754453de-6c68-4cdd-acc4-2307e4b6d3d2 for instance with vm_state building and task_state spawning.
Dec 01 17:07:38 user nova-compute[75745]: DEBUG nova.compute.manager [req-ea835656-21b5-4e6b-be29-3dc552ac35f2 req-bf5c9bb8-217d-4c8e-8ca5-c44f6e8820b1 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-plugged-754453de-6c68-4cdd-acc4-2307e4b6d3d2 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ea835656-21b5-4e6b-be29-3dc552ac35f2 req-bf5c9bb8-217d-4c8e-8ca5-c44f6e8820b1 service nova] Acquiring lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ea835656-21b5-4e6b-be29-3dc552ac35f2 req-bf5c9bb8-217d-4c8e-8ca5-c44f6e8820b1 service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ea835656-21b5-4e6b-be29-3dc552ac35f2 req-bf5c9bb8-217d-4c8e-8ca5-c44f6e8820b1 service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG nova.compute.manager [req-ea835656-21b5-4e6b-be29-3dc552ac35f2 req-bf5c9bb8-217d-4c8e-8ca5-c44f6e8820b1 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] No waiting events found dispatching network-vif-plugged-754453de-6c68-4cdd-acc4-2307e4b6d3d2 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:07:38 user nova-compute[75745]: WARNING nova.compute.manager [req-ea835656-21b5-4e6b-be29-3dc552ac35f2 req-bf5c9bb8-217d-4c8e-8ca5-c44f6e8820b1 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received unexpected event network-vif-plugged-754453de-6c68-4cdd-acc4-2307e4b6d3d2 for instance with vm_state building and task_state spawning.
Dec 01 17:07:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "dc78dcf1-f005-415c-ac27-798cab8f52fb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "dc78dcf1-f005-415c-ac27-798cab8f52fb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:38 user nova-compute[75745]: DEBUG nova.objects.instance [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lazy-loading 'flavor' on Instance uuid dc78dcf1-f005-415c-ac27-798cab8f52fb {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "dc78dcf1-f005-415c-ac27-798cab8f52fb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.184s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG nova.compute.manager [req-8a6f0142-5932-4848-b2b8-4882f3a02d0f req-f8291ea0-04cd-4315-9f8f-0c41a248f3aa service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-plugged-9d9f0b3d-a677-4db0-a8be-b19006908125 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8a6f0142-5932-4848-b2b8-4882f3a02d0f req-f8291ea0-04cd-4315-9f8f-0c41a248f3aa service nova] Acquiring lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8a6f0142-5932-4848-b2b8-4882f3a02d0f req-f8291ea0-04cd-4315-9f8f-0c41a248f3aa service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8a6f0142-5932-4848-b2b8-4882f3a02d0f req-f8291ea0-04cd-4315-9f8f-0c41a248f3aa service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG nova.compute.manager [req-8a6f0142-5932-4848-b2b8-4882f3a02d0f req-f8291ea0-04cd-4315-9f8f-0c41a248f3aa service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] No waiting events found dispatching network-vif-plugged-9d9f0b3d-a677-4db0-a8be-b19006908125 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:07:39 user nova-compute[75745]: WARNING nova.compute.manager [req-8a6f0142-5932-4848-b2b8-4882f3a02d0f req-f8291ea0-04cd-4315-9f8f-0c41a248f3aa service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received unexpected event network-vif-plugged-9d9f0b3d-a677-4db0-a8be-b19006908125 for instance with vm_state building and task_state spawning.
Dec 01 17:07:39 user nova-compute[75745]: DEBUG nova.compute.manager [req-8a6f0142-5932-4848-b2b8-4882f3a02d0f req-f8291ea0-04cd-4315-9f8f-0c41a248f3aa service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-plugged-847be9c3-c4d1-4280-8b85-56697d11a876 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8a6f0142-5932-4848-b2b8-4882f3a02d0f req-f8291ea0-04cd-4315-9f8f-0c41a248f3aa service nova] Acquiring lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8a6f0142-5932-4848-b2b8-4882f3a02d0f req-f8291ea0-04cd-4315-9f8f-0c41a248f3aa service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8a6f0142-5932-4848-b2b8-4882f3a02d0f req-f8291ea0-04cd-4315-9f8f-0c41a248f3aa service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG nova.compute.manager [req-8a6f0142-5932-4848-b2b8-4882f3a02d0f req-f8291ea0-04cd-4315-9f8f-0c41a248f3aa service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] No waiting events found dispatching network-vif-plugged-847be9c3-c4d1-4280-8b85-56697d11a876 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:07:39 user nova-compute[75745]: WARNING nova.compute.manager [req-8a6f0142-5932-4848-b2b8-4882f3a02d0f req-f8291ea0-04cd-4315-9f8f-0c41a248f3aa service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received unexpected event network-vif-plugged-847be9c3-c4d1-4280-8b85-56697d11a876 for instance with vm_state building and task_state spawning.
Dec 01 17:07:39 user nova-compute[75745]: DEBUG nova.compute.manager [req-8a6f0142-5932-4848-b2b8-4882f3a02d0f req-f8291ea0-04cd-4315-9f8f-0c41a248f3aa service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Received event network-changed-b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG nova.compute.manager [req-8a6f0142-5932-4848-b2b8-4882f3a02d0f req-f8291ea0-04cd-4315-9f8f-0c41a248f3aa service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Refreshing instance network info cache due to event network-changed-b4990a3b-371a-44eb-98d8-685dc63590da. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8a6f0142-5932-4848-b2b8-4882f3a02d0f req-f8291ea0-04cd-4315-9f8f-0c41a248f3aa service nova] Acquiring lock "refresh_cache-4ac6f586-cc5b-4a3f-b374-4b2006a48427" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8a6f0142-5932-4848-b2b8-4882f3a02d0f req-f8291ea0-04cd-4315-9f8f-0c41a248f3aa service nova] Acquired lock "refresh_cache-4ac6f586-cc5b-4a3f-b374-4b2006a48427" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG nova.network.neutron [req-8a6f0142-5932-4848-b2b8-4882f3a02d0f req-f8291ea0-04cd-4315-9f8f-0c41a248f3aa service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Refreshing network info cache for port b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "dc78dcf1-f005-415c-ac27-798cab8f52fb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "dc78dcf1-f005-415c-ac27-798cab8f52fb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:39 user nova-compute[75745]: INFO nova.compute.manager [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Attaching volume 3f50c0ac-c8a8-4290-8246-487eee7d3111 to /dev/vdb
Dec 01 17:07:39 user nova-compute[75745]: DEBUG os_brick.utils [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[07831a97-ce57-4d06-aa1a-20183575383b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83f633e-23cd-419b-bea8-10d78da774f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG nova.compute.manager [req-893f3bed-3111-48a8-85f2-586619a22736 req-af6d81f8-5286-4722-bb99-1169a4785f9a service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-plugged-c6812409-296e-40f5-bdfc-b7cedf33f85b {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-893f3bed-3111-48a8-85f2-586619a22736 req-af6d81f8-5286-4722-bb99-1169a4785f9a service nova] Acquiring lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-893f3bed-3111-48a8-85f2-586619a22736 req-af6d81f8-5286-4722-bb99-1169a4785f9a service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-893f3bed-3111-48a8-85f2-586619a22736 req-af6d81f8-5286-4722-bb99-1169a4785f9a service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG nova.compute.manager [req-893f3bed-3111-48a8-85f2-586619a22736 req-af6d81f8-5286-4722-bb99-1169a4785f9a service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] No waiting events found dispatching network-vif-plugged-c6812409-296e-40f5-bdfc-b7cedf33f85b {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:07:39 user nova-compute[75745]: WARNING nova.compute.manager [req-893f3bed-3111-48a8-85f2-586619a22736 req-af6d81f8-5286-4722-bb99-1169a4785f9a service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received unexpected event network-vif-plugged-c6812409-296e-40f5-bdfc-b7cedf33f85b for instance with vm_state building and task_state spawning.
Dec 01 17:07:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5ca14a-3fb8-4056-850e-5ae7710f364d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f0090f-3a3d-4932-ae5e-b383f6a6f83d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:07:39 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:07:39 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b0813b-251c-44a0-8175-8597da079658]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG os_brick.utils [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Updating existing volume attachment record: cb005aa8-2537-48a2-90f7-63fec2a4d1b7 {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG nova.compute.manager [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:07:39 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Instance spawned successfully.
Dec 01 17:07:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:07:39 user nova-compute[75745]: INFO nova.compute.manager [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Took 16.29 seconds to spawn the instance on the hypervisor.
Dec 01 17:07:39 user nova-compute[75745]: DEBUG nova.compute.manager [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:07:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b566a6fd-2ea6-4df7-8866-eab5b4d398a7/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:40 user nova-compute[75745]: INFO nova.compute.manager [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Took 46.79 seconds to build instance.
Dec 01 17:07:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-824f2bb9-ec52-4465-8ce1-ac2322ef2f2c tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 46.902s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:40 user nova-compute[75745]: DEBUG nova.network.neutron [req-8a6f0142-5932-4848-b2b8-4882f3a02d0f req-f8291ea0-04cd-4315-9f8f-0c41a248f3aa service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Updated VIF entry in instance network info cache for port b4990a3b-371a-44eb-98d8-685dc63590da. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:07:40 user nova-compute[75745]: DEBUG nova.network.neutron [req-8a6f0142-5932-4848-b2b8-4882f3a02d0f req-f8291ea0-04cd-4315-9f8f-0c41a248f3aa service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Updating instance_info_cache with network_info: [{"id": "b4990a3b-371a-44eb-98d8-685dc63590da", "address": "fa:16:3e:d3:4e:b4", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4990a3b-37", "ovs_interfaceid": "b4990a3b-371a-44eb-98d8-685dc63590da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:07:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8a6f0142-5932-4848-b2b8-4882f3a02d0f req-f8291ea0-04cd-4315-9f8f-0c41a248f3aa service nova] Releasing lock "refresh_cache-4ac6f586-cc5b-4a3f-b374-4b2006a48427" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:07:40 user nova-compute[75745]: DEBUG nova.compute.manager [req-8a6f0142-5932-4848-b2b8-4882f3a02d0f req-f8291ea0-04cd-4315-9f8f-0c41a248f3aa service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-plugged-847be9c3-c4d1-4280-8b85-56697d11a876 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8a6f0142-5932-4848-b2b8-4882f3a02d0f req-f8291ea0-04cd-4315-9f8f-0c41a248f3aa service nova] Acquiring lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8a6f0142-5932-4848-b2b8-4882f3a02d0f req-f8291ea0-04cd-4315-9f8f-0c41a248f3aa service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8a6f0142-5932-4848-b2b8-4882f3a02d0f req-f8291ea0-04cd-4315-9f8f-0c41a248f3aa service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:40 user nova-compute[75745]: DEBUG nova.compute.manager [req-8a6f0142-5932-4848-b2b8-4882f3a02d0f req-f8291ea0-04cd-4315-9f8f-0c41a248f3aa service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] No waiting events found dispatching network-vif-plugged-847be9c3-c4d1-4280-8b85-56697d11a876 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:07:40 user nova-compute[75745]: WARNING nova.compute.manager [req-8a6f0142-5932-4848-b2b8-4882f3a02d0f req-f8291ea0-04cd-4315-9f8f-0c41a248f3aa service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received unexpected event network-vif-plugged-847be9c3-c4d1-4280-8b85-56697d11a876 for instance with vm_state building and task_state spawning.
Dec 01 17:07:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b566a6fd-2ea6-4df7-8866-eab5b4d398a7/disk --force-share --output=json" returned: 0 in 0.319s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b566a6fd-2ea6-4df7-8866-eab5b4d398a7/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b566a6fd-2ea6-4df7-8866-eab5b4d398a7/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:07:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:07:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:07:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG nova.objects.instance [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lazy-loading 'flavor' on Instance uuid 4ac6f586-cc5b-4a3f-b374-4b2006a48427 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:41 user nova-compute[75745]: INFO nova.compute.manager [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Attaching volume 609a2122-bfa0-40d7-b912-c4d799157121 to /dev/vdb
Dec 01 17:07:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bfb9f9-95a4-49f5-b781-5e78c83c54d1/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG os_brick.utils [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4f3094-b8c9-4069-9961-0b218ec8090e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2372893e-93d0-45b2-8088-07eb54943074]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b682ae8-550c-4f3d-97f7-202653595941]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f428700e-c964-426d-852f-49885543589e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:07:41 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:07:41 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b5570c-789c-4aac-bfca-e9b660b161ca]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG os_brick.utils [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Updating existing volume attachment record: fb1fb991-b371-4845-a70e-f7b50885a92f {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bfb9f9-95a4-49f5-b781-5e78c83c54d1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bfb9f9-95a4-49f5-b781-5e78c83c54d1/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bfb9f9-95a4-49f5-b781-5e78c83c54d1/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:07:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fb74ee-dfa0-40e1-8773-99bd4a0402d5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fb74ee-dfa0-40e1-8773-99bd4a0402d5/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fb74ee-dfa0-40e1-8773-99bd4a0402d5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:42 user nova-compute[75745]: DEBUG nova.compute.manager [req-7c499ac2-4343-4434-8afe-aea84136a247 req-c752fbf7-fd66-47a9-9fc8-f629a70a57d8 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Received event network-changed-5897fde5-fea9-4ff3-98b8-db1020cf5127 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:42 user nova-compute[75745]: DEBUG nova.compute.manager [req-7c499ac2-4343-4434-8afe-aea84136a247 req-c752fbf7-fd66-47a9-9fc8-f629a70a57d8 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Refreshing instance network info cache due to event network-changed-5897fde5-fea9-4ff3-98b8-db1020cf5127. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:07:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7c499ac2-4343-4434-8afe-aea84136a247 req-c752fbf7-fd66-47a9-9fc8-f629a70a57d8 service nova] Acquiring lock "refresh_cache-2abc6436-bf45-497a-acd2-47d43d5e158c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:07:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7c499ac2-4343-4434-8afe-aea84136a247 req-c752fbf7-fd66-47a9-9fc8-f629a70a57d8 service nova] Acquired lock "refresh_cache-2abc6436-bf45-497a-acd2-47d43d5e158c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:07:42 user nova-compute[75745]: DEBUG nova.network.neutron [req-7c499ac2-4343-4434-8afe-aea84136a247 req-c752fbf7-fd66-47a9-9fc8-f629a70a57d8 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Refreshing network info cache for port 5897fde5-fea9-4ff3-98b8-db1020cf5127 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:07:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fb74ee-dfa0-40e1-8773-99bd4a0402d5/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc78dcf1-f005-415c-ac27-798cab8f52fb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc78dcf1-f005-415c-ac27-798cab8f52fb/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc78dcf1-f005-415c-ac27-798cab8f52fb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc78dcf1-f005-415c-ac27-798cab8f52fb/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e256c89-0301-431a-ae27-dfd7c2af19f2/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:43 user nova-compute[75745]: DEBUG nova.network.neutron [req-7c499ac2-4343-4434-8afe-aea84136a247 req-c752fbf7-fd66-47a9-9fc8-f629a70a57d8 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Updated VIF entry in instance network info cache for port 5897fde5-fea9-4ff3-98b8-db1020cf5127. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:07:43 user nova-compute[75745]: DEBUG nova.network.neutron [req-7c499ac2-4343-4434-8afe-aea84136a247 req-c752fbf7-fd66-47a9-9fc8-f629a70a57d8 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Updating instance_info_cache with network_info: [{"id": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "address": "fa:16:3e:66:74:ba", "network": {"id": "3d78774f-ff2b-4705-b359-7a1fb7fc272f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-234182378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1efefd35d14e03a3eebfff2ac0d335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5897fde5-fe", "ovs_interfaceid": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:07:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7c499ac2-4343-4434-8afe-aea84136a247 req-c752fbf7-fd66-47a9-9fc8-f629a70a57d8 service nova] Releasing lock "refresh_cache-2abc6436-bf45-497a-acd2-47d43d5e158c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:07:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e256c89-0301-431a-ae27-dfd7c2af19f2/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e256c89-0301-431a-ae27-dfd7c2af19f2/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e256c89-0301-431a-ae27-dfd7c2af19f2/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4bc58d-90b6-4621-80a9-0b72194b10da/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:43 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4bc58d-90b6-4621-80a9-0b72194b10da/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4bc58d-90b6-4621-80a9-0b72194b10da/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4bc58d-90b6-4621-80a9-0b72194b10da/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:44 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:07:44 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:07:44 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=7111MB free_disk=25.526371002197266GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:07:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:44 user nova-compute[75745]: DEBUG nova.compute.manager [None req-8395a700-4d16-493e-8b63-a19f525c8210 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:07:45 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance dc78dcf1-f005-415c-ac27-798cab8f52fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:07:45 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance b566a6fd-2ea6-4df7-8866-eab5b4d398a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:07:45 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 4ac6f586-cc5b-4a3f-b374-4b2006a48427 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:07:45 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 2abc6436-bf45-497a-acd2-47d43d5e158c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:07:45 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance c7fb74ee-dfa0-40e1-8773-99bd4a0402d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:07:45 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance d9bfb9f9-95a4-49f5-b781-5e78c83c54d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:07:45 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 02715ae1-5200-4df5-8430-2f19a610d2bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:07:45 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 0e256c89-0301-431a-ae27-dfd7c2af19f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:07:45 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 9d4bc58d-90b6-4621-80a9-0b72194b10da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:07:45 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:07:45 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 5c6c7551-7045-4129-9908-c0c6fbd93124 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:07:45 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:07:45 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:07:45 user nova-compute[75745]: INFO nova.compute.manager [None req-8395a700-4d16-493e-8b63-a19f525c8210 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] instance snapshotting
Dec 01 17:07:45 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-8395a700-4d16-493e-8b63-a19f525c8210 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Beginning live snapshot process
Dec 01 17:07:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-8395a700-4d16-493e-8b63-a19f525c8210 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk --force-share --output=json -f qcow2 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:45 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:07:45 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:07:45 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:07:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.738s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-8395a700-4d16-493e-8b63-a19f525c8210 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk --force-share --output=json -f qcow2" returned: 0 in 0.246s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-8395a700-4d16-493e-8b63-a19f525c8210 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk --force-share --output=json -f qcow2 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-8395a700-4d16-493e-8b63-a19f525c8210 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk --force-share --output=json -f qcow2" returned: 0 in 0.230s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-8395a700-4d16-493e-8b63-a19f525c8210 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-8395a700-4d16-493e-8b63-a19f525c8210 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.299s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-8395a700-4d16-493e-8b63-a19f525c8210 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsnpg57o5/9f988b66fc6c4bf9812ed6c81463e84a.delta 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-8395a700-4d16-493e-8b63-a19f525c8210 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsnpg57o5/9f988b66fc6c4bf9812ed6c81463e84a.delta 1073741824" returned: 0 in 0.063s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:46 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-8395a700-4d16-493e-8b63-a19f525c8210 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Quiescing instance not available: QEMU guest agent is not enabled.
Dec 01 17:07:46 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-8395a700-4d16-493e-8b63-a19f525c8210 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75745) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Dec 01 17:07:46 user nova-compute[75745]: INFO nova.virt.libvirt.host [None req-8395a700-4d16-493e-8b63-a19f525c8210 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] UEFI support detected
Dec 01 17:07:46 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:07:46 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:07:46 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:07:47 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-8395a700-4d16-493e-8b63-a19f525c8210 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75745) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 17:07:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:47 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-8395a700-4d16-493e-8b63-a19f525c8210 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] COPY block job progress, current cursor: 14352384 final cursor: 75497472 {{(pid=75745) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 17:07:48 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-8395a700-4d16-493e-8b63-a19f525c8210 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] COPY block job progress, current cursor: 75628544 final cursor: 75628544 {{(pid=75745) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 17:07:48 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-8395a700-4d16-493e-8b63-a19f525c8210 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 01 17:07:48 user nova-compute[75745]: DEBUG nova.privsep.utils [None req-8395a700-4d16-493e-8b63-a19f525c8210 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75745) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 17:07:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-8395a700-4d16-493e-8b63-a19f525c8210 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsnpg57o5/9f988b66fc6c4bf9812ed6c81463e84a.delta /opt/stack/data/nova/instances/snapshots/tmpsnpg57o5/9f988b66fc6c4bf9812ed6c81463e84a {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-8395a700-4d16-493e-8b63-a19f525c8210 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsnpg57o5/9f988b66fc6c4bf9812ed6c81463e84a.delta /opt/stack/data/nova/instances/snapshots/tmpsnpg57o5/9f988b66fc6c4bf9812ed6c81463e84a" returned: 0 in 0.576s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:48 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-8395a700-4d16-493e-8b63-a19f525c8210 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Snapshot extracted, beginning image upload
Dec 01 17:07:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:48 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:07:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YPuDdBLc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:07:48 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:07:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:07:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:07:48 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:07:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:07:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:07:48 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:07:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:48 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d742a0-4628-4c5f-b93b-90dc1c3d1be5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:07:48 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:48 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7a28f3-d740-4b20-af71-18a743127227]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72] added
Dec 01 17:07:48 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:48 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ead437f-fa65-47b4-968d-9f8568de3396]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:48 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5206ac7-fc0c-41a5-8c20-52b2809a498e]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YPuDdBLc {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YPuDdBLc" returned: 0 in 0.032s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79d3f98-10f6-453f-9591-209141818d12]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YPuDdBLc'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1c486b-a23f-4520-97e9-47cd8881e0d8]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f32b3c6-6cfe-4603-b5b4-504929924f84]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:07:49 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:07:49 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:07:49 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:07:49 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:07:49 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:07:49 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:07:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:07:49 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:07:49 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:07:49 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:07:49 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:07:49 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:07:49 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:07:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3e4fd1-bc3f-41a4-b53b-d29ec4300de7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72, portal: 172.16.0.220,3260]
Dec 01 17:07:49 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72, portal: 172.16.0.220,3260] successful.
Dec 01 17:07:49 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[48810ab2-0507-448c-bcbe-17aaf12fc37a]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd79d29-815f-49ee-af3f-6fa481e7979f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:07:49 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:07:49 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:07:49 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:07:49 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:07:49 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:07:49 user nova-compute[75745]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72 (non-flash)
Dec 01 17:07:49 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:07:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:07:49 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:07:49 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:07:49 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:07:49 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:07:49 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:07:49 user nova-compute[75745]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72 (non-flash)
Dec 01 17:07:49 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:07:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:07:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:07:49 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:07:49 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:07:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf7f248-baba-4322-beae-db20aebf0e5e]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:49 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:07:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YPuDdBLc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:07:50 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:07:50 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '23637643133643461', 'path': '/dev/sdh'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:07:50 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637643133643461', 'path': '/dev/sdh'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:07:50 user nova-compute[75745]: DEBUG nova.objects.instance [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Lazy-loading 'flavor' on Instance uuid b566a6fd-2ea6-4df7-8866-eab5b4d398a7 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:07:50 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 17:07:50 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:07:50 user nova-compute[75745]:   <source dev="/dev/sdh"/>
Dec 01 17:07:50 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:07:50 user nova-compute[75745]:   <serial>43a3784d-ea83-44e2-af2d-91edb059fa72</serial>
Dec 01 17:07:50 user nova-compute[75745]: </disk>
Dec 01 17:07:50 user nova-compute[75745]:  {{(pid=75745) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 17:07:50 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:07:50 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:07:50 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] No VIF found with MAC fa:16:3e:48:5d:1c, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b34ed3e2-5e9c-43b1-a517-fe6918051c94 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Lock "b566a6fd-2ea6-4df7-8866-eab5b4d398a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.698s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'csPfUOeM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:07:51 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:07:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:07:51 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:07:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:07:51 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b589ae-9346-488e-b588-050a0fb9c635]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:07:51 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[883d381d-d2bb-4b63-8a91-31444078e574]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111] added
Dec 01 17:07:51 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[24966c3c-90e4-42f6-858d-91e1eb090536]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58d0434-73a9-4cde-ad67-ea36e1458359]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v csPfUOeM {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v csPfUOeM" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6acc92-cc2d-43a1-82ae-09107419d04b]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'csPfUOeM'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e725a7-76e7-47ae-b813-8b362cf32a5b]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e8668f-437a-42ee-9736-a05fba972675]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:07:51 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:07:51 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:07:51 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:07:51 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:07:51 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:07:51 user nova-compute[75745]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72 (non-flash)
Dec 01 17:07:51 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:07:51 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:07:51 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:07:51 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:07:51 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:07:51 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:07:51 user nova-compute[75745]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72 (non-flash)
Dec 01 17:07:51 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Acquiring lock "b566a6fd-2ea6-4df7-8866-eab5b4d398a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Lock "b566a6fd-2ea6-4df7-8866-eab5b4d398a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Acquiring lock "b566a6fd-2ea6-4df7-8866-eab5b4d398a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Lock "b566a6fd-2ea6-4df7-8866-eab5b4d398a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Lock "b566a6fd-2ea6-4df7-8866-eab5b4d398a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:51 user nova-compute[75745]: INFO nova.compute.manager [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Terminating instance
Dec 01 17:07:51 user nova-compute[75745]: DEBUG nova.compute.manager [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe07890-8e2a-4c58-b998-2fdb5ce61e70]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111, portal: 172.16.0.220,3260]
Dec 01 17:07:51 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111, portal: 172.16.0.220,3260] successful.
Dec 01 17:07:51 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9d7275-ddb9-49eb-b0ef-f101c7bd29e6]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e90c662-d27a-475e-9a5a-8f1287786c84]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:07:51 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:07:51 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:07:51 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:07:51 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:07:51 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:07:51 user nova-compute[75745]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72 (non-flash)
Dec 01 17:07:51 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:07:51 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:07:51 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:07:51 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:07:51 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:07:51 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:07:51 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:07:51 user nova-compute[75745]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72 (non-flash)
Dec 01 17:07:51 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:07:51 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.039s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2833ef5-c608-40cc-9da0-33b91d508f3b]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'csPfUOeM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:51 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-8395a700-4d16-493e-8b63-a19f525c8210 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Snapshot image upload complete
Dec 01 17:07:51 user nova-compute[75745]: INFO nova.compute.manager [None req-8395a700-4d16-493e-8b63-a19f525c8210 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Took 6.77 seconds to snapshot the instance on the hypervisor.
Dec 01 17:07:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-85df63e3-16ea-4a50-8a97-94a366988cee req-a6e63011-ca83-4744-9f1d-c45c71f26cf1 service nova] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Received event network-vif-unplugged-ea70774b-9342-49b5-b596-1da083140c0a {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-85df63e3-16ea-4a50-8a97-94a366988cee req-a6e63011-ca83-4744-9f1d-c45c71f26cf1 service nova] Acquiring lock "b566a6fd-2ea6-4df7-8866-eab5b4d398a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-85df63e3-16ea-4a50-8a97-94a366988cee req-a6e63011-ca83-4744-9f1d-c45c71f26cf1 service nova] Lock "b566a6fd-2ea6-4df7-8866-eab5b4d398a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-85df63e3-16ea-4a50-8a97-94a366988cee req-a6e63011-ca83-4744-9f1d-c45c71f26cf1 service nova] Lock "b566a6fd-2ea6-4df7-8866-eab5b4d398a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-85df63e3-16ea-4a50-8a97-94a366988cee req-a6e63011-ca83-4744-9f1d-c45c71f26cf1 service nova] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] No waiting events found dispatching network-vif-unplugged-ea70774b-9342-49b5-b596-1da083140c0a {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:07:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-85df63e3-16ea-4a50-8a97-94a366988cee req-a6e63011-ca83-4744-9f1d-c45c71f26cf1 service nova] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Received event network-vif-unplugged-ea70774b-9342-49b5-b596-1da083140c0a for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:52 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Instance destroyed successfully.
Dec 01 17:07:52 user nova-compute[75745]: DEBUG nova.objects.instance [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Lazy-loading 'resources' on Instance uuid b566a6fd-2ea6-4df7-8866-eab5b4d398a7 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:05:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1369399865',display_name='tempest-DeleteServersTestJSON-server-1369399865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1369399865',id=2,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:06:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e08f6fe2b83b488ca3febd45986ed592',ramdisk_id='',reservation_id='r-ca9c753f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-13375027',owner_user_name='tempest-DeleteServersTestJSON-13375027-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:06:02Z,user_data=None,user_id='4ad569596dc749f1a20e0bd4a1594a18',uuid=b566a6fd-2ea6-4df7-8866-eab5b4d398a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea70774b-9342-49b5-b596-1da083140c0a", "address": "fa:16:3e:48:5d:1c", "network": {"id": "004342e4-e51d-4e72-bda8-00a8e88f5e0a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2037576247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e08f6fe2b83b488ca3febd45986ed592", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea70774b-93", "ovs_interfaceid": "ea70774b-9342-49b5-b596-1da083140c0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Converting VIF {"id": "ea70774b-9342-49b5-b596-1da083140c0a", "address": "fa:16:3e:48:5d:1c", "network": {"id": "004342e4-e51d-4e72-bda8-00a8e88f5e0a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2037576247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e08f6fe2b83b488ca3febd45986ed592", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea70774b-93", "ovs_interfaceid": "ea70774b-9342-49b5-b596-1da083140c0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:5d:1c,bridge_name='br-int',has_traffic_filtering=True,id=ea70774b-9342-49b5-b596-1da083140c0a,network=Network(004342e4-e51d-4e72-bda8-00a8e88f5e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea70774b-93') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG os_vif [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:5d:1c,bridge_name='br-int',has_traffic_filtering=True,id=ea70774b-9342-49b5-b596-1da083140c0a,network=Network(004342e4-e51d-4e72-bda8-00a8e88f5e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea70774b-93') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea70774b-93, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c6faf5a9-fd2c-4fe3-8832-b3b6f8a54554) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:52 user nova-compute[75745]: INFO os_vif [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:5d:1c,bridge_name='br-int',has_traffic_filtering=True,id=ea70774b-9342-49b5-b596-1da083140c0a,network=Network(004342e4-e51d-4e72-bda8-00a8e88f5e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea70774b-93')
Dec 01 17:07:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YPuDdBLc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:07:52 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:07:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.430s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] <== connect_volume: return (1431ms) {'type': 'block', 'scsi_wwn': '23165633139323335', 'path': '/dev/sdi'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165633139323335', 'path': '/dev/sdi'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.199s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG nova.objects.instance [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lazy-loading 'flavor' on Instance uuid dc78dcf1-f005-415c-ac27-798cab8f52fb {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45b2fd3-3461-4d3e-917c-bc19534587c5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:07:52 user nova-compute[75745]: No targets found.
Dec 01 17:07:52 user nova-compute[75745]: iSNS:
Dec 01 17:07:52 user nova-compute[75745]: No targets found.
Dec 01 17:07:52 user nova-compute[75745]: STATIC:
Dec 01 17:07:52 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c
Dec 01 17:07:52 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:07:52 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:07:52 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749
Dec 01 17:07:52 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:07:52 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:07:52 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111
Dec 01 17:07:52 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:07:52 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:07:52 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de
Dec 01 17:07:52 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:07:52 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:07:52 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e
Dec 01 17:07:52 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:07:52 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:07:52 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72
Dec 01 17:07:52 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:07:52 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:07:52 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762
Dec 01 17:07:52 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:07:52 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:07:52 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9
Dec 01 17:07:52 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:07:52 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:07:52 user nova-compute[75745]: FIRMWARE:
Dec 01 17:07:52 user nova-compute[75745]: No targets found.
Dec 01 17:07:52 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:07:52 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:07:52 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11b3e54-623c-4e26-97a9-cd884192457b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0246555-f501-4972-a26e-09e487af4948]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:07:52 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:07:52 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:07:52 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:07:52 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:07:52 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:07:52 user nova-compute[75745]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72 (non-flash)
Dec 01 17:07:52 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:07:52 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:07:52 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:07:52 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:07:52 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:07:52 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:07:52 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:07:52 user nova-compute[75745]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72 (non-flash)
Dec 01 17:07:52 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:07:52 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24d824f760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72'): ({'sdh'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Removing single pathed devices sdh {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 17:07:52 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:07:52 user nova-compute[75745]:   <source dev="/dev/sdi"/>
Dec 01 17:07:52 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:07:52 user nova-compute[75745]:   <serial>3f50c0ac-c8a8-4290-8246-487eee7d3111</serial>
Dec 01 17:07:52 user nova-compute[75745]: </disk>
Dec 01 17:07:52 user nova-compute[75745]:  {{(pid=75745) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8ad893-ed64-4952-9186-9c40c4937153]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[130a8cf4-bf66-42b1-a3c4-ec27397673b6]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Flushing IO for device /dev/sdh {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[427dedd9-86b2-43ae-809f-9f36e7826183]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.054s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[999530a8-9395-4299-980b-3cb07b36fc08]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] SCSI volumes sdh have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6ccb16-422f-4761-8104-a10e102a7f72]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e6623c-ebcd-4eaa-bf0e-ce97563dac57]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72, portal: 172.16.0.220,3260]
Dec 01 17:07:53 user nova-compute[75745]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72, portal: 172.16.0.220,3260] successful.
Dec 01 17:07:53 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43a3784d-ea83-44e2-af2d-91edb059fa72 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7330986f-2f4d-46b0-ad79-7aefe7c30995]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] <== disconnect_volume: return (552ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:07:53 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Deleting instance files /opt/stack/data/nova/instances/b566a6fd-2ea6-4df7-8866-eab5b4d398a7_del
Dec 01 17:07:53 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Deletion of /opt/stack/data/nova/instances/b566a6fd-2ea6-4df7-8866-eab5b4d398a7_del complete
Dec 01 17:07:53 user nova-compute[75745]: INFO nova.compute.manager [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Took 1.59 seconds to destroy the instance on the hypervisor.
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] No VIF found with MAC fa:16:3e:9e:67:88, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SQOjKMiW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:07:53 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:07:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:07:53 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:07:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:07:53 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cc284f-e508-4c75-9dab-9adfcf6de286]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:07:53 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e86761c-6c82-4446-b111-b75b17ad5c8c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121] added
Dec 01 17:07:53 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee231cf-3e92-472b-ae59-aafa5a1fe513]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-732bd250-86ea-4354-b83d-c455047ad496 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "dc78dcf1-f005-415c-ac27-798cab8f52fb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.908s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c874d522-fc61-4b86-b322-71ce77bdafaa]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SQOjKMiW {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SQOjKMiW" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe780fc-217a-4fbf-ae10-b6fe6af26669]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SQOjKMiW'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[860b4de3-4708-4c65-ab3e-054edfc5b5f9]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdb4fd0-9541-4cbe-ac20-3ec52e5403dd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:07:53 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:07:53 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:07:53 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:07:53 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:07:53 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:07:53 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:07:53 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:07:53 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:07:53 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:07:53 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:07:53 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:07:53 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:07:53 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:07:53 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[549b312e-d4bd-43a7-92d1-7fe3e093ee9c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121, portal: 172.16.0.220,3260]
Dec 01 17:07:53 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121, portal: 172.16.0.220,3260] successful.
Dec 01 17:07:53 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5260d94d-9e5b-4c46-8b21-32cb1a826eeb]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b808896-ba45-4333-b4ba-286d2988b294]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:07:53 user nova-compute[75745]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:07:53 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:07:53 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:07:53 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:07:53 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:07:53 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:07:53 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:07:53 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:07:53 user nova-compute[75745]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:07:53 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:07:53 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:07:53 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:07:53 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:07:53 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:07:53 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:07:53 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] HCTL ('39', '-', '-', 0) found on session 10 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8059ba-0ffd-4ed9-ae2d-1950b4817e32]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Searching for a device in session 10 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SQOjKMiW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:07:53 user nova-compute[75745]: DEBUG nova.compute.manager [req-f7ca2f81-6e2a-495f-adf6-f894f3a9cbe7 req-af93e3b5-8524-4a42-82f2-6875f2498c2a service nova] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Received event network-vif-deleted-ea70774b-9342-49b5-b596-1da083140c0a {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:53 user nova-compute[75745]: INFO nova.compute.manager [req-f7ca2f81-6e2a-495f-adf6-f894f3a9cbe7 req-af93e3b5-8524-4a42-82f2-6875f2498c2a service nova] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Neutron deleted interface ea70774b-9342-49b5-b596-1da083140c0a; detaching it from the instance and deleting it from the info cache
Dec 01 17:07:53 user nova-compute[75745]: DEBUG nova.network.neutron [req-f7ca2f81-6e2a-495f-adf6-f894f3a9cbe7 req-af93e3b5-8524-4a42-82f2-6875f2498c2a service nova] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:07:53 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Took 0.72 seconds to deallocate network for instance.
Dec 01 17:07:53 user nova-compute[75745]: DEBUG nova.compute.manager [req-f7ca2f81-6e2a-495f-adf6-f894f3a9cbe7 req-af93e3b5-8524-4a42-82f2-6875f2498c2a service nova] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Detach interface failed, port_id=ea70774b-9342-49b5-b596-1da083140c0a, reason: Instance b566a6fd-2ea6-4df7-8866-eab5b4d398a7 could not be found. {{(pid=75745) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 17:07:54 user nova-compute[75745]: DEBUG nova.compute.manager [req-6b6b91c3-dffa-47dd-9dad-f2990263ccce req-14ba56f0-e02f-46cd-a0be-9475823de93d service nova] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Received event network-vif-plugged-ea70774b-9342-49b5-b596-1da083140c0a {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6b6b91c3-dffa-47dd-9dad-f2990263ccce req-14ba56f0-e02f-46cd-a0be-9475823de93d service nova] Acquiring lock "b566a6fd-2ea6-4df7-8866-eab5b4d398a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6b6b91c3-dffa-47dd-9dad-f2990263ccce req-14ba56f0-e02f-46cd-a0be-9475823de93d service nova] Lock "b566a6fd-2ea6-4df7-8866-eab5b4d398a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6b6b91c3-dffa-47dd-9dad-f2990263ccce req-14ba56f0-e02f-46cd-a0be-9475823de93d service nova] Lock "b566a6fd-2ea6-4df7-8866-eab5b4d398a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:54 user nova-compute[75745]: DEBUG nova.compute.manager [req-6b6b91c3-dffa-47dd-9dad-f2990263ccce req-14ba56f0-e02f-46cd-a0be-9475823de93d service nova] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] No waiting events found dispatching network-vif-plugged-ea70774b-9342-49b5-b596-1da083140c0a {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:07:54 user nova-compute[75745]: WARNING nova.compute.manager [req-6b6b91c3-dffa-47dd-9dad-f2990263ccce req-14ba56f0-e02f-46cd-a0be-9475823de93d service nova] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Received unexpected event network-vif-plugged-ea70774b-9342-49b5-b596-1da083140c0a for instance with vm_state active and task_state deleting.
Dec 01 17:07:54 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:07:54 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '23664333931656464', 'path': '/dev/sdh'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:07:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664333931656464', 'path': '/dev/sdh'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:07:54 user nova-compute[75745]: DEBUG nova.objects.instance [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lazy-loading 'flavor' on Instance uuid 4ac6f586-cc5b-4a3f-b374-4b2006a48427 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:07:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 17:07:54 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:07:54 user nova-compute[75745]:   <source dev="/dev/sdh"/>
Dec 01 17:07:54 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:07:54 user nova-compute[75745]:   <serial>609a2122-bfa0-40d7-b912-c4d799157121</serial>
Dec 01 17:07:54 user nova-compute[75745]: </disk>
Dec 01 17:07:54 user nova-compute[75745]:  {{(pid=75745) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 17:07:54 user nova-compute[75745]: INFO nova.compute.manager [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] [instance: b566a6fd-2ea6-4df7-8866-eab5b4d398a7] Took 0.88 seconds to detach 1 volumes for instance.
Dec 01 17:07:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:55 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:07:55 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:07:55 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:07:55 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] No VIF found with MAC fa:16:3e:d3:4e:b4, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:07:55 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:07:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:55 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Deleted allocations for instance b566a6fd-2ea6-4df7-8866-eab5b4d398a7
Dec 01 17:07:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-159e9a50-2298-4c9c-b937-8f8a4c4663b9 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.247s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-71f71508-5c43-4021-ab4e-ba39a298b673 tempest-DeleteServersTestJSON-13375027 tempest-DeleteServersTestJSON-13375027-project-member] Lock "b566a6fd-2ea6-4df7-8866-eab5b4d398a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.280s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-67af71b4-a7c8-4167-8658-495a20a92cef tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-67af71b4-a7c8-4167-8658-495a20a92cef tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:55 user nova-compute[75745]: DEBUG nova.compute.manager [None req-67af71b4-a7c8-4167-8658-495a20a92cef tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:07:55 user nova-compute[75745]: DEBUG nova.compute.manager [None req-67af71b4-a7c8-4167-8658-495a20a92cef tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75745) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Dec 01 17:07:55 user nova-compute[75745]: DEBUG nova.objects.instance [None req-67af71b4-a7c8-4167-8658-495a20a92cef tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lazy-loading 'flavor' on Instance uuid 4ac6f586-cc5b-4a3f-b374-4b2006a48427 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:07:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-9fe66be7-6a2f-4372-8f5d-4b8fd9bd3372 req-d2bbb4ab-d12c-441d-a6cd-1bb0022a1b9f service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Received event network-vif-unplugged-b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-9fe66be7-6a2f-4372-8f5d-4b8fd9bd3372 req-d2bbb4ab-d12c-441d-a6cd-1bb0022a1b9f service nova] Acquiring lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-9fe66be7-6a2f-4372-8f5d-4b8fd9bd3372 req-d2bbb4ab-d12c-441d-a6cd-1bb0022a1b9f service nova] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-9fe66be7-6a2f-4372-8f5d-4b8fd9bd3372 req-d2bbb4ab-d12c-441d-a6cd-1bb0022a1b9f service nova] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-9fe66be7-6a2f-4372-8f5d-4b8fd9bd3372 req-d2bbb4ab-d12c-441d-a6cd-1bb0022a1b9f service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] No waiting events found dispatching network-vif-unplugged-b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:07:56 user nova-compute[75745]: WARNING nova.compute.manager [req-9fe66be7-6a2f-4372-8f5d-4b8fd9bd3372 req-d2bbb4ab-d12c-441d-a6cd-1bb0022a1b9f service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Received unexpected event network-vif-unplugged-b4990a3b-371a-44eb-98d8-685dc63590da for instance with vm_state active and task_state powering-off.
Dec 01 17:07:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "b3a04948-936e-47c8-8a5f-e7bdee5b69db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "b3a04948-936e-47c8-8a5f-e7bdee5b69db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:56 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:07:56 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Instance destroyed successfully.
Dec 01 17:07:56 user nova-compute[75745]: DEBUG nova.compute.manager [None req-67af71b4-a7c8-4167-8658-495a20a92cef tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:07:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:07:56 user nova-compute[75745]: INFO nova.compute.claims [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Claim successful on node user
Dec 01 17:07:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-67af71b4-a7c8-4167-8658-495a20a92cef tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.910s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:57 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:07:57 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:07:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:57 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:07:57 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:07:57 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:07:57 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:07:57 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:07:57 user nova-compute[75745]: DEBUG nova.policy [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76845c98f91449df9196e19187b1b786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1730419061445f98680b8c81753a4f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:07:57 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:07:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:07:57 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Creating image(s)
Dec 01 17:07:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "/opt/stack/data/nova/instances/b3a04948-936e-47c8-8a5f-e7bdee5b69db/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "/opt/stack/data/nova/instances/b3a04948-936e-47c8-8a5f-e7bdee5b69db/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "/opt/stack/data/nova/instances/b3a04948-936e-47c8-8a5f-e7bdee5b69db/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.205s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.191s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/b3a04948-936e-47c8-8a5f-e7bdee5b69db/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:57 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Successfully created port: 1457b6ab-6243-4c0d-a336-441dcdad820d {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:07:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/b3a04948-936e-47c8-8a5f-e7bdee5b69db/disk 1073741824" returned: 0 in 0.104s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.168s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:58 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b3a04948-936e-47c8-8a5f-e7bdee5b69db/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:07:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3a04948-936e-47c8-8a5f-e7bdee5b69db/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:07:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3a04948-936e-47c8-8a5f-e7bdee5b69db/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:07:58 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Cannot resize image /opt/stack/data/nova/instances/b3a04948-936e-47c8-8a5f-e7bdee5b69db/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:07:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:07:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Ensure instance console log exists: /opt/stack/data/nova/instances/b3a04948-936e-47c8-8a5f-e7bdee5b69db/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:07:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-b0dddcde-7eb0-4f8a-b828-6607a0b46291 req-a3b94593-bd0b-4d07-9b9f-d87d86222aae service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Received event network-vif-plugged-b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b0dddcde-7eb0-4f8a-b828-6607a0b46291 req-a3b94593-bd0b-4d07-9b9f-d87d86222aae service nova] Acquiring lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:07:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b0dddcde-7eb0-4f8a-b828-6607a0b46291 req-a3b94593-bd0b-4d07-9b9f-d87d86222aae service nova] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:07:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b0dddcde-7eb0-4f8a-b828-6607a0b46291 req-a3b94593-bd0b-4d07-9b9f-d87d86222aae service nova] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:07:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-b0dddcde-7eb0-4f8a-b828-6607a0b46291 req-a3b94593-bd0b-4d07-9b9f-d87d86222aae service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] No waiting events found dispatching network-vif-plugged-b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:07:58 user nova-compute[75745]: WARNING nova.compute.manager [req-b0dddcde-7eb0-4f8a-b828-6607a0b46291 req-a3b94593-bd0b-4d07-9b9f-d87d86222aae service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Received unexpected event network-vif-plugged-b4990a3b-371a-44eb-98d8-685dc63590da for instance with vm_state stopped and task_state None.
Dec 01 17:07:58 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Successfully updated port: 1457b6ab-6243-4c0d-a336-441dcdad820d {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:07:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "refresh_cache-b3a04948-936e-47c8-8a5f-e7bdee5b69db" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:07:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquired lock "refresh_cache-b3a04948-936e-47c8-8a5f-e7bdee5b69db" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:07:58 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:07:58 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:07:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Updating instance_info_cache with network_info: [{"id": "1457b6ab-6243-4c0d-a336-441dcdad820d", "address": "fa:16:3e:8e:6f:d2", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1457b6ab-62", "ovs_interfaceid": "1457b6ab-6243-4c0d-a336-441dcdad820d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Releasing lock "refresh_cache-b3a04948-936e-47c8-8a5f-e7bdee5b69db" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Instance network_info: |[{"id": "1457b6ab-6243-4c0d-a336-441dcdad820d", "address": "fa:16:3e:8e:6f:d2", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1457b6ab-62", "ovs_interfaceid": "1457b6ab-6243-4c0d-a336-441dcdad820d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Start _get_guest_xml network_info=[{"id": "1457b6ab-6243-4c0d-a336-441dcdad820d", "address": "fa:16:3e:8e:6f:d2", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1457b6ab-62", "ovs_interfaceid": "1457b6ab-6243-4c0d-a336-441dcdad820d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:07:59 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:07:59 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:07:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:07:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1529912563',display_name='tempest-AttachVolumeNegativeTest-server-1529912563',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1529912563',id=12,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBx22Saygtup37i3j0imcyjOsIQHFQhGiFBCD3HVPoBVa8SzI4Lab3PiPMPlLyi9YmTvglelP7KF1NiCosafP/sbMzee9X+93eBqEvSoDmWZ0uH5CpJOwsvGi/Y6JtlBMA==',key_name='tempest-keypair-1098087906',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1730419061445f98680b8c81753a4f3',ramdisk_id='',reservation_id='r-090fxoxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1227943771',owner_user_name='tempest-AttachVolumeNegativeTest-1227943771-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:07:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76845c98f91449df9196e19187b1b786',uuid=b3a04948-936e-47c8-8a5f-e7bdee5b69db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1457b6ab-6243-4c0d-a336-441dcdad820d", "address": "fa:16:3e:8e:6f:d2", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1457b6ab-62", "ovs_interfaceid": "1457b6ab-6243-4c0d-a336-441dcdad820d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Converting VIF {"id": "1457b6ab-6243-4c0d-a336-441dcdad820d", "address": "fa:16:3e:8e:6f:d2", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1457b6ab-62", "ovs_interfaceid": "1457b6ab-6243-4c0d-a336-441dcdad820d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:6f:d2,bridge_name='br-int',has_traffic_filtering=True,id=1457b6ab-6243-4c0d-a336-441dcdad820d,network=Network(8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1457b6ab-62') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG nova.objects.instance [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lazy-loading 'pci_devices' on Instance uuid b3a04948-936e-47c8-8a5f-e7bdee5b69db {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:07:59 user nova-compute[75745]:   <uuid>b3a04948-936e-47c8-8a5f-e7bdee5b69db</uuid>
Dec 01 17:07:59 user nova-compute[75745]:   <name>instance-0000000c</name>
Dec 01 17:07:59 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:07:59 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:07:59 user nova-compute[75745]:   <metadata>
Dec 01 17:07:59 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:07:59 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:07:59 user nova-compute[75745]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1529912563</nova:name>
Dec 01 17:07:59 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:07:59</nova:creationTime>
Dec 01 17:07:59 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:07:59 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:07:59 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:07:59 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:07:59 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:07:59 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:07:59 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:07:59 user nova-compute[75745]:       <nova:owner>
Dec 01 17:07:59 user nova-compute[75745]:         <nova:user uuid="76845c98f91449df9196e19187b1b786">tempest-AttachVolumeNegativeTest-1227943771-project-member</nova:user>
Dec 01 17:07:59 user nova-compute[75745]:         <nova:project uuid="c1730419061445f98680b8c81753a4f3">tempest-AttachVolumeNegativeTest-1227943771</nova:project>
Dec 01 17:07:59 user nova-compute[75745]:       </nova:owner>
Dec 01 17:07:59 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:07:59 user nova-compute[75745]:       <nova:ports>
Dec 01 17:07:59 user nova-compute[75745]:         <nova:port uuid="1457b6ab-6243-4c0d-a336-441dcdad820d">
Dec 01 17:07:59 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 01 17:07:59 user nova-compute[75745]:         </nova:port>
Dec 01 17:07:59 user nova-compute[75745]:       </nova:ports>
Dec 01 17:07:59 user nova-compute[75745]:     </nova:instance>
Dec 01 17:07:59 user nova-compute[75745]:   </metadata>
Dec 01 17:07:59 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:07:59 user nova-compute[75745]:     <system>
Dec 01 17:07:59 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:07:59 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:07:59 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:07:59 user nova-compute[75745]:       <entry name="serial">b3a04948-936e-47c8-8a5f-e7bdee5b69db</entry>
Dec 01 17:07:59 user nova-compute[75745]:       <entry name="uuid">b3a04948-936e-47c8-8a5f-e7bdee5b69db</entry>
Dec 01 17:07:59 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:07:59 user nova-compute[75745]:     </system>
Dec 01 17:07:59 user nova-compute[75745]:   </sysinfo>
Dec 01 17:07:59 user nova-compute[75745]:   <os>
Dec 01 17:07:59 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:07:59 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:07:59 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:07:59 user nova-compute[75745]:   </os>
Dec 01 17:07:59 user nova-compute[75745]:   <features>
Dec 01 17:07:59 user nova-compute[75745]:     <acpi/>
Dec 01 17:07:59 user nova-compute[75745]:     <apic/>
Dec 01 17:07:59 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:07:59 user nova-compute[75745]:   </features>
Dec 01 17:07:59 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:07:59 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:07:59 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:07:59 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:07:59 user nova-compute[75745]:   </clock>
Dec 01 17:07:59 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:07:59 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:07:59 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:07:59 user nova-compute[75745]:   </cpu>
Dec 01 17:07:59 user nova-compute[75745]:   <devices>
Dec 01 17:07:59 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:07:59 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:07:59 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/b3a04948-936e-47c8-8a5f-e7bdee5b69db/disk"/>
Dec 01 17:07:59 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:07:59 user nova-compute[75745]:     </disk>
Dec 01 17:07:59 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:07:59 user nova-compute[75745]:       <mac address="fa:16:3e:8e:6f:d2"/>
Dec 01 17:07:59 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:07:59 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:07:59 user nova-compute[75745]:       <target dev="tap1457b6ab-62"/>
Dec 01 17:07:59 user nova-compute[75745]:     </interface>
Dec 01 17:07:59 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:07:59 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/b3a04948-936e-47c8-8a5f-e7bdee5b69db/console.log" append="off"/>
Dec 01 17:07:59 user nova-compute[75745]:     </serial>
Dec 01 17:07:59 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:07:59 user nova-compute[75745]:     <video>
Dec 01 17:07:59 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:07:59 user nova-compute[75745]:     </video>
Dec 01 17:07:59 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:07:59 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:07:59 user nova-compute[75745]:     </rng>
Dec 01 17:07:59 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:07:59 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:07:59 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:07:59 user nova-compute[75745]:     </memballoon>
Dec 01 17:07:59 user nova-compute[75745]:   </devices>
Dec 01 17:07:59 user nova-compute[75745]: </domain>
Dec 01 17:07:59 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:07:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1529912563',display_name='tempest-AttachVolumeNegativeTest-server-1529912563',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1529912563',id=12,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBx22Saygtup37i3j0imcyjOsIQHFQhGiFBCD3HVPoBVa8SzI4Lab3PiPMPlLyi9YmTvglelP7KF1NiCosafP/sbMzee9X+93eBqEvSoDmWZ0uH5CpJOwsvGi/Y6JtlBMA==',key_name='tempest-keypair-1098087906',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1730419061445f98680b8c81753a4f3',ramdisk_id='',reservation_id='r-090fxoxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1227943771',owner_user_name='tempest-AttachVolumeNegativeTest-1227943771-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:07:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76845c98f91449df9196e19187b1b786',uuid=b3a04948-936e-47c8-8a5f-e7bdee5b69db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1457b6ab-6243-4c0d-a336-441dcdad820d", "address": "fa:16:3e:8e:6f:d2", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1457b6ab-62", "ovs_interfaceid": "1457b6ab-6243-4c0d-a336-441dcdad820d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Converting VIF {"id": "1457b6ab-6243-4c0d-a336-441dcdad820d", "address": "fa:16:3e:8e:6f:d2", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1457b6ab-62", "ovs_interfaceid": "1457b6ab-6243-4c0d-a336-441dcdad820d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:6f:d2,bridge_name='br-int',has_traffic_filtering=True,id=1457b6ab-6243-4c0d-a336-441dcdad820d,network=Network(8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1457b6ab-62') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG os_vif [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:6f:d2,bridge_name='br-int',has_traffic_filtering=True,id=1457b6ab-6243-4c0d-a336-441dcdad820d,network=Network(8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1457b6ab-62') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad46a957-127e-5a93-8aea-9361c31712b7', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1457b6ab-62, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1457b6ab-62, col_values=(('qos', UUID('b5375309-ab3b-4f8b-ada0-4632d161938b')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1457b6ab-62, col_values=(('external_ids', {'iface-id': '1457b6ab-6243-4c0d-a336-441dcdad820d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:6f:d2', 'vm-uuid': 'b3a04948-936e-47c8-8a5f-e7bdee5b69db'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:07:59 user nova-compute[75745]: INFO os_vif [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:6f:d2,bridge_name='br-int',has_traffic_filtering=True,id=1457b6ab-6243-4c0d-a336-441dcdad820d,network=Network(8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1457b6ab-62')
Dec 01 17:07:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] No VIF found with MAC fa:16:3e:8e:6f:d2, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG nova.compute.manager [req-2536abf3-1b74-412c-922b-7ef0c780f4e8 req-448563db-5ef8-496d-ab3f-c1f5563e2323 service nova] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Received event network-changed-0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG nova.compute.manager [req-2536abf3-1b74-412c-922b-7ef0c780f4e8 req-448563db-5ef8-496d-ab3f-c1f5563e2323 service nova] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Refreshing instance network info cache due to event network-changed-0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2536abf3-1b74-412c-922b-7ef0c780f4e8 req-448563db-5ef8-496d-ab3f-c1f5563e2323 service nova] Acquiring lock "refresh_cache-c7fb74ee-dfa0-40e1-8773-99bd4a0402d5" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2536abf3-1b74-412c-922b-7ef0c780f4e8 req-448563db-5ef8-496d-ab3f-c1f5563e2323 service nova] Acquired lock "refresh_cache-c7fb74ee-dfa0-40e1-8773-99bd4a0402d5" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:07:59 user nova-compute[75745]: DEBUG nova.network.neutron [req-2536abf3-1b74-412c-922b-7ef0c780f4e8 req-448563db-5ef8-496d-ab3f-c1f5563e2323 service nova] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Refreshing network info cache for port 0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:08:00 user nova-compute[75745]: DEBUG nova.network.neutron [req-2536abf3-1b74-412c-922b-7ef0c780f4e8 req-448563db-5ef8-496d-ab3f-c1f5563e2323 service nova] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Updated VIF entry in instance network info cache for port 0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:08:00 user nova-compute[75745]: DEBUG nova.network.neutron [req-2536abf3-1b74-412c-922b-7ef0c780f4e8 req-448563db-5ef8-496d-ab3f-c1f5563e2323 service nova] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Updating instance_info_cache with network_info: [{"id": "0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f", "address": "fa:16:3e:1d:54:77", "network": {"id": "1d5056ab-3b1d-40a2-b83f-5012d1e8c71f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1526171674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca0e64357e24c7098548625d1e269f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f98a2c5-bb", "ovs_interfaceid": "0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:08:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2536abf3-1b74-412c-922b-7ef0c780f4e8 req-448563db-5ef8-496d-ab3f-c1f5563e2323 service nova] Releasing lock "refresh_cache-c7fb74ee-dfa0-40e1-8773-99bd4a0402d5" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:08:00 user nova-compute[75745]: DEBUG nova.compute.manager [req-9d65fe2f-ce1a-47ea-b612-f422e1982912 req-b5245332-e36f-46ab-8bda-1a22a2493263 service nova] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Received event network-changed-1457b6ab-6243-4c0d-a336-441dcdad820d {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:00 user nova-compute[75745]: DEBUG nova.compute.manager [req-9d65fe2f-ce1a-47ea-b612-f422e1982912 req-b5245332-e36f-46ab-8bda-1a22a2493263 service nova] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Refreshing instance network info cache due to event network-changed-1457b6ab-6243-4c0d-a336-441dcdad820d. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:08:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-9d65fe2f-ce1a-47ea-b612-f422e1982912 req-b5245332-e36f-46ab-8bda-1a22a2493263 service nova] Acquiring lock "refresh_cache-b3a04948-936e-47c8-8a5f-e7bdee5b69db" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:08:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-9d65fe2f-ce1a-47ea-b612-f422e1982912 req-b5245332-e36f-46ab-8bda-1a22a2493263 service nova] Acquired lock "refresh_cache-b3a04948-936e-47c8-8a5f-e7bdee5b69db" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:08:00 user nova-compute[75745]: DEBUG nova.network.neutron [req-9d65fe2f-ce1a-47ea-b612-f422e1982912 req-b5245332-e36f-46ab-8bda-1a22a2493263 service nova] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Refreshing network info cache for port 1457b6ab-6243-4c0d-a336-441dcdad820d {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:08:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:00 user nova-compute[75745]: DEBUG nova.network.neutron [req-9d65fe2f-ce1a-47ea-b612-f422e1982912 req-b5245332-e36f-46ab-8bda-1a22a2493263 service nova] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Updated VIF entry in instance network info cache for port 1457b6ab-6243-4c0d-a336-441dcdad820d. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:08:00 user nova-compute[75745]: DEBUG nova.network.neutron [req-9d65fe2f-ce1a-47ea-b612-f422e1982912 req-b5245332-e36f-46ab-8bda-1a22a2493263 service nova] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Updating instance_info_cache with network_info: [{"id": "1457b6ab-6243-4c0d-a336-441dcdad820d", "address": "fa:16:3e:8e:6f:d2", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1457b6ab-62", "ovs_interfaceid": "1457b6ab-6243-4c0d-a336-441dcdad820d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:08:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-9d65fe2f-ce1a-47ea-b612-f422e1982912 req-b5245332-e36f-46ab-8bda-1a22a2493263 service nova] Releasing lock "refresh_cache-b3a04948-936e-47c8-8a5f-e7bdee5b69db" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:08:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:01 user nova-compute[75745]: DEBUG nova.compute.manager [req-6ea69ac6-64c6-4f1a-bf45-95b20deb47ed req-5c3dfd11-d4dc-4b13-bbb6-d9acaa8fde1a service nova] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Received event network-vif-plugged-1457b6ab-6243-4c0d-a336-441dcdad820d {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6ea69ac6-64c6-4f1a-bf45-95b20deb47ed req-5c3dfd11-d4dc-4b13-bbb6-d9acaa8fde1a service nova] Acquiring lock "b3a04948-936e-47c8-8a5f-e7bdee5b69db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6ea69ac6-64c6-4f1a-bf45-95b20deb47ed req-5c3dfd11-d4dc-4b13-bbb6-d9acaa8fde1a service nova] Lock "b3a04948-936e-47c8-8a5f-e7bdee5b69db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6ea69ac6-64c6-4f1a-bf45-95b20deb47ed req-5c3dfd11-d4dc-4b13-bbb6-d9acaa8fde1a service nova] Lock "b3a04948-936e-47c8-8a5f-e7bdee5b69db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:01 user nova-compute[75745]: DEBUG nova.compute.manager [req-6ea69ac6-64c6-4f1a-bf45-95b20deb47ed req-5c3dfd11-d4dc-4b13-bbb6-d9acaa8fde1a service nova] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] No waiting events found dispatching network-vif-plugged-1457b6ab-6243-4c0d-a336-441dcdad820d {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:01 user nova-compute[75745]: WARNING nova.compute.manager [req-6ea69ac6-64c6-4f1a-bf45-95b20deb47ed req-5c3dfd11-d4dc-4b13-bbb6-d9acaa8fde1a service nova] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Received unexpected event network-vif-plugged-1457b6ab-6243-4c0d-a336-441dcdad820d for instance with vm_state building and task_state spawning.
Dec 01 17:08:02 user nova-compute[75745]: DEBUG nova.compute.manager [req-79dcbbbc-8541-4d65-8753-2ce1af7db2ac req-c491b700-d54a-4259-84df-9c87ad6e5866 service nova] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Received event network-changed-9f322a2f-deae-4c15-8b43-c21c779ed76a {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:02 user nova-compute[75745]: DEBUG nova.compute.manager [req-79dcbbbc-8541-4d65-8753-2ce1af7db2ac req-c491b700-d54a-4259-84df-9c87ad6e5866 service nova] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Refreshing instance network info cache due to event network-changed-9f322a2f-deae-4c15-8b43-c21c779ed76a. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:08:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-79dcbbbc-8541-4d65-8753-2ce1af7db2ac req-c491b700-d54a-4259-84df-9c87ad6e5866 service nova] Acquiring lock "refresh_cache-d9bfb9f9-95a4-49f5-b781-5e78c83c54d1" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:08:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-79dcbbbc-8541-4d65-8753-2ce1af7db2ac req-c491b700-d54a-4259-84df-9c87ad6e5866 service nova] Acquired lock "refresh_cache-d9bfb9f9-95a4-49f5-b781-5e78c83c54d1" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:08:02 user nova-compute[75745]: DEBUG nova.network.neutron [req-79dcbbbc-8541-4d65-8753-2ce1af7db2ac req-c491b700-d54a-4259-84df-9c87ad6e5866 service nova] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Refreshing network info cache for port 9f322a2f-deae-4c15-8b43-c21c779ed76a {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:08:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Acquiring lock "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Lock "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:02 user nova-compute[75745]: DEBUG nova.objects.instance [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Lazy-loading 'flavor' on Instance uuid d9bfb9f9-95a4-49f5-b781-5e78c83c54d1 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:08:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Lock "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:02 user nova-compute[75745]: DEBUG nova.network.neutron [req-79dcbbbc-8541-4d65-8753-2ce1af7db2ac req-c491b700-d54a-4259-84df-9c87ad6e5866 service nova] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Updated VIF entry in instance network info cache for port 9f322a2f-deae-4c15-8b43-c21c779ed76a. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:08:02 user nova-compute[75745]: DEBUG nova.network.neutron [req-79dcbbbc-8541-4d65-8753-2ce1af7db2ac req-c491b700-d54a-4259-84df-9c87ad6e5866 service nova] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Updating instance_info_cache with network_info: [{"id": "9f322a2f-deae-4c15-8b43-c21c779ed76a", "address": "fa:16:3e:d0:61:8e", "network": {"id": "2cbf6c6e-fe98-488e-b0d7-fe25e97af92d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1025939428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2aaa61f4c24fd5adaca1c9b5445ed8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f322a2f-de", "ovs_interfaceid": "9f322a2f-deae-4c15-8b43-c21c779ed76a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:08:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Acquiring lock "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Lock "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:02 user nova-compute[75745]: INFO nova.compute.manager [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Attaching volume b000c1c2-a9f3-4629-b034-ef182141787e to /dev/vdb
Dec 01 17:08:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-79dcbbbc-8541-4d65-8753-2ce1af7db2ac req-c491b700-d54a-4259-84df-9c87ad6e5866 service nova] Releasing lock "refresh_cache-d9bfb9f9-95a4-49f5-b781-5e78c83c54d1" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:08:02 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:08:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:08:02 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Instance spawned successfully.
Dec 01 17:08:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:08:02 user nova-compute[75745]: DEBUG os_brick.utils [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:08:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:02 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[901cc287-f9dc-46e9-9f69-aa4b7aaa8640]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[47dde195-7f48-47b7-b622-49f25f996787]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79a279b-cf8d-4f99-81a7-1d083e4521ea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56c6dcc-c1c4-41e3-8373-264d3c1049dd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:08:03 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:08:03 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd31f6c9-de15-417a-9f23-bf565dd2d01c]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG os_brick.utils [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Updating existing volume attachment record: bea2536c-3acb-4b70-b457-48065d6c7af0 {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:08:03 user nova-compute[75745]: INFO nova.compute.manager [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Took 5.63 seconds to spawn the instance on the hypervisor.
Dec 01 17:08:03 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:08:03 user nova-compute[75745]: INFO nova.compute.manager [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Took 6.37 seconds to build instance.
Dec 01 17:08:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d338342d-0535-409e-8747-5eba738c4517 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "b3a04948-936e-47c8-8a5f-e7bdee5b69db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.516s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG nova.compute.manager [req-1081164a-3eba-4132-8f51-8ef27f7ddaca req-22ac1ca8-4449-4195-947c-7e786151de86 service nova] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Received event network-vif-plugged-1457b6ab-6243-4c0d-a336-441dcdad820d {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1081164a-3eba-4132-8f51-8ef27f7ddaca req-22ac1ca8-4449-4195-947c-7e786151de86 service nova] Acquiring lock "b3a04948-936e-47c8-8a5f-e7bdee5b69db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1081164a-3eba-4132-8f51-8ef27f7ddaca req-22ac1ca8-4449-4195-947c-7e786151de86 service nova] Lock "b3a04948-936e-47c8-8a5f-e7bdee5b69db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1081164a-3eba-4132-8f51-8ef27f7ddaca req-22ac1ca8-4449-4195-947c-7e786151de86 service nova] Lock "b3a04948-936e-47c8-8a5f-e7bdee5b69db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG nova.compute.manager [req-1081164a-3eba-4132-8f51-8ef27f7ddaca req-22ac1ca8-4449-4195-947c-7e786151de86 service nova] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] No waiting events found dispatching network-vif-plugged-1457b6ab-6243-4c0d-a336-441dcdad820d {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:03 user nova-compute[75745]: WARNING nova.compute.manager [req-1081164a-3eba-4132-8f51-8ef27f7ddaca req-22ac1ca8-4449-4195-947c-7e786151de86 service nova] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Received unexpected event network-vif-plugged-1457b6ab-6243-4c0d-a336-441dcdad820d for instance with vm_state active and task_state None.
Dec 01 17:08:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Acquiring lock "c7fb74ee-dfa0-40e1-8773-99bd4a0402d5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Lock "c7fb74ee-dfa0-40e1-8773-99bd4a0402d5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG nova.objects.instance [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Lazy-loading 'flavor' on Instance uuid c7fb74ee-dfa0-40e1-8773-99bd4a0402d5 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Lock "c7fb74ee-dfa0-40e1-8773-99bd4a0402d5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Acquiring lock "c7fb74ee-dfa0-40e1-8773-99bd4a0402d5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Lock "c7fb74ee-dfa0-40e1-8773-99bd4a0402d5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:03 user nova-compute[75745]: INFO nova.compute.manager [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Attaching volume 549f164a-dddc-479f-8178-e3db004fe8b0 to /dev/sdc
Dec 01 17:08:03 user nova-compute[75745]: DEBUG os_brick.utils [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef44d67-4c79-4afb-9ad8-10e26ccd2061]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb04177-75cc-4f7b-970f-df1dbc1a2672]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddd03dd-0bb5-47d1-82a2-7773e30ff96a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bd35d0-8843-49df-9f12-7574a91460b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:08:03 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:08:03 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b8e1b9-396e-453d-9cdd-27093838d229]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG os_brick.utils [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:08:03 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Updating existing volume attachment record: f88a3e4f-fa9f-40c5-96d4-b2c07484f53f {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:08:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:05 user nova-compute[75745]: DEBUG nova.compute.manager [req-d9be327b-9e3e-4b15-8b72-c27fc6de4004 req-239d64bc-c709-49a8-a085-1ea183cfc1ed service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Received event network-changed-f2e5d5e1-b6be-444f-b8b6-c8f26cef560b {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:05 user nova-compute[75745]: DEBUG nova.compute.manager [req-d9be327b-9e3e-4b15-8b72-c27fc6de4004 req-239d64bc-c709-49a8-a085-1ea183cfc1ed service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Refreshing instance network info cache due to event network-changed-f2e5d5e1-b6be-444f-b8b6-c8f26cef560b. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:08:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d9be327b-9e3e-4b15-8b72-c27fc6de4004 req-239d64bc-c709-49a8-a085-1ea183cfc1ed service nova] Acquiring lock "refresh_cache-02715ae1-5200-4df5-8430-2f19a610d2bb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:08:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d9be327b-9e3e-4b15-8b72-c27fc6de4004 req-239d64bc-c709-49a8-a085-1ea183cfc1ed service nova] Acquired lock "refresh_cache-02715ae1-5200-4df5-8430-2f19a610d2bb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:08:05 user nova-compute[75745]: DEBUG nova.network.neutron [req-d9be327b-9e3e-4b15-8b72-c27fc6de4004 req-239d64bc-c709-49a8-a085-1ea183cfc1ed service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Refreshing network info cache for port f2e5d5e1-b6be-444f-b8b6-c8f26cef560b {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:08:05 user nova-compute[75745]: DEBUG nova.network.neutron [req-d9be327b-9e3e-4b15-8b72-c27fc6de4004 req-239d64bc-c709-49a8-a085-1ea183cfc1ed service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Updated VIF entry in instance network info cache for port f2e5d5e1-b6be-444f-b8b6-c8f26cef560b. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:08:05 user nova-compute[75745]: DEBUG nova.network.neutron [req-d9be327b-9e3e-4b15-8b72-c27fc6de4004 req-239d64bc-c709-49a8-a085-1ea183cfc1ed service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Updating instance_info_cache with network_info: [{"id": "f2e5d5e1-b6be-444f-b8b6-c8f26cef560b", "address": "fa:16:3e:ff:a2:43", "network": {"id": "32e8e577-9bad-40af-b8e3-cb700c5f2ddf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-262107762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5275e723c904fa183974b49d4530824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e5d5e1-b6", "ovs_interfaceid": "f2e5d5e1-b6be-444f-b8b6-c8f26cef560b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:08:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d9be327b-9e3e-4b15-8b72-c27fc6de4004 req-239d64bc-c709-49a8-a085-1ea183cfc1ed service nova] Releasing lock "refresh_cache-02715ae1-5200-4df5-8430-2f19a610d2bb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:08:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e1b06139-3782-46f6-b9e3-6863e6c8982b tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Acquiring lock "interface-02715ae1-5200-4df5-8430-2f19a610d2bb-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e1b06139-3782-46f6-b9e3-6863e6c8982b tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lock "interface-02715ae1-5200-4df5-8430-2f19a610d2bb-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:06 user nova-compute[75745]: DEBUG nova.objects.instance [None req-e1b06139-3782-46f6-b9e3-6863e6c8982b tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lazy-loading 'flavor' on Instance uuid 02715ae1-5200-4df5-8430-2f19a610d2bb {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:08:06 user nova-compute[75745]: DEBUG nova.objects.instance [None req-e1b06139-3782-46f6-b9e3-6863e6c8982b tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lazy-loading 'pci_requests' on Instance uuid 02715ae1-5200-4df5-8430-2f19a610d2bb {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:08:06 user nova-compute[75745]: DEBUG nova.objects.base [None req-e1b06139-3782-46f6-b9e3-6863e6c8982b tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Object Instance<02715ae1-5200-4df5-8430-2f19a610d2bb> lazy-loaded attributes: flavor,pci_requests {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:08:06 user nova-compute[75745]: DEBUG nova.network.neutron [None req-e1b06139-3782-46f6-b9e3-6863e6c8982b tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:08:06 user nova-compute[75745]: DEBUG nova.policy [None req-e1b06139-3782-46f6-b9e3-6863e6c8982b tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '77cc6ad71fa84904acd8d24eec648c94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5275e723c904fa183974b49d4530824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:08:06 user nova-compute[75745]: DEBUG nova.network.neutron [None req-e1b06139-3782-46f6-b9e3-6863e6c8982b tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Successfully created port: 8b8877f6-9183-46cb-964f-089f6b197d1e {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:08:07 user nova-compute[75745]: DEBUG nova.network.neutron [None req-e1b06139-3782-46f6-b9e3-6863e6c8982b tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Successfully updated port: 8b8877f6-9183-46cb-964f-089f6b197d1e {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:08:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e1b06139-3782-46f6-b9e3-6863e6c8982b tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Acquiring lock "refresh_cache-02715ae1-5200-4df5-8430-2f19a610d2bb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:08:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e1b06139-3782-46f6-b9e3-6863e6c8982b tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Acquired lock "refresh_cache-02715ae1-5200-4df5-8430-2f19a610d2bb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:08:07 user nova-compute[75745]: DEBUG nova.network.neutron [None req-e1b06139-3782-46f6-b9e3-6863e6c8982b tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:08:07 user nova-compute[75745]: DEBUG nova.compute.manager [req-2dd76dfa-9be3-4f1a-b409-98c9b567a5fd req-8ae824d7-437e-4dd5-8764-dec91d8075af service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Received event network-changed-8b8877f6-9183-46cb-964f-089f6b197d1e {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:07 user nova-compute[75745]: DEBUG nova.compute.manager [req-2dd76dfa-9be3-4f1a-b409-98c9b567a5fd req-8ae824d7-437e-4dd5-8764-dec91d8075af service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Refreshing instance network info cache due to event network-changed-8b8877f6-9183-46cb-964f-089f6b197d1e. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:08:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2dd76dfa-9be3-4f1a-b409-98c9b567a5fd req-8ae824d7-437e-4dd5-8764-dec91d8075af service nova] Acquiring lock "refresh_cache-02715ae1-5200-4df5-8430-2f19a610d2bb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG nova.network.neutron [None req-e1b06139-3782-46f6-b9e3-6863e6c8982b tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Updating instance_info_cache with network_info: [{"id": "f2e5d5e1-b6be-444f-b8b6-c8f26cef560b", "address": "fa:16:3e:ff:a2:43", "network": {"id": "32e8e577-9bad-40af-b8e3-cb700c5f2ddf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-262107762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5275e723c904fa183974b49d4530824", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e5d5e1-b6", "ovs_interfaceid": "f2e5d5e1-b6be-444f-b8b6-c8f26cef560b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b8877f6-9183-46cb-964f-089f6b197d1e", "address": "fa:16:3e:d5:67:2f", "network": {"id": "26980f90-5a9d-43ef-b565-452f33c31c2d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2066230581", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d5275e723c904fa183974b49d4530824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8877f6-91", "ovs_interfaceid": "8b8877f6-9183-46cb-964f-089f6b197d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e1b06139-3782-46f6-b9e3-6863e6c8982b tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Releasing lock "refresh_cache-02715ae1-5200-4df5-8430-2f19a610d2bb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2dd76dfa-9be3-4f1a-b409-98c9b567a5fd req-8ae824d7-437e-4dd5-8764-dec91d8075af service nova] Acquired lock "refresh_cache-02715ae1-5200-4df5-8430-2f19a610d2bb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG nova.network.neutron [req-2dd76dfa-9be3-4f1a-b409-98c9b567a5fd req-8ae824d7-437e-4dd5-8764-dec91d8075af service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Refreshing network info cache for port 8b8877f6-9183-46cb-964f-089f6b197d1e {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-e1b06139-3782-46f6-b9e3-6863e6c8982b tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-307822093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-307822093',id=7,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcs8sgcxWpvAhCDukezlQYcNLHeLOr5mWfJj0puItGCkRZJXOGQ6MpM5uepe4ipPhQinPlSmQOH6fLeiZ2h4cJWUaoqQV3toeXUomzqHJu8XbHvxkd2bF7E/efoK+eL7A==',key_name='tempest-keypair-903294596',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:06:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d5275e723c904fa183974b49d4530824',ramdisk_id='',reservation_id='r-1wsmmw87',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-161209440',owner_user_name='tempest-TaggedAttachmentsTest-161209440-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:06:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77cc6ad71fa84904acd8d24eec648c94',uuid=02715ae1-5200-4df5-8430-2f19a610d2bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b8877f6-9183-46cb-964f-089f6b197d1e", "address": "fa:16:3e:d5:67:2f", "network": {"id": "26980f90-5a9d-43ef-b565-452f33c31c2d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2066230581", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d5275e723c904fa183974b49d4530824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8877f6-91", "ovs_interfaceid": "8b8877f6-9183-46cb-964f-089f6b197d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-e1b06139-3782-46f6-b9e3-6863e6c8982b tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Converting VIF {"id": "8b8877f6-9183-46cb-964f-089f6b197d1e", "address": "fa:16:3e:d5:67:2f", "network": {"id": "26980f90-5a9d-43ef-b565-452f33c31c2d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2066230581", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d5275e723c904fa183974b49d4530824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8877f6-91", "ovs_interfaceid": "8b8877f6-9183-46cb-964f-089f6b197d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-e1b06139-3782-46f6-b9e3-6863e6c8982b tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:67:2f,bridge_name='br-int',has_traffic_filtering=True,id=8b8877f6-9183-46cb-964f-089f6b197d1e,network=Network(26980f90-5a9d-43ef-b565-452f33c31c2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8877f6-91') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG os_vif [None req-e1b06139-3782-46f6-b9e3-6863e6c8982b tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:67:2f,bridge_name='br-int',has_traffic_filtering=True,id=8b8877f6-9183-46cb-964f-089f6b197d1e,network=Network(26980f90-5a9d-43ef-b565-452f33c31c2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8877f6-91') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0c910920-95ba-5a6b-ac7a-70498af3b3fe', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b8877f6-91, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b8877f6-91, col_values=(('qos', UUID('5e68270a-df6d-4e6b-8af9-37d1a76c7f99')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b8877f6-91, col_values=(('external_ids', {'iface-id': '8b8877f6-9183-46cb-964f-089f6b197d1e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:67:2f', 'vm-uuid': '02715ae1-5200-4df5-8430-2f19a610d2bb'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:08 user nova-compute[75745]: INFO os_vif [None req-e1b06139-3782-46f6-b9e3-6863e6c8982b tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:67:2f,bridge_name='br-int',has_traffic_filtering=True,id=8b8877f6-9183-46cb-964f-089f6b197d1e,network=Network(26980f90-5a9d-43ef-b565-452f33c31c2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8877f6-91')
Dec 01 17:08:08 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-e1b06139-3782-46f6-b9e3-6863e6c8982b tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-307822093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-307822093',id=7,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcs8sgcxWpvAhCDukezlQYcNLHeLOr5mWfJj0puItGCkRZJXOGQ6MpM5uepe4ipPhQinPlSmQOH6fLeiZ2h4cJWUaoqQV3toeXUomzqHJu8XbHvxkd2bF7E/efoK+eL7A==',key_name='tempest-keypair-903294596',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:06:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d5275e723c904fa183974b49d4530824',ramdisk_id='',reservation_id='r-1wsmmw87',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-161209440',owner_user_name='tempest-TaggedAttachmentsTest-161209440-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:06:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77cc6ad71fa84904acd8d24eec648c94',uuid=02715ae1-5200-4df5-8430-2f19a610d2bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b8877f6-9183-46cb-964f-089f6b197d1e", "address": "fa:16:3e:d5:67:2f", "network": {"id": "26980f90-5a9d-43ef-b565-452f33c31c2d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2066230581", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d5275e723c904fa183974b49d4530824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8877f6-91", "ovs_interfaceid": "8b8877f6-9183-46cb-964f-089f6b197d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-e1b06139-3782-46f6-b9e3-6863e6c8982b tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Converting VIF {"id": "8b8877f6-9183-46cb-964f-089f6b197d1e", "address": "fa:16:3e:d5:67:2f", "network": {"id": "26980f90-5a9d-43ef-b565-452f33c31c2d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2066230581", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d5275e723c904fa183974b49d4530824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8877f6-91", "ovs_interfaceid": "8b8877f6-9183-46cb-964f-089f6b197d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-e1b06139-3782-46f6-b9e3-6863e6c8982b tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:67:2f,bridge_name='br-int',has_traffic_filtering=True,id=8b8877f6-9183-46cb-964f-089f6b197d1e,network=Network(26980f90-5a9d-43ef-b565-452f33c31c2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8877f6-91') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-e1b06139-3782-46f6-b9e3-6863e6c8982b tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] attach device xml: <interface type="ethernet">
Dec 01 17:08:08 user nova-compute[75745]:   <mac address="fa:16:3e:d5:67:2f"/>
Dec 01 17:08:08 user nova-compute[75745]:   <model type="virtio"/>
Dec 01 17:08:08 user nova-compute[75745]:   <mtu size="1442"/>
Dec 01 17:08:08 user nova-compute[75745]:   <target dev="tap8b8877f6-91"/>
Dec 01 17:08:08 user nova-compute[75745]: </interface>
Dec 01 17:08:08 user nova-compute[75745]:  {{(pid=75745) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG nova.compute.manager [req-346e2f79-3f9a-4e67-8d00-121eca95c8a0 req-2fbb570a-65d3-4409-bd51-6d71274f4e6a service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Received event network-vif-plugged-8b8877f6-9183-46cb-964f-089f6b197d1e {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-346e2f79-3f9a-4e67-8d00-121eca95c8a0 req-2fbb570a-65d3-4409-bd51-6d71274f4e6a service nova] Acquiring lock "02715ae1-5200-4df5-8430-2f19a610d2bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-346e2f79-3f9a-4e67-8d00-121eca95c8a0 req-2fbb570a-65d3-4409-bd51-6d71274f4e6a service nova] Lock "02715ae1-5200-4df5-8430-2f19a610d2bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-346e2f79-3f9a-4e67-8d00-121eca95c8a0 req-2fbb570a-65d3-4409-bd51-6d71274f4e6a service nova] Lock "02715ae1-5200-4df5-8430-2f19a610d2bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG nova.compute.manager [req-346e2f79-3f9a-4e67-8d00-121eca95c8a0 req-2fbb570a-65d3-4409-bd51-6d71274f4e6a service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] No waiting events found dispatching network-vif-plugged-8b8877f6-9183-46cb-964f-089f6b197d1e {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:08 user nova-compute[75745]: WARNING nova.compute.manager [req-346e2f79-3f9a-4e67-8d00-121eca95c8a0 req-2fbb570a-65d3-4409-bd51-6d71274f4e6a service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Received unexpected event network-vif-plugged-8b8877f6-9183-46cb-964f-089f6b197d1e for instance with vm_state active and task_state None.
Dec 01 17:08:08 user nova-compute[75745]: DEBUG nova.network.neutron [req-2dd76dfa-9be3-4f1a-b409-98c9b567a5fd req-8ae824d7-437e-4dd5-8764-dec91d8075af service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Updated VIF entry in instance network info cache for port 8b8877f6-9183-46cb-964f-089f6b197d1e. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG nova.network.neutron [req-2dd76dfa-9be3-4f1a-b409-98c9b567a5fd req-8ae824d7-437e-4dd5-8764-dec91d8075af service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Updating instance_info_cache with network_info: [{"id": "f2e5d5e1-b6be-444f-b8b6-c8f26cef560b", "address": "fa:16:3e:ff:a2:43", "network": {"id": "32e8e577-9bad-40af-b8e3-cb700c5f2ddf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-262107762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5275e723c904fa183974b49d4530824", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e5d5e1-b6", "ovs_interfaceid": "f2e5d5e1-b6be-444f-b8b6-c8f26cef560b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b8877f6-9183-46cb-964f-089f6b197d1e", "address": "fa:16:3e:d5:67:2f", "network": {"id": "26980f90-5a9d-43ef-b565-452f33c31c2d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2066230581", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d5275e723c904fa183974b49d4530824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8877f6-91", "ovs_interfaceid": "8b8877f6-9183-46cb-964f-089f6b197d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2dd76dfa-9be3-4f1a-b409-98c9b567a5fd req-8ae824d7-437e-4dd5-8764-dec91d8075af service nova] Releasing lock "refresh_cache-02715ae1-5200-4df5-8430-2f19a610d2bb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-e1b06139-3782-46f6-b9e3-6863e6c8982b tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-e1b06139-3782-46f6-b9e3-6863e6c8982b tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] No BDM found with device name hda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-e1b06139-3782-46f6-b9e3-6863e6c8982b tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] No VIF found with MAC fa:16:3e:ff:a2:43, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-e1b06139-3782-46f6-b9e3-6863e6c8982b tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:08:08 user nova-compute[75745]:   <nova:package version="0.0.0"/>
Dec 01 17:08:08 user nova-compute[75745]:   <nova:name>tempest-device-tagging-server-307822093</nova:name>
Dec 01 17:08:08 user nova-compute[75745]:   <nova:creationTime>2023-12-01 17:08:08</nova:creationTime>
Dec 01 17:08:08 user nova-compute[75745]:   <nova:flavor name="m1.tiny">
Dec 01 17:08:08 user nova-compute[75745]:     <nova:memory>512</nova:memory>
Dec 01 17:08:08 user nova-compute[75745]:     <nova:disk>1</nova:disk>
Dec 01 17:08:08 user nova-compute[75745]:     <nova:swap>0</nova:swap>
Dec 01 17:08:08 user nova-compute[75745]:     <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:08:08 user nova-compute[75745]:     <nova:vcpus>1</nova:vcpus>
Dec 01 17:08:08 user nova-compute[75745]:   </nova:flavor>
Dec 01 17:08:08 user nova-compute[75745]:   <nova:owner>
Dec 01 17:08:08 user nova-compute[75745]:     <nova:user uuid="77cc6ad71fa84904acd8d24eec648c94">tempest-TaggedAttachmentsTest-161209440-project-member</nova:user>
Dec 01 17:08:08 user nova-compute[75745]:     <nova:project uuid="d5275e723c904fa183974b49d4530824">tempest-TaggedAttachmentsTest-161209440</nova:project>
Dec 01 17:08:08 user nova-compute[75745]:   </nova:owner>
Dec 01 17:08:08 user nova-compute[75745]:   <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:08:08 user nova-compute[75745]:   <nova:ports>
Dec 01 17:08:08 user nova-compute[75745]:     <nova:port uuid="f2e5d5e1-b6be-444f-b8b6-c8f26cef560b">
Dec 01 17:08:08 user nova-compute[75745]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 01 17:08:08 user nova-compute[75745]:     </nova:port>
Dec 01 17:08:08 user nova-compute[75745]:     <nova:port uuid="8b8877f6-9183-46cb-964f-089f6b197d1e">
Dec 01 17:08:08 user nova-compute[75745]:       <nova:ip type="fixed" address="10.10.10.23" ipVersion="4"/>
Dec 01 17:08:08 user nova-compute[75745]:     </nova:port>
Dec 01 17:08:08 user nova-compute[75745]:   </nova:ports>
Dec 01 17:08:08 user nova-compute[75745]: </nova:instance>
Dec 01 17:08:08 user nova-compute[75745]:  {{(pid=75745) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e1b06139-3782-46f6-b9e3-6863e6c8982b tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lock "interface-02715ae1-5200-4df5-8430-2f19a610d2bb-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.829s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Acquiring lock "02715ae1-5200-4df5-8430-2f19a610d2bb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lock "02715ae1-5200-4df5-8430-2f19a610d2bb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:09 user nova-compute[75745]: DEBUG nova.objects.instance [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lazy-loading 'flavor' on Instance uuid 02715ae1-5200-4df5-8430-2f19a610d2bb {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:08:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lock "02715ae1-5200-4df5-8430-2f19a610d2bb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Acquiring lock "02715ae1-5200-4df5-8430-2f19a610d2bb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lock "02715ae1-5200-4df5-8430-2f19a610d2bb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:09 user nova-compute[75745]: INFO nova.compute.manager [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Attaching volume b29cb5db-9033-42b2-97ee-ccd5651fbb16 to /dev/vdb
Dec 01 17:08:09 user nova-compute[75745]: DEBUG os_brick.utils [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:08:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:09 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa02790-17a5-4d9e-bd2e-90388bd89746]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:09 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5459cc9e-e39a-4fd8-95ab-f25eed7ba53a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:09 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f69634d-d687-4c46-922c-e82bdf0555f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:09 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0162f946-8b27-4ca1-8827-856997c9fbdb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:08:09 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:08:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:08:09 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:08:09 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8efcaf-9e50-484c-a263-8b0b6083eab8]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:09 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:08:09 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:08:09 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:08:09 user nova-compute[75745]: DEBUG os_brick.utils [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:08:09 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Updating existing volume attachment record: 64490ccf-aeb2-4b74-bc4b-78708c88f0f3 {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:08:10 user nova-compute[75745]: DEBUG nova.compute.manager [req-c6782fb6-87ce-45fd-b147-fdb35b397750 req-937d9398-5838-4495-8ee0-f7c962648041 service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Received event network-vif-plugged-8b8877f6-9183-46cb-964f-089f6b197d1e {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c6782fb6-87ce-45fd-b147-fdb35b397750 req-937d9398-5838-4495-8ee0-f7c962648041 service nova] Acquiring lock "02715ae1-5200-4df5-8430-2f19a610d2bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c6782fb6-87ce-45fd-b147-fdb35b397750 req-937d9398-5838-4495-8ee0-f7c962648041 service nova] Lock "02715ae1-5200-4df5-8430-2f19a610d2bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c6782fb6-87ce-45fd-b147-fdb35b397750 req-937d9398-5838-4495-8ee0-f7c962648041 service nova] Lock "02715ae1-5200-4df5-8430-2f19a610d2bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:10 user nova-compute[75745]: DEBUG nova.compute.manager [req-c6782fb6-87ce-45fd-b147-fdb35b397750 req-937d9398-5838-4495-8ee0-f7c962648041 service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] No waiting events found dispatching network-vif-plugged-8b8877f6-9183-46cb-964f-089f6b197d1e {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:10 user nova-compute[75745]: WARNING nova.compute.manager [req-c6782fb6-87ce-45fd-b147-fdb35b397750 req-937d9398-5838-4495-8ee0-f7c962648041 service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Received unexpected event network-vif-plugged-8b8877f6-9183-46cb-964f-089f6b197d1e for instance with vm_state active and task_state None.
Dec 01 17:08:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:13 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:08:13 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XgKELjUI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:08:13 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:08:13 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:08:13 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:08:13 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:08:13 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:08:13 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:08:13 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:08:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:13 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e968f041-aa55-47b3-8f95-8504c525a0a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:13 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:08:13 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:13 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5fa06b-e5f8-4c26-a90e-afbe5e0911e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:13 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e] added
Dec 01 17:08:13 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:13 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[87be5349-0613-4535-8240-bc8941baa097]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:13 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:13 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b963118-34e4-4cb1-b3e9-f4b73c581451]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:13 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XgKELjUI {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XgKELjUI" returned: 0 in 0.026s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:13 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54eeb9d-9589-4d48-86ef-cf15356240d9]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:13 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XgKELjUI'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:13 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b445d3da-01b3-4852-a3ca-e5a9e56b63a9]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:13 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:13 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[723fbf3d-6243-4100-815c-96a1b1347bb2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:13 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:13 user nova-compute[75745]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:08:13 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:13 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:08:13 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:13 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:08:13 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:13 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:13 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:08:13 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:13 user nova-compute[75745]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:08:13 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:13 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:08:13 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:13 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:08:13 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:13 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:13 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:08:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24df54a-8d88-4cb7-8364-e203aaea82d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e, portal: 172.16.0.220,3260]
Dec 01 17:08:14 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e, portal: 172.16.0.220,3260] successful.
Dec 01 17:08:14 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c6de71-da09-4632-ba3b-09bc8da40c2a]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfff01ab-20dc-47c9-b179-9f945aa7a0b2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:14 user nova-compute[75745]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)
Dec 01 17:08:14 user nova-compute[75745]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:08:14 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:14 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:08:14 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:14 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:08:14 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:14 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:14 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:08:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:14 user nova-compute[75745]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)
Dec 01 17:08:14 user nova-compute[75745]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:08:14 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:14 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:08:14 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:14 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:08:14 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:14 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:14 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:08:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:08:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:08:14 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:08:14 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:08:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3773ac-c4bd-4702-a243-46c085579467]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:14 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:08:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XgKELjUI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:08:15 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:08:15 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23966393238363761', 'path': '/dev/sdj'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:08:15 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966393238363761', 'path': '/dev/sdj'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:08:15 user nova-compute[75745]: DEBUG nova.objects.instance [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Lazy-loading 'flavor' on Instance uuid d9bfb9f9-95a4-49f5-b781-5e78c83c54d1 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:08:15 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 17:08:15 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:08:15 user nova-compute[75745]:   <source dev="/dev/sdj"/>
Dec 01 17:08:15 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:08:15 user nova-compute[75745]:   <serial>b000c1c2-a9f3-4629-b034-ef182141787e</serial>
Dec 01 17:08:15 user nova-compute[75745]: </disk>
Dec 01 17:08:15 user nova-compute[75745]:  {{(pid=75745) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 17:08:15 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:08:15 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:08:15 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] No VIF found with MAC fa:16:3e:d0:61:8e, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:08:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f94c0944-fd56-4973-ae1b-523d1ee06060 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Lock "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.821s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Acquiring lock "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Lock "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:16 user nova-compute[75745]: DEBUG os_brick.utils [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:08:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:16 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03ae34a-83a4-4ed1-bd45-6b098330681e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:16 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84579ff-3f7d-434f-81ed-798017409254]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:16 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[09833d9b-f1ac-47ac-a7f9-f569841ad61c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:16 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d524e33e-947a-4188-9070-aa9c3a79bcdc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:08:16 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:08:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:08:16 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:08:16 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6488a3-ed9b-4f18-be6c-36cbf2a1f4ce]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:16 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:08:16 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:08:16 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:08:16 user nova-compute[75745]: DEBUG os_brick.utils [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:08:16 user nova-compute[75745]: INFO nova.compute.manager [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Swapping volume b000c1c2-a9f3-4629-b034-ef182141787e for 67e7fd43-4d07-4a4c-8027-2861e79e6e04
Dec 01 17:08:17 user nova-compute[75745]: DEBUG nova.compute.manager [req-6c0dde93-f465-4006-b271-e316145f5c83 req-c983bef5-f331-4672-a001-10c76f560594 service nova] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Received event network-changed-2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:17 user nova-compute[75745]: DEBUG nova.compute.manager [req-6c0dde93-f465-4006-b271-e316145f5c83 req-c983bef5-f331-4672-a001-10c76f560594 service nova] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Refreshing instance network info cache due to event network-changed-2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:08:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6c0dde93-f465-4006-b271-e316145f5c83 req-c983bef5-f331-4672-a001-10c76f560594 service nova] Acquiring lock "refresh_cache-0e256c89-0301-431a-ae27-dfd7c2af19f2" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:08:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6c0dde93-f465-4006-b271-e316145f5c83 req-c983bef5-f331-4672-a001-10c76f560594 service nova] Acquired lock "refresh_cache-0e256c89-0301-431a-ae27-dfd7c2af19f2" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:08:17 user nova-compute[75745]: DEBUG nova.network.neutron [req-6c0dde93-f465-4006-b271-e316145f5c83 req-c983bef5-f331-4672-a001-10c76f560594 service nova] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Refreshing network info cache for port 2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:08:17 user nova-compute[75745]: DEBUG nova.network.neutron [req-6c0dde93-f465-4006-b271-e316145f5c83 req-c983bef5-f331-4672-a001-10c76f560594 service nova] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Updated VIF entry in instance network info cache for port 2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:08:17 user nova-compute[75745]: DEBUG nova.network.neutron [req-6c0dde93-f465-4006-b271-e316145f5c83 req-c983bef5-f331-4672-a001-10c76f560594 service nova] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Updating instance_info_cache with network_info: [{"id": "2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1", "address": "fa:16:3e:66:77:e0", "network": {"id": "c0dde7ef-077a-49d3-996e-9cd7f48984ce", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-105760332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c36b3e1f1ae4122abfac021cefc809a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bbb1dd6-ad", "ovs_interfaceid": "2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:08:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6c0dde93-f465-4006-b271-e316145f5c83 req-c983bef5-f331-4672-a001-10c76f560594 service nova] Releasing lock "refresh_cache-0e256c89-0301-431a-ae27-dfd7c2af19f2" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:08:18 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:18 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CTDvIONZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:08:24 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:08:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:08:24 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:08:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:08:24 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98b5046-854e-4ee7-a362-cfb0a1f329ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:08:24 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[284fd46a-deb4-477d-b98e-6c51ec8831f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0] added
Dec 01 17:08:24 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7aec193-328a-4609-8f70-f72acb034870]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DmiXsNCw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:08:24 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:08:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4894595a-2f7e-4af0-b350-6adfb3f0bb81]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CTDvIONZ {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CTDvIONZ" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b790f4ab-4f99-44d9-99b4-d74e72971b47]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CTDvIONZ'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f548cb3d-39f5-4d1e-9c99-78b04d8a569b]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Acquiring lock "0e256c89-0301-431a-ae27-dfd7c2af19f2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Lock "0e256c89-0301-431a-ae27-dfd7c2af19f2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG nova.objects.instance [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Lazy-loading 'flavor' on Instance uuid 0e256c89-0301-431a-ae27-dfd7c2af19f2 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1144db11-1b79-43c3-82a7-305d8da205dd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:24 user nova-compute[75745]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)
Dec 01 17:08:24 user nova-compute[75745]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:08:24 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:24 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:08:24 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:24 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:08:24 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:24 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:24 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:24 user nova-compute[75745]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)
Dec 01 17:08:24 user nova-compute[75745]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:08:24 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:24 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:08:24 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:24 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:08:24 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:24 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:24 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Lock "0e256c89-0301-431a-ae27-dfd7c2af19f2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[434ea593-9bc8-4c4e-8e4f-47d854ef9242]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0, portal: 172.16.0.220,3260]
Dec 01 17:08:24 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0, portal: 172.16.0.220,3260] successful.
Dec 01 17:08:24 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a85dbd-88b2-4263-b2dd-a1dbe3121380]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[98448e77-92bf-45f1-9637-c011139ff613]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:24 user nova-compute[75745]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)
Dec 01 17:08:24 user nova-compute[75745]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)
Dec 01 17:08:24 user nova-compute[75745]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:08:24 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:24 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:08:24 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:24 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:08:24 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:24 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:24 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:24 user nova-compute[75745]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)
Dec 01 17:08:24 user nova-compute[75745]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)
Dec 01 17:08:24 user nova-compute[75745]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:08:24 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:24 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:08:24 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:24 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:08:24 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:24 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:24 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d7fe5e-472e-485b-a6d9-5bcdc566652f]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CTDvIONZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Acquiring lock "0e256c89-0301-431a-ae27-dfd7c2af19f2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Lock "0e256c89-0301-431a-ae27-dfd7c2af19f2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:24 user nova-compute[75745]: INFO nova.compute.manager [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Attaching volume f45ea748-d36e-4f48-9af3-8d022a56290c to /dev/vdb
Dec 01 17:08:24 user nova-compute[75745]: DEBUG os_brick.utils [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[246579ee-8864-4d7f-b594-63eba937c149]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f452fe4-4d01-49ef-8c88-9da1d5ca1318]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31219f6-a574-49fe-b5cd-88fdf5aafae4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6654387c-74cf-43c0-8186-257fb194605b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:08:24 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:08:24 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b0abba-f75d-4e4d-a9c1-e7a0932f647a]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG os_brick.utils [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:08:24 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Updating existing volume attachment record: edcf56ab-4c93-44a5-ad2f-17e51fb2ce3a {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:08:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:08:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] <== connect_volume: return (1423ms) {'type': 'block', 'scsi_wwn': '23162633461336136', 'path': '/dev/sdk'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:08:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162633461336136', 'path': '/dev/sdk'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:08:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.330s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:08:25 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:08:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:08:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:08:25 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:08:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:25 user nova-compute[75745]: DEBUG nova.objects.instance [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Lazy-loading 'flavor' on Instance uuid c7fb74ee-dfa0-40e1-8773-99bd4a0402d5 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:08:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8b53d3-ccb6-45a3-b196-44c932d8c955]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:08:25 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7897a68-9222-448e-b21f-42709f0c09b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16] added
Dec 01 17:08:25 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 17:08:25 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:08:25 user nova-compute[75745]:   <source dev="/dev/sdk"/>
Dec 01 17:08:25 user nova-compute[75745]:   <target dev="sdc" bus="scsi"/>
Dec 01 17:08:25 user nova-compute[75745]:   <serial>549f164a-dddc-479f-8178-e3db004fe8b0</serial>
Dec 01 17:08:25 user nova-compute[75745]:   <address type="drive" controller="0" unit="2"/>
Dec 01 17:08:25 user nova-compute[75745]: </disk>
Dec 01 17:08:25 user nova-compute[75745]:  {{(pid=75745) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 17:08:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1d3be1-99d0-4957-8231-77d1b7077586]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dcdc1d-cd40-4d3f-9814-03cf4bd27e0b]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DmiXsNCw {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DmiXsNCw" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ef63ac-8a29-477a-861c-b47461551f70]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DmiXsNCw'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f2b59c-1363-427d-8efe-aa2846b73d88]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6783b6c3-0372-4e44-ad57-1dd2c2509eb4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:25 user nova-compute[75745]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)
Dec 01 17:08:25 user nova-compute[75745]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)
Dec 01 17:08:25 user nova-compute[75745]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:08:25 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:25 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:08:25 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:25 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:08:25 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:25 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:25 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:08:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:25 user nova-compute[75745]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)
Dec 01 17:08:25 user nova-compute[75745]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)
Dec 01 17:08:25 user nova-compute[75745]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:08:25 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:25 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:08:25 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:25 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:08:25 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:25 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:25 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:08:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:26 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1210a8-3fc2-4677-8f65-6b6b75256140]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16, portal: 172.16.0.220,3260]
Dec 01 17:08:26 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16, portal: 172.16.0.220,3260] successful.
Dec 01 17:08:26 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:26 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[17dfae29-c88f-47b7-a032-17c37359b92c]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:26 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[354be23f-147a-4101-bbc1-e74263ce3429]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:26 user nova-compute[75745]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)
Dec 01 17:08:26 user nova-compute[75745]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)
Dec 01 17:08:26 user nova-compute[75745]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)
Dec 01 17:08:26 user nova-compute[75745]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:08:26 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:26 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:08:26 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:26 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:08:26 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:26 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:26 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:08:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:26 user nova-compute[75745]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)
Dec 01 17:08:26 user nova-compute[75745]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)
Dec 01 17:08:26 user nova-compute[75745]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)
Dec 01 17:08:26 user nova-compute[75745]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:08:26 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:26 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:08:26 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:26 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:08:26 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:26 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:26 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:08:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:08:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:08:26 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] HCTL ('43', '-', '-', 0) found on session 13 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:08:26 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Scanning host 43 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:08:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:26 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b418acb-5090-443b-bab8-744fccfad1d2]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:26 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Searching for a device in session 13 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:08:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DmiXsNCw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:08:26 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] No BDM found with device name sda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:08:26 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:08:26 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:08:26 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] No VIF found with MAC fa:16:3e:1d:54:77, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:08:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-776e3fd0-3488-4a7d-a865-59d13869e88d tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Lock "c7fb74ee-dfa0-40e1-8773-99bd4a0402d5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.806s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Acquiring lock "c7fb74ee-dfa0-40e1-8773-99bd4a0402d5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Lock "c7fb74ee-dfa0-40e1-8773-99bd4a0402d5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:27 user nova-compute[75745]: INFO nova.compute.manager [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Detaching volume 549f164a-dddc-479f-8178-e3db004fe8b0
Dec 01 17:08:27 user nova-compute[75745]: INFO nova.virt.block_device [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Attempting to driver detach volume 549f164a-dddc-479f-8178-e3db004fe8b0 from mountpoint /dev/sdc
Dec 01 17:08:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] <== connect_volume: return (2717ms) {'type': 'block', 'scsi_wwn': '23939646238626534', 'path': '/dev/sdl'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939646238626534', 'path': '/dev/sdl'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG nova.objects.instance [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lazy-loading 'flavor' on Instance uuid 02715ae1-5200-4df5-8430-2f19a610d2bb {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Attempting to detach device sdc from instance c7fb74ee-dfa0-40e1-8773-99bd4a0402d5 from the persistent domain config. {{(pid=75745) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:08:27 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:08:27 user nova-compute[75745]:   <source dev="/dev/sdk"/>
Dec 01 17:08:27 user nova-compute[75745]:   <target dev="sdc" bus="scsi"/>
Dec 01 17:08:27 user nova-compute[75745]:   <serial>549f164a-dddc-479f-8178-e3db004fe8b0</serial>
Dec 01 17:08:27 user nova-compute[75745]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Dec 01 17:08:27 user nova-compute[75745]: </disk>
Dec 01 17:08:27 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG nova.compute.manager [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SWPtsvUY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd9bfb9f9-95a4-49f5-b781-5e78c83c54d1', 'attached_at': '', 'detached_at': '', 'volume_id': '67e7fd43-4d07-4a4c-8027-2861e79e6e04', 'serial': '67e7fd43-4d07-4a4c-8027-2861e79e6e04'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XgKELjUI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': 'd9bfb9f9-95a4-49f5-b781-5e78c83c54d1', 'attached_at': '', 'detached_at': '', 'volume_id': 'b000c1c2-a9f3-4629-b034-ef182141787e', 'serial'} {{(pid=75745) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Dec 01 17:08:27 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Successfully detached device sdc from instance c7fb74ee-dfa0-40e1-8773-99bd4a0402d5 from the persistent domain config.
Dec 01 17:08:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance c7fb74ee-dfa0-40e1-8773-99bd4a0402d5 from the live domain config. {{(pid=75745) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:08:27 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:08:27 user nova-compute[75745]:   <source dev="/dev/sdk"/>
Dec 01 17:08:27 user nova-compute[75745]:   <target dev="sdc" bus="scsi"/>
Dec 01 17:08:27 user nova-compute[75745]:   <serial>549f164a-dddc-479f-8178-e3db004fe8b0</serial>
Dec 01 17:08:27 user nova-compute[75745]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Dec 01 17:08:27 user nova-compute[75745]: </disk>
Dec 01 17:08:27 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SWPtsvUY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:08:27 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:08:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:08:27 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:08:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:08:27 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:08:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 17:08:27 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:08:27 user nova-compute[75745]:   <source dev="/dev/sdl"/>
Dec 01 17:08:27 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:08:27 user nova-compute[75745]:   <serial>b29cb5db-9033-42b2-97ee-ccd5651fbb16</serial>
Dec 01 17:08:27 user nova-compute[75745]: </disk>
Dec 01 17:08:27 user nova-compute[75745]:  {{(pid=75745) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3b08d9-46cb-4ee5-94a9-aab29457c124]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:08:27 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4472d54f-0490-4bbf-98fe-772b54a4a0f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04] added
Dec 01 17:08:27 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a0f92f-0c52-4303-88d7-37e971062d7b]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b41b73-9c14-4de0-9397-7d0a0672d5e4]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SWPtsvUY {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SWPtsvUY" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b010599d-ada5-4716-a35b-c522ebd21ffa]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SWPtsvUY'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[624bbedb-0195-4508-994b-bef99fce8573]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1726420d-fd62-4e73-9cc7-65d74402532a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:27 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:27 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7c1d37-c208-4f55-a30c-2bb2a47dd53d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04, portal: 172.16.0.220,3260]
Dec 01 17:08:27 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04, portal: 172.16.0.220,3260] successful.
Dec 01 17:08:27 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[370b6da3-9ce6-457a-a73a-ff0f242b3ed0]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea06636-66c7-49e9-8a37-d979ed8fa93b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:27 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:27 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:27 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] HCTL ('44', '-', '-', 0) found on session 14 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Scanning host 44 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host44/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host44/scan" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55017d0-ba3a-4909-87af-93d9811536f8]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Searching for a device in session 14 and hctl ['44', '*', '*', 0] yield: None {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] No BDM found with device name hda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] No VIF found with MAC fa:16:3e:ff:a2:43, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9ab3feed-afc4-4663-b7ec-836d99cc0454 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lock "02715ae1-5200-4df5-8430-2f19a610d2bb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.350s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance c7fb74ee-dfa0-40e1-8773-99bd4a0402d5 {{(pid=75745) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 17:08:28 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:28 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Searching for a device in session 14 and hctl ['44', '*', '*', 0] yield: sdm {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:08:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Connected to sdm using {'target_iqn': 'iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SWPtsvUY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:08:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:08:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '23231373764643663', 'path': '/dev/sdm'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:08:28 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231373764643663', 'path': '/dev/sdm'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:08:28 user nova-compute[75745]: DEBUG nova.objects.instance [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Lazy-loading 'flavor' on Instance uuid d9bfb9f9-95a4-49f5-b781-5e78c83c54d1 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:08:28 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75745) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 17:08:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] COPY block job progress, current cursor: 126877696 final cursor: 1073741824 {{(pid=75745) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 17:08:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Acquiring lock "02715ae1-5200-4df5-8430-2f19a610d2bb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lock "02715ae1-5200-4df5-8430-2f19a610d2bb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:29 user nova-compute[75745]: INFO nova.compute.manager [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Detaching volume b29cb5db-9033-42b2-97ee-ccd5651fbb16
Dec 01 17:08:29 user nova-compute[75745]: INFO nova.virt.block_device [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Attempting to driver detach volume b29cb5db-9033-42b2-97ee-ccd5651fbb16 from mountpoint /dev/vdb
Dec 01 17:08:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Attempting to detach device vdb from instance 02715ae1-5200-4df5-8430-2f19a610d2bb from the persistent domain config. {{(pid=75745) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 17:08:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:08:29 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:08:29 user nova-compute[75745]:   <source dev="/dev/sdl"/>
Dec 01 17:08:29 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:08:29 user nova-compute[75745]:   <serial>b29cb5db-9033-42b2-97ee-ccd5651fbb16</serial>
Dec 01 17:08:29 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 01 17:08:29 user nova-compute[75745]: </disk>
Dec 01 17:08:29 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:08:29 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Successfully detached device vdb from instance 02715ae1-5200-4df5-8430-2f19a610d2bb from the persistent domain config.
Dec 01 17:08:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 02715ae1-5200-4df5-8430-2f19a610d2bb from the live domain config. {{(pid=75745) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 17:08:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:08:29 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:08:29 user nova-compute[75745]:   <source dev="/dev/sdl"/>
Dec 01 17:08:29 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:08:29 user nova-compute[75745]:   <serial>b29cb5db-9033-42b2-97ee-ccd5651fbb16</serial>
Dec 01 17:08:29 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 01 17:08:29 user nova-compute[75745]: </disk>
Dec 01 17:08:29 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:08:30 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] COPY block job progress, current cursor: 253755392 final cursor: 1073741824 {{(pid=75745) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 17:08:30 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 02715ae1-5200-4df5-8430-2f19a610d2bb {{(pid=75745) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 17:08:30 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] COPY block job progress, current cursor: 422576128 final cursor: 1073741824 {{(pid=75745) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 17:08:31 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] COPY block job progress, current cursor: 587202560 final cursor: 1073741824 {{(pid=75745) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 17:08:31 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] COPY block job progress, current cursor: 721420288 final cursor: 1073741824 {{(pid=75745) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 17:08:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] COPY block job progress, current cursor: 853540864 final cursor: 1073741824 {{(pid=75745) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 17:08:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] COPY block job progress, current cursor: 1042284544 final cursor: 1073741824 {{(pid=75745) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75745) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XgKELjUI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:08:33 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:08:33 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca80467b-bcc1-4f45-bf09-e32fe3a89d1c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:08:33 user nova-compute[75745]: No targets found.
Dec 01 17:08:33 user nova-compute[75745]: iSNS:
Dec 01 17:08:33 user nova-compute[75745]: No targets found.
Dec 01 17:08:33 user nova-compute[75745]: STATIC:
Dec 01 17:08:33 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c
Dec 01 17:08:33 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:33 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:33 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749
Dec 01 17:08:33 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:33 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:33 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111
Dec 01 17:08:33 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:33 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:33 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de
Dec 01 17:08:33 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:33 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:33 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e
Dec 01 17:08:33 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:33 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:33 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121
Dec 01 17:08:33 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:33 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:33 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762
Dec 01 17:08:33 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:33 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:33 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04
Dec 01 17:08:33 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:33 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:33 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0
Dec 01 17:08:33 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:33 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:33 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e
Dec 01 17:08:33 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:33 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:33 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9
Dec 01 17:08:33 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:33 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:33 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16
Dec 01 17:08:33 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:33 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:33 user nova-compute[75745]: FIRMWARE:
Dec 01 17:08:33 user nova-compute[75745]: No targets found.
Dec 01 17:08:33 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:08:33 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:08:33 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6480d7-288f-4bc5-907d-e0020bb1d5d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[294ff9ab-dbb3-4dac-9281-8e0a352fe362]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:33 user nova-compute[75745]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)
Dec 01 17:08:33 user nova-compute[75745]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)
Dec 01 17:08:33 user nova-compute[75745]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)
Dec 01 17:08:33 user nova-compute[75745]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)
Dec 01 17:08:33 user nova-compute[75745]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:08:33 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:33 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:08:33 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:33 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:08:33 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:33 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:33 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:33 user nova-compute[75745]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)
Dec 01 17:08:33 user nova-compute[75745]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)
Dec 01 17:08:33 user nova-compute[75745]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)
Dec 01 17:08:33 user nova-compute[75745]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)
Dec 01 17:08:33 user nova-compute[75745]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:08:33 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:33 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:08:33 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:33 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:08:33 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:33 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:33 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24d824fa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e'): ({'sdj'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Removing single pathed devices sdj {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb31a7d-4669-4714-9960-4c53d3dacbbc]: (4, ('path checker states:\nup                  11\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f17776-4b1d-4086-be4b-dd79ebdaaa60]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Flushing IO for device /dev/sdj {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.012s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[28eed337-3bbd-4f2f-8b1e-35e452f303eb]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.036s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a758ea-0780-470c-bc28-079c13ee9004]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] SCSI volumes sdj have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d5e8b4-43d5-41b3-a98f-57ba97570a71]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --logout" returned: 0 in 0.098s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4477f0-0442-4f82-8a9d-539388c2d3a8]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e, portal: 172.16.0.220,3260]
Dec 01 17:08:33 user nova-compute[75745]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e, portal: 172.16.0.220,3260] successful.
Dec 01 17:08:33 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7756d2-9d86-4a8a-bbc8-58feb510b40c]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] <== disconnect_volume: return (368ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG nova.compute.manager [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SWPtsvUY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdm'}, 'status': 'reserved', 'instance': 'd9bfb9f9-95a4-49f5-b781-5e78c83c54d1', 'attached_at': '', 'detached_at': '', 'volume_id': '67e7fd43-4d07-4a4c-8027-2861e79e6e04', 'serial'} {{(pid=75745) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG nova.compute.manager [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] swap_volume: removing Cinder connection for volume b000c1c2-a9f3-4629-b034-ef182141787e {{(pid=75745) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Dec 01 17:08:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:34 user nova-compute[75745]: DEBUG nova.compute.manager [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] swap_volume: Updating volume b000c1c2-a9f3-4629-b034-ef182141787e BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "SWPtsvUY", "auth_password": "0PLRnO4WQEmlfC", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdm", "volume_id": "67e7fd43-4d07-4a4c-8027-2861e79e6e04"}, "status": "reserved", "instance": "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1", "attached_at": "", "detached_at": "", "volume_id": "67e7fd43-4d07-4a4c-8027-2861e79e6e04", "serial": "67e7fd43-4d07-4a4c-8027-2861e79e6e04"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '67e7fd43-4d07-4a4c-8027-2861e79e6e04', 'no_device': None, 'attachment_id': '84dd4596-5909-4a5d-8a98-9366bf5b6682'} {{(pid=75745) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Dec 01 17:08:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-93b96371-40d0-491f-9e74-2a20c604b44c tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Lock "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.888s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Acquiring lock "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Lock "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:35 user nova-compute[75745]: DEBUG os_brick.utils [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:08:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:35 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[95648f4a-8340-4d48-bf0b-be784a16cbf9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:35 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92546fc-c867-43bc-bcb7-1a73bee3a7e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:35 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18a88ec-b1bc-4504-a847-d8e4263db6d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:35 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e337698c-1e58-4002-a42b-17ed636b8800]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:08:35 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:08:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:08:35 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:08:35 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ad8d72-75ba-46c2-87a3-44c69a7fd967]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:35 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:08:35 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:08:35 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:08:35 user nova-compute[75745]: DEBUG os_brick.utils [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:08:35 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:08:35 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:08:35 user nova-compute[75745]: INFO nova.compute.manager [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Swapping volume 67e7fd43-4d07-4a4c-8027-2861e79e6e04 for b000c1c2-a9f3-4629-b034-ef182141787e
Dec 01 17:08:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VPeoIbFv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:08:36 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:08:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:08:36 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:08:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:08:36 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:08:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e01ced-51ee-4772-9470-30e41f050fe7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:08:36 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8dbdd7d-4e32-42fa-b6ea-100a49f1382c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c] added
Dec 01 17:08:36 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a4fe90-e5a6-4142-a48e-bd1d6ed53ef1]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e265a5f-57ff-451b-8237-f3a0a36ee14e]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VPeoIbFv {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VPeoIbFv" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[52dc4000-b6e2-403d-b27e-e8a43eeed62d]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VPeoIbFv'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef2b4b8-0d62-4b4f-8de4-3b2b5f60a78a]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b99409-dbf2-4910-8339-09451905494f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:36 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:36 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dac82c8-dd2e-4291-b399-f97c6a10a30a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c, portal: 172.16.0.220,3260]
Dec 01 17:08:36 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c, portal: 172.16.0.220,3260] successful.
Dec 01 17:08:36 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a10b909-aedc-4f9a-a90f-9f7a4a93576a]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[872e3f6c-52b7-46b5-ab39-efd020b706fe]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:36 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:36 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:36 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] HCTL ('41', '-', '-', 0) found on session 15 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1890bfcd-e480-416d-976b-eb26d0dbb930]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Searching for a device in session 15 and hctl ['41', '*', '*', 0] yield: None {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:08:36 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:08:37 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Searching for a device in session 15 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:08:37 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VPeoIbFv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:08:37 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:08:37 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] <== connect_volume: return (1405ms) {'type': 'block', 'scsi_wwn': '23961623030643961', 'path': '/dev/sdj'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:08:37 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961623030643961', 'path': '/dev/sdj'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:08:37 user nova-compute[75745]: DEBUG nova.objects.instance [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Lazy-loading 'flavor' on Instance uuid 0e256c89-0301-431a-ae27-dfd7c2af19f2 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:08:37 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:08:37 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:08:37 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] attach device xml: <disk type="block" device="disk">
Dec 01 17:08:37 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:08:37 user nova-compute[75745]:   <source dev="/dev/sdj"/>
Dec 01 17:08:37 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:08:37 user nova-compute[75745]:   <serial>f45ea748-d36e-4f48-9af3-8d022a56290c</serial>
Dec 01 17:08:37 user nova-compute[75745]: </disk>
Dec 01 17:08:37 user nova-compute[75745]:  {{(pid=75745) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 17:08:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:37 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:08:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:38 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:08:38 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:08:38 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] No VIF found with MAC fa:16:3e:66:77:e0, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:08:38 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:08:38 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:08:38 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:08:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e2259b5d-1615-4432-8c08-22bd94a404f2 tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Lock "0e256c89-0301-431a-ae27-dfd7c2af19f2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.692s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:38 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:08:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a79223d3-5790-4938-bace-8d0941cb5c62 tempest-VolumesAssistedSnapshotsTest-2085892572 tempest-VolumesAssistedSnapshotsTest-2085892572-project] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] volume_snapshot_create: create_info: {'snapshot_id': '66f2c254-f456-4a3b-9bc8-758d396a4bdd', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75745) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3572}}
Dec 01 17:08:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a79223d3-5790-4938-bace-8d0941cb5c62 tempest-VolumesAssistedSnapshotsTest-2085892572 tempest-VolumesAssistedSnapshotsTest-2085892572-project] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] snap xml: <domainsnapshot>
Dec 01 17:08:39 user nova-compute[75745]:   <disks>
Dec 01 17:08:39 user nova-compute[75745]:     <disk name="/dev/sdj" snapshot="external" type="file">
Dec 01 17:08:39 user nova-compute[75745]:       <source file="/dev/new_file"/>
Dec 01 17:08:39 user nova-compute[75745]:     </disk>
Dec 01 17:08:39 user nova-compute[75745]:     <disk name="vda" snapshot="no"/>
Dec 01 17:08:39 user nova-compute[75745]:   </disks>
Dec 01 17:08:39 user nova-compute[75745]: </domainsnapshot>
Dec 01 17:08:39 user nova-compute[75745]:  {{(pid=75745) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3513}}
Dec 01 17:08:39 user nova-compute[75745]: DEBUG nova.objects.instance [None req-a79223d3-5790-4938-bace-8d0941cb5c62 tempest-VolumesAssistedSnapshotsTest-2085892572 tempest-VolumesAssistedSnapshotsTest-2085892572-project] Lazy-loading 'system_metadata' on Instance uuid 0e256c89-0301-431a-ae27-dfd7c2af19f2 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:08:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bfb9f9-95a4-49f5-b781-5e78c83c54d1/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9203631d-d967-4042-81c7-597816982405 tempest-VolumesAssistedSnapshotsTest-2085892572 tempest-VolumesAssistedSnapshotsTest-2085892572-project] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] volume_snapshot_delete: delete_info: {'volume_id': 'f45ea748-d36e-4f48-9af3-8d022a56290c'} {{(pid=75745) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3673}}
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [None req-9203631d-d967-4042-81c7-597816982405 tempest-VolumesAssistedSnapshotsTest-2085892572 tempest-VolumesAssistedSnapshotsTest-2085892572-project] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Traceback (most recent call last):
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3846, in volume_snapshot_delete
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]     self._volume_snapshot_delete(context, instance, volume_id,
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3676, in _volume_snapshot_delete
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]     if delete_info['type'] != 'qcow2':
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] KeyError: 'type'
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] 
Dec 01 17:08:39 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-a79223d3-5790-4938-bace-8d0941cb5c62 tempest-VolumesAssistedSnapshotsTest-2085892572 tempest-VolumesAssistedSnapshotsTest-2085892572-project] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [None req-a79223d3-5790-4938-bace-8d0941cb5c62 tempest-VolumesAssistedSnapshotsTest-2085892572 tempest-VolumesAssistedSnapshotsTest-2085892572-project] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Traceback (most recent call last):
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]     rv = execute(f, *args, **kwargs)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]     six.reraise(c, e, tb)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]     raise value
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]     rv = meth(*args, **kwargs)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] 
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [None req-a79223d3-5790-4938-bace-8d0941cb5c62 tempest-VolumesAssistedSnapshotsTest-2085892572 tempest-VolumesAssistedSnapshotsTest-2085892572-project] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Traceback (most recent call last):
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3590, in volume_snapshot_create
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]     self._volume_snapshot_create(context, instance, guest,
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]     rv = execute(f, *args, **kwargs)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]     six.reraise(c, e, tb)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]     raise value
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]     rv = meth(*args, **kwargs)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] 
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [None req-9203631d-d967-4042-81c7-597816982405 tempest-VolumesAssistedSnapshotsTest-2085892572 tempest-VolumesAssistedSnapshotsTest-2085892572-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3846, in volume_snapshot_delete
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3676, in _volume_snapshot_delete
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver 
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver 
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-9db484e5-814b-4a57-8585-376a15a6a793)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver 
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver 
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3412, in _volume_snapshot_update_status
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver 
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server [None req-9203631d-d967-4042-81c7-597816982405 tempest-VolumesAssistedSnapshotsTest-2085892572 tempest-VolumesAssistedSnapshotsTest-2085892572-project] Exception during message handling: KeyError: 'type'
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3849, in volume_snapshot_delete
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3846, in volume_snapshot_delete
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3676, in _volume_snapshot_delete
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server 
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver [None req-a79223d3-5790-4938-bace-8d0941cb5c62 tempest-VolumesAssistedSnapshotsTest-2085892572 tempest-VolumesAssistedSnapshotsTest-2085892572-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 66f2c254-f456-4a3b-9bc8-758d396a4bdd could not be found.
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3590, in volume_snapshot_create
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     raise value
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver 
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver 
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 66f2c254-f456-4a3b-9bc8-758d396a4bdd could not be found. (HTTP 404) (Request-ID: req-3de79c81-0ada-42f1-960a-c568a647c422)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver 
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver 
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3412, in _volume_snapshot_update_status
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 66f2c254-f456-4a3b-9bc8-758d396a4bdd could not be found.
Dec 01 17:08:39 user nova-compute[75745]: ERROR nova.virt.libvirt.driver 
Dec 01 17:08:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bfb9f9-95a4-49f5-b781-5e78c83c54d1/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server [None req-a79223d3-5790-4938-bace-8d0941cb5c62 tempest-VolumesAssistedSnapshotsTest-2085892572 tempest-VolumesAssistedSnapshotsTest-2085892572-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3593, in volume_snapshot_create
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3590, in volume_snapshot_create
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     raise value
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 01 17:08:39 user nova-compute[75745]: ERROR oslo_messaging.rpc.server 
Dec 01 17:08:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bfb9f9-95a4-49f5-b781-5e78c83c54d1/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bfb9f9-95a4-49f5-b781-5e78c83c54d1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdm (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:08:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:08:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:08:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:08:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Acquiring lock "0e256c89-0301-431a-ae27-dfd7c2af19f2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Lock "0e256c89-0301-431a-ae27-dfd7c2af19f2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:39 user nova-compute[75745]: INFO nova.compute.manager [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Detaching volume f45ea748-d36e-4f48-9af3-8d022a56290c
Dec 01 17:08:39 user nova-compute[75745]: INFO nova.virt.block_device [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Attempting to driver detach volume f45ea748-d36e-4f48-9af3-8d022a56290c from mountpoint /dev/vdb
Dec 01 17:08:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Attempting to detach device vdb from instance 0e256c89-0301-431a-ae27-dfd7c2af19f2 from the persistent domain config. {{(pid=75745) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 17:08:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] detach device xml: <disk type="block" device="disk">
Dec 01 17:08:39 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:08:39 user nova-compute[75745]:   <source dev="/dev/sdj"/>
Dec 01 17:08:39 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:08:39 user nova-compute[75745]:   <serial>f45ea748-d36e-4f48-9af3-8d022a56290c</serial>
Dec 01 17:08:39 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 17:08:39 user nova-compute[75745]: </disk>
Dec 01 17:08:39 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:08:39 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Successfully detached device vdb from instance 0e256c89-0301-431a-ae27-dfd7c2af19f2 from the persistent domain config.
Dec 01 17:08:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0e256c89-0301-431a-ae27-dfd7c2af19f2 from the live domain config. {{(pid=75745) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 17:08:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] detach device xml: <disk type="block" device="disk">
Dec 01 17:08:39 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:08:39 user nova-compute[75745]:   <source dev="/dev/sdj"/>
Dec 01 17:08:39 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:08:39 user nova-compute[75745]:   <serial>f45ea748-d36e-4f48-9af3-8d022a56290c</serial>
Dec 01 17:08:39 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 17:08:39 user nova-compute[75745]: </disk>
Dec 01 17:08:39 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:08:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fb74ee-dfa0-40e1-8773-99bd4a0402d5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fb74ee-dfa0-40e1-8773-99bd4a0402d5/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fb74ee-dfa0-40e1-8773-99bd4a0402d5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0e256c89-0301-431a-ae27-dfd7c2af19f2 {{(pid=75745) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 17:08:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7fb74ee-dfa0-40e1-8773-99bd4a0402d5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc78dcf1-f005-415c-ac27-798cab8f52fb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc78dcf1-f005-415c-ac27-798cab8f52fb/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc78dcf1-f005-415c-ac27-798cab8f52fb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc78dcf1-f005-415c-ac27-798cab8f52fb/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:08:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3a04948-936e-47c8-8a5f-e7bdee5b69db/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3a04948-936e-47c8-8a5f-e7bdee5b69db/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3a04948-936e-47c8-8a5f-e7bdee5b69db/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3a04948-936e-47c8-8a5f-e7bdee5b69db/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e256c89-0301-431a-ae27-dfd7c2af19f2/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e256c89-0301-431a-ae27-dfd7c2af19f2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e256c89-0301-431a-ae27-dfd7c2af19f2/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e256c89-0301-431a-ae27-dfd7c2af19f2/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:41 user nova-compute[75745]: DEBUG nova.compute.manager [req-74ba87b5-d514-4fec-91a4-ce1d553e9eb8 req-30fb6184-0d70-46c3-b316-f9f3706f6c50 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-changed-d7c02fc7-a4d9-4c86-b18b-cf12d101f22f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:41 user nova-compute[75745]: DEBUG nova.compute.manager [req-74ba87b5-d514-4fec-91a4-ce1d553e9eb8 req-30fb6184-0d70-46c3-b316-f9f3706f6c50 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Refreshing instance network info cache due to event network-changed-d7c02fc7-a4d9-4c86-b18b-cf12d101f22f. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:08:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-74ba87b5-d514-4fec-91a4-ce1d553e9eb8 req-30fb6184-0d70-46c3-b316-f9f3706f6c50 service nova] Acquiring lock "refresh_cache-1372f3b7-6608-43a9-b1a5-fd7dfbaf303e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:08:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-74ba87b5-d514-4fec-91a4-ce1d553e9eb8 req-30fb6184-0d70-46c3-b316-f9f3706f6c50 service nova] Acquired lock "refresh_cache-1372f3b7-6608-43a9-b1a5-fd7dfbaf303e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:08:41 user nova-compute[75745]: DEBUG nova.network.neutron [req-74ba87b5-d514-4fec-91a4-ce1d553e9eb8 req-30fb6184-0d70-46c3-b316-f9f3706f6c50 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Refreshing network info cache for port d7c02fc7-a4d9-4c86-b18b-cf12d101f22f {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:08:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4bc58d-90b6-4621-80a9-0b72194b10da/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4bc58d-90b6-4621-80a9-0b72194b10da/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4bc58d-90b6-4621-80a9-0b72194b10da/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4bc58d-90b6-4621-80a9-0b72194b10da/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:42 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:08:42 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:08:42 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=7288MB free_disk=25.455821990966797GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:08:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:42 user nova-compute[75745]: DEBUG nova.network.neutron [req-74ba87b5-d514-4fec-91a4-ce1d553e9eb8 req-30fb6184-0d70-46c3-b316-f9f3706f6c50 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Updated VIF entry in instance network info cache for port d7c02fc7-a4d9-4c86-b18b-cf12d101f22f. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:08:42 user nova-compute[75745]: DEBUG nova.network.neutron [req-74ba87b5-d514-4fec-91a4-ce1d553e9eb8 req-30fb6184-0d70-46c3-b316-f9f3706f6c50 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Updating instance_info_cache with network_info: [{"id": "d7c02fc7-a4d9-4c86-b18b-cf12d101f22f", "address": "fa:16:3e:09:96:2e", "network": {"id": "b1af6a14-56fa-4052-8593-93b13dc6a9a1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1377780155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7c02fc7-a4", "ovs_interfaceid": "d7c02fc7-a4d9-4c86-b18b-cf12d101f22f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4024ab4b-08e5-4f1f-866d-979bb1dee426", "address": "fa:16:3e:bc:fa:09", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4024ab4b-08", "ovs_interfaceid": "4024ab4b-08e5-4f1f-866d-979bb1dee426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6e1b67ad-1619-4e40-906c-df31e0eab904", "address": "fa:16:3e:a7:3f:00", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e1b67ad-16", "ovs_interfaceid": "6e1b67ad-1619-4e40-906c-df31e0eab904", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "92b697c2-8400-4b91-9fd7-53df7f47c4e0", "address": "fa:16:3e:95:8f:8d", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b697c2-84", "ovs_interfaceid": "92b697c2-8400-4b91-9fd7-53df7f47c4e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f79cb7e-7ef6-4e1a-a241-780713de2217", "address": "fa:16:3e:ef:c2:b4", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f79cb7e-7e", "ovs_interfaceid": "9f79cb7e-7ef6-4e1a-a241-780713de2217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b6cfe1f-9722-41e1-9679-52398359a035", "address": "fa:16:3e:7c:30:af", "network": {"id": "32d435b7-174b-4e6c-9165-315876fea12a", "bridge": "br-int", "label": "tempest-device-tagging-net2-658876998", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6cfe1f-97", "ovs_interfaceid": "4b6cfe1f-9722-41e1-9679-52398359a035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2f8e363-9e49-43ae-b61b-7ff8893c9f8f", "address": "fa:16:3e:20:41:d6", "network": {"id": "32d435b7-174b-4e6c-9165-315876fea12a", "bridge": "br-int", "label": "tempest-device-tagging-net2-658876998", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f8e363-9e", "ovs_interfaceid": "f2f8e363-9e49-43ae-b61b-7ff8893c9f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:08:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-74ba87b5-d514-4fec-91a4-ce1d553e9eb8 req-30fb6184-0d70-46c3-b316-f9f3706f6c50 service nova] Releasing lock "refresh_cache-1372f3b7-6608-43a9-b1a5-fd7dfbaf303e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:08:42 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance dc78dcf1-f005-415c-ac27-798cab8f52fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:08:42 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 4ac6f586-cc5b-4a3f-b374-4b2006a48427 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:08:42 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 2abc6436-bf45-497a-acd2-47d43d5e158c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:08:42 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance c7fb74ee-dfa0-40e1-8773-99bd4a0402d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:08:42 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance d9bfb9f9-95a4-49f5-b781-5e78c83c54d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:08:42 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 02715ae1-5200-4df5-8430-2f19a610d2bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:08:42 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 0e256c89-0301-431a-ae27-dfd7c2af19f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:08:42 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 9d4bc58d-90b6-4621-80a9-0b72194b10da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:08:42 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:08:42 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 5c6c7551-7045-4129-9908-c0c6fbd93124 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:08:42 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance b3a04948-936e-47c8-8a5f-e7bdee5b69db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:08:42 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:08:42 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:08:43 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:08:43 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:08:43 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:08:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.562s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:43 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:43 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:44 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:08:44 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:08:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Acquiring lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Acquiring lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:44 user nova-compute[75745]: INFO nova.compute.manager [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Terminating instance
Dec 01 17:08:44 user nova-compute[75745]: DEBUG nova.compute.manager [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:08:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-4ac6f586-cc5b-4a3f-b374-4b2006a48427" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:08:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-4ac6f586-cc5b-4a3f-b374-4b2006a48427" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:08:44 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:08:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:44 user nova-compute[75745]: DEBUG nova.compute.manager [req-5fa8a88a-1926-425d-8823-d2fdadc42237 req-7634cbab-0611-403b-86dd-f75ac73d5d33 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-changed-de0d310c-2bc9-4434-8b2b-253a88febaa0 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:44 user nova-compute[75745]: DEBUG nova.compute.manager [req-5fa8a88a-1926-425d-8823-d2fdadc42237 req-7634cbab-0611-403b-86dd-f75ac73d5d33 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Refreshing instance network info cache due to event network-changed-de0d310c-2bc9-4434-8b2b-253a88febaa0. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:08:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5fa8a88a-1926-425d-8823-d2fdadc42237 req-7634cbab-0611-403b-86dd-f75ac73d5d33 service nova] Acquiring lock "refresh_cache-5c6c7551-7045-4129-9908-c0c6fbd93124" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:08:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5fa8a88a-1926-425d-8823-d2fdadc42237 req-7634cbab-0611-403b-86dd-f75ac73d5d33 service nova] Acquired lock "refresh_cache-5c6c7551-7045-4129-9908-c0c6fbd93124" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:08:44 user nova-compute[75745]: DEBUG nova.network.neutron [req-5fa8a88a-1926-425d-8823-d2fdadc42237 req-7634cbab-0611-403b-86dd-f75ac73d5d33 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Refreshing network info cache for port de0d310c-2bc9-4434-8b2b-253a88febaa0 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:08:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:45 user nova-compute[75745]: DEBUG nova.compute.manager [req-7092ddc9-45b5-4638-93e9-b22ed4e63fcf req-75e8681a-17a6-4d5c-aac4-a2de506a51aa service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-unplugged-d7c02fc7-a4d9-4c86-b18b-cf12d101f22f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7092ddc9-45b5-4638-93e9-b22ed4e63fcf req-75e8681a-17a6-4d5c-aac4-a2de506a51aa service nova] Acquiring lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7092ddc9-45b5-4638-93e9-b22ed4e63fcf req-75e8681a-17a6-4d5c-aac4-a2de506a51aa service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7092ddc9-45b5-4638-93e9-b22ed4e63fcf req-75e8681a-17a6-4d5c-aac4-a2de506a51aa service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:45 user nova-compute[75745]: DEBUG nova.compute.manager [req-7092ddc9-45b5-4638-93e9-b22ed4e63fcf req-75e8681a-17a6-4d5c-aac4-a2de506a51aa service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] No waiting events found dispatching network-vif-unplugged-d7c02fc7-a4d9-4c86-b18b-cf12d101f22f {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:45 user nova-compute[75745]: DEBUG nova.compute.manager [req-7092ddc9-45b5-4638-93e9-b22ed4e63fcf req-75e8681a-17a6-4d5c-aac4-a2de506a51aa service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-unplugged-d7c02fc7-a4d9-4c86-b18b-cf12d101f22f for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:08:45 user nova-compute[75745]: DEBUG nova.compute.manager [req-b1fc32e6-afb8-4deb-9aee-1acdec8a6e0b req-dee53b1f-f07e-4a64-9a73-f1dedbd06a51 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-unplugged-6e1b67ad-1619-4e40-906c-df31e0eab904 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b1fc32e6-afb8-4deb-9aee-1acdec8a6e0b req-dee53b1f-f07e-4a64-9a73-f1dedbd06a51 service nova] Acquiring lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b1fc32e6-afb8-4deb-9aee-1acdec8a6e0b req-dee53b1f-f07e-4a64-9a73-f1dedbd06a51 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b1fc32e6-afb8-4deb-9aee-1acdec8a6e0b req-dee53b1f-f07e-4a64-9a73-f1dedbd06a51 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:45 user nova-compute[75745]: DEBUG nova.compute.manager [req-b1fc32e6-afb8-4deb-9aee-1acdec8a6e0b req-dee53b1f-f07e-4a64-9a73-f1dedbd06a51 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] No waiting events found dispatching network-vif-unplugged-6e1b67ad-1619-4e40-906c-df31e0eab904 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:45 user nova-compute[75745]: DEBUG nova.compute.manager [req-b1fc32e6-afb8-4deb-9aee-1acdec8a6e0b req-dee53b1f-f07e-4a64-9a73-f1dedbd06a51 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-unplugged-6e1b67ad-1619-4e40-906c-df31e0eab904 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:08:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:45 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Updating instance_info_cache with network_info: [{"id": "b4990a3b-371a-44eb-98d8-685dc63590da", "address": "fa:16:3e:d3:4e:b4", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4990a3b-37", "ovs_interfaceid": "b4990a3b-371a-44eb-98d8-685dc63590da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:08:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-4ac6f586-cc5b-4a3f-b374-4b2006a48427" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:08:45 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:08:45 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:08:45 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:08:45 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:08:45 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:08:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG nova.network.neutron [req-5fa8a88a-1926-425d-8823-d2fdadc42237 req-7634cbab-0611-403b-86dd-f75ac73d5d33 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Updated VIF entry in instance network info cache for port de0d310c-2bc9-4434-8b2b-253a88febaa0. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG nova.network.neutron [req-5fa8a88a-1926-425d-8823-d2fdadc42237 req-7634cbab-0611-403b-86dd-f75ac73d5d33 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Updating instance_info_cache with network_info: [{"id": "de0d310c-2bc9-4434-8b2b-253a88febaa0", "address": "fa:16:3e:3f:e1:39", "network": {"id": "8d239238-e90b-4408-86f0-a143eb9ac337", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1071206325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0d310c-2b", "ovs_interfaceid": "de0d310c-2bc9-4434-8b2b-253a88febaa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5ecb053-fd41-42ea-8abe-4c504b6c7882", "address": "fa:16:3e:56:bb:b9", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5ecb053-fd", "ovs_interfaceid": "a5ecb053-fd41-42ea-8abe-4c504b6c7882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4bc79fe9-e1e7-4040-ae00-e231301a8c58", "address": "fa:16:3e:b8:6d:f8", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc79fe9-e1", "ovs_interfaceid": "4bc79fe9-e1e7-4040-ae00-e231301a8c58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9d9f0b3d-a677-4db0-a8be-b19006908125", "address": "fa:16:3e:d2:26:2b", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d9f0b3d-a6", "ovs_interfaceid": "9d9f0b3d-a677-4db0-a8be-b19006908125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "754453de-6c68-4cdd-acc4-2307e4b6d3d2", "address": "fa:16:3e:e2:b2:aa", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap754453de-6c", "ovs_interfaceid": "754453de-6c68-4cdd-acc4-2307e4b6d3d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "847be9c3-c4d1-4280-8b85-56697d11a876", "address": "fa:16:3e:67:52:ab", "network": {"id": "2a7db2ed-f938-42c6-b85c-8a94ac2717a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-811431562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap847be9c3-c4", "ovs_interfaceid": "847be9c3-c4d1-4280-8b85-56697d11a876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6812409-296e-40f5-bdfc-b7cedf33f85b", "address": "fa:16:3e:db:bf:df", "network": {"id": "2a7db2ed-f938-42c6-b85c-8a94ac2717a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-811431562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6812409-29", "ovs_interfaceid": "c6812409-296e-40f5-bdfc-b7cedf33f85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5fa8a88a-1926-425d-8823-d2fdadc42237 req-7634cbab-0611-403b-86dd-f75ac73d5d33 service nova] Releasing lock "refresh_cache-5c6c7551-7045-4129-9908-c0c6fbd93124" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:08:46 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Instance destroyed successfully.
Dec 01 17:08:46 user nova-compute[75745]: DEBUG nova.objects.instance [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Lazy-loading 'resources' on Instance uuid 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-967863949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-967863949',id=10,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNJQ6Ls85E20B9JwJyODLi6L5WLfy6H87RMs9k8eKydMJ8U7Bv+G1AO3XADEvyUXeKa4DqapDG0KKZB6o4L4oqqYYcjzoS5y0Gkw1mDGthLvWBxAnOCXC13OwMrt/AWCA==',key_name='tempest-keypair-2600959',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:07:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='586f7ce69de240cb9e2d110530c2c7ef',ramdisk_id='',reservation_id='r-e9tvthiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-744386326',owner_user_name='tempest-TaggedBootDevicesTest-744386326-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:07:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9840763db2774692ae52f8a689ed9083',uuid=1372f3b7-6608-43a9-b1a5-fd7dfbaf303e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7c02fc7-a4d9-4c86-b18b-cf12d101f22f", "address": "fa:16:3e:09:96:2e", "network": {"id": "b1af6a14-56fa-4052-8593-93b13dc6a9a1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1377780155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7c02fc7-a4", "ovs_interfaceid": "d7c02fc7-a4d9-4c86-b18b-cf12d101f22f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converting VIF {"id": "d7c02fc7-a4d9-4c86-b18b-cf12d101f22f", "address": "fa:16:3e:09:96:2e", "network": {"id": "b1af6a14-56fa-4052-8593-93b13dc6a9a1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1377780155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7c02fc7-a4", "ovs_interfaceid": "d7c02fc7-a4d9-4c86-b18b-cf12d101f22f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:96:2e,bridge_name='br-int',has_traffic_filtering=True,id=d7c02fc7-a4d9-4c86-b18b-cf12d101f22f,network=Network(b1af6a14-56fa-4052-8593-93b13dc6a9a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7c02fc7-a4') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG os_vif [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:96:2e,bridge_name='br-int',has_traffic_filtering=True,id=d7c02fc7-a4d9-4c86-b18b-cf12d101f22f,network=Network(b1af6a14-56fa-4052-8593-93b13dc6a9a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7c02fc7-a4') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7c02fc7-a4, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de630e01-2288-4059-b514-a7fc7e657da0) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG nova.compute.manager [req-1bf32069-82e4-4659-9011-f2f7e0175be3 req-7d17211f-0a9a-40ed-8b73-6e304545f150 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-unplugged-4024ab4b-08e5-4f1f-866d-979bb1dee426 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1bf32069-82e4-4659-9011-f2f7e0175be3 req-7d17211f-0a9a-40ed-8b73-6e304545f150 service nova] Acquiring lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1bf32069-82e4-4659-9011-f2f7e0175be3 req-7d17211f-0a9a-40ed-8b73-6e304545f150 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1bf32069-82e4-4659-9011-f2f7e0175be3 req-7d17211f-0a9a-40ed-8b73-6e304545f150 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG nova.compute.manager [req-1bf32069-82e4-4659-9011-f2f7e0175be3 req-7d17211f-0a9a-40ed-8b73-6e304545f150 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] No waiting events found dispatching network-vif-unplugged-4024ab4b-08e5-4f1f-866d-979bb1dee426 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG nova.compute.manager [req-1bf32069-82e4-4659-9011-f2f7e0175be3 req-7d17211f-0a9a-40ed-8b73-6e304545f150 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-unplugged-4024ab4b-08e5-4f1f-866d-979bb1dee426 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG nova.compute.manager [req-1bf32069-82e4-4659-9011-f2f7e0175be3 req-7d17211f-0a9a-40ed-8b73-6e304545f150 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-plugged-4024ab4b-08e5-4f1f-866d-979bb1dee426 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1bf32069-82e4-4659-9011-f2f7e0175be3 req-7d17211f-0a9a-40ed-8b73-6e304545f150 service nova] Acquiring lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1bf32069-82e4-4659-9011-f2f7e0175be3 req-7d17211f-0a9a-40ed-8b73-6e304545f150 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1bf32069-82e4-4659-9011-f2f7e0175be3 req-7d17211f-0a9a-40ed-8b73-6e304545f150 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG nova.compute.manager [req-1bf32069-82e4-4659-9011-f2f7e0175be3 req-7d17211f-0a9a-40ed-8b73-6e304545f150 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] No waiting events found dispatching network-vif-plugged-4024ab4b-08e5-4f1f-866d-979bb1dee426 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:46 user nova-compute[75745]: WARNING nova.compute.manager [req-1bf32069-82e4-4659-9011-f2f7e0175be3 req-7d17211f-0a9a-40ed-8b73-6e304545f150 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received unexpected event network-vif-plugged-4024ab4b-08e5-4f1f-866d-979bb1dee426 for instance with vm_state active and task_state deleting.
Dec 01 17:08:46 user nova-compute[75745]: DEBUG nova.compute.manager [req-1bf32069-82e4-4659-9011-f2f7e0175be3 req-7d17211f-0a9a-40ed-8b73-6e304545f150 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-unplugged-4b6cfe1f-9722-41e1-9679-52398359a035 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1bf32069-82e4-4659-9011-f2f7e0175be3 req-7d17211f-0a9a-40ed-8b73-6e304545f150 service nova] Acquiring lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1bf32069-82e4-4659-9011-f2f7e0175be3 req-7d17211f-0a9a-40ed-8b73-6e304545f150 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1bf32069-82e4-4659-9011-f2f7e0175be3 req-7d17211f-0a9a-40ed-8b73-6e304545f150 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG nova.compute.manager [req-1bf32069-82e4-4659-9011-f2f7e0175be3 req-7d17211f-0a9a-40ed-8b73-6e304545f150 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] No waiting events found dispatching network-vif-unplugged-4b6cfe1f-9722-41e1-9679-52398359a035 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG nova.compute.manager [req-1bf32069-82e4-4659-9011-f2f7e0175be3 req-7d17211f-0a9a-40ed-8b73-6e304545f150 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-unplugged-4b6cfe1f-9722-41e1-9679-52398359a035 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG nova.compute.manager [req-1bf32069-82e4-4659-9011-f2f7e0175be3 req-7d17211f-0a9a-40ed-8b73-6e304545f150 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-plugged-4b6cfe1f-9722-41e1-9679-52398359a035 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1bf32069-82e4-4659-9011-f2f7e0175be3 req-7d17211f-0a9a-40ed-8b73-6e304545f150 service nova] Acquiring lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1bf32069-82e4-4659-9011-f2f7e0175be3 req-7d17211f-0a9a-40ed-8b73-6e304545f150 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1bf32069-82e4-4659-9011-f2f7e0175be3 req-7d17211f-0a9a-40ed-8b73-6e304545f150 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG nova.compute.manager [req-1bf32069-82e4-4659-9011-f2f7e0175be3 req-7d17211f-0a9a-40ed-8b73-6e304545f150 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] No waiting events found dispatching network-vif-plugged-4b6cfe1f-9722-41e1-9679-52398359a035 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:46 user nova-compute[75745]: WARNING nova.compute.manager [req-1bf32069-82e4-4659-9011-f2f7e0175be3 req-7d17211f-0a9a-40ed-8b73-6e304545f150 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received unexpected event network-vif-plugged-4b6cfe1f-9722-41e1-9679-52398359a035 for instance with vm_state active and task_state deleting.
Dec 01 17:08:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:46 user nova-compute[75745]: INFO os_vif [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:96:2e,bridge_name='br-int',has_traffic_filtering=True,id=d7c02fc7-a4d9-4c86-b18b-cf12d101f22f,network=Network(b1af6a14-56fa-4052-8593-93b13dc6a9a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7c02fc7-a4')
Dec 01 17:08:46 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-967863949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-967863949',id=10,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNJQ6Ls85E20B9JwJyODLi6L5WLfy6H87RMs9k8eKydMJ8U7Bv+G1AO3XADEvyUXeKa4DqapDG0KKZB6o4L4oqqYYcjzoS5y0Gkw1mDGthLvWBxAnOCXC13OwMrt/AWCA==',key_name='tempest-keypair-2600959',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:07:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='586f7ce69de240cb9e2d110530c2c7ef',ramdisk_id='',reservation_id='r-e9tvthiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-744386326',owner_user_name='tempest-TaggedBootDevicesTest-744386326-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:07:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9840763db2774692ae52f8a689ed9083',uuid=1372f3b7-6608-43a9-b1a5-fd7dfbaf303e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4024ab4b-08e5-4f1f-866d-979bb1dee426", "address": "fa:16:3e:bc:fa:09", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4024ab4b-08", "ovs_interfaceid": "4024ab4b-08e5-4f1f-866d-979bb1dee426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converting VIF {"id": "4024ab4b-08e5-4f1f-866d-979bb1dee426", "address": "fa:16:3e:bc:fa:09", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4024ab4b-08", "ovs_interfaceid": "4024ab4b-08e5-4f1f-866d-979bb1dee426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:fa:09,bridge_name='br-int',has_traffic_filtering=True,id=4024ab4b-08e5-4f1f-866d-979bb1dee426,network=Network(a0d9c591-842a-4fcd-93e5-62cacb3f1d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4024ab4b-08') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG os_vif [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:fa:09,bridge_name='br-int',has_traffic_filtering=True,id=4024ab4b-08e5-4f1f-866d-979bb1dee426,network=Network(a0d9c591-842a-4fcd-93e5-62cacb3f1d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4024ab4b-08') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4024ab4b-08, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d3352ca0-0163-4a2f-9bf8-b3a9c9b44041) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:46 user nova-compute[75745]: INFO os_vif [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:fa:09,bridge_name='br-int',has_traffic_filtering=True,id=4024ab4b-08e5-4f1f-866d-979bb1dee426,network=Network(a0d9c591-842a-4fcd-93e5-62cacb3f1d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4024ab4b-08')
Dec 01 17:08:46 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-967863949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-967863949',id=10,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNJQ6Ls85E20B9JwJyODLi6L5WLfy6H87RMs9k8eKydMJ8U7Bv+G1AO3XADEvyUXeKa4DqapDG0KKZB6o4L4oqqYYcjzoS5y0Gkw1mDGthLvWBxAnOCXC13OwMrt/AWCA==',key_name='tempest-keypair-2600959',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:07:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='586f7ce69de240cb9e2d110530c2c7ef',ramdisk_id='',reservation_id='r-e9tvthiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-744386326',owner_user_name='tempest-TaggedBootDevicesTest-744386326-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:07:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9840763db2774692ae52f8a689ed9083',uuid=1372f3b7-6608-43a9-b1a5-fd7dfbaf303e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e1b67ad-1619-4e40-906c-df31e0eab904", "address": "fa:16:3e:a7:3f:00", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e1b67ad-16", "ovs_interfaceid": "6e1b67ad-1619-4e40-906c-df31e0eab904", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converting VIF {"id": "6e1b67ad-1619-4e40-906c-df31e0eab904", "address": "fa:16:3e:a7:3f:00", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e1b67ad-16", "ovs_interfaceid": "6e1b67ad-1619-4e40-906c-df31e0eab904", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:3f:00,bridge_name='br-int',has_traffic_filtering=True,id=6e1b67ad-1619-4e40-906c-df31e0eab904,network=Network(a0d9c591-842a-4fcd-93e5-62cacb3f1d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e1b67ad-16') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG os_vif [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:3f:00,bridge_name='br-int',has_traffic_filtering=True,id=6e1b67ad-1619-4e40-906c-df31e0eab904,network=Network(a0d9c591-842a-4fcd-93e5-62cacb3f1d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e1b67ad-16') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e1b67ad-16, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5625952c-a882-43a1-a322-bb931e598e59) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:47 user nova-compute[75745]: INFO os_vif [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:3f:00,bridge_name='br-int',has_traffic_filtering=True,id=6e1b67ad-1619-4e40-906c-df31e0eab904,network=Network(a0d9c591-842a-4fcd-93e5-62cacb3f1d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e1b67ad-16')
Dec 01 17:08:47 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-967863949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-967863949',id=10,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNJQ6Ls85E20B9JwJyODLi6L5WLfy6H87RMs9k8eKydMJ8U7Bv+G1AO3XADEvyUXeKa4DqapDG0KKZB6o4L4oqqYYcjzoS5y0Gkw1mDGthLvWBxAnOCXC13OwMrt/AWCA==',key_name='tempest-keypair-2600959',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:07:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='586f7ce69de240cb9e2d110530c2c7ef',ramdisk_id='',reservation_id='r-e9tvthiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-744386326',owner_user_name='tempest-TaggedBootDevicesTest-744386326-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:07:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9840763db2774692ae52f8a689ed9083',uuid=1372f3b7-6608-43a9-b1a5-fd7dfbaf303e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92b697c2-8400-4b91-9fd7-53df7f47c4e0", "address": "fa:16:3e:95:8f:8d", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b697c2-84", "ovs_interfaceid": "92b697c2-8400-4b91-9fd7-53df7f47c4e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converting VIF {"id": "92b697c2-8400-4b91-9fd7-53df7f47c4e0", "address": "fa:16:3e:95:8f:8d", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b697c2-84", "ovs_interfaceid": "92b697c2-8400-4b91-9fd7-53df7f47c4e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:8f:8d,bridge_name='br-int',has_traffic_filtering=True,id=92b697c2-8400-4b91-9fd7-53df7f47c4e0,network=Network(a0d9c591-842a-4fcd-93e5-62cacb3f1d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92b697c2-84') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_vif [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:8f:8d,bridge_name='br-int',has_traffic_filtering=True,id=92b697c2-8400-4b91-9fd7-53df7f47c4e0,network=Network(a0d9c591-842a-4fcd-93e5-62cacb3f1d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92b697c2-84') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92b697c2-84, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6ba55ac2-a4e2-4c2f-ad2c-d99aa527a515) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:47 user nova-compute[75745]: INFO os_vif [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:8f:8d,bridge_name='br-int',has_traffic_filtering=True,id=92b697c2-8400-4b91-9fd7-53df7f47c4e0,network=Network(a0d9c591-842a-4fcd-93e5-62cacb3f1d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92b697c2-84')
Dec 01 17:08:47 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-967863949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-967863949',id=10,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNJQ6Ls85E20B9JwJyODLi6L5WLfy6H87RMs9k8eKydMJ8U7Bv+G1AO3XADEvyUXeKa4DqapDG0KKZB6o4L4oqqYYcjzoS5y0Gkw1mDGthLvWBxAnOCXC13OwMrt/AWCA==',key_name='tempest-keypair-2600959',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:07:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='586f7ce69de240cb9e2d110530c2c7ef',ramdisk_id='',reservation_id='r-e9tvthiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-744386326',owner_user_name='tempest-TaggedBootDevicesTest-744386326-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:07:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9840763db2774692ae52f8a689ed9083',uuid=1372f3b7-6608-43a9-b1a5-fd7dfbaf303e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f79cb7e-7ef6-4e1a-a241-780713de2217", "address": "fa:16:3e:ef:c2:b4", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f79cb7e-7e", "ovs_interfaceid": "9f79cb7e-7ef6-4e1a-a241-780713de2217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converting VIF {"id": "9f79cb7e-7ef6-4e1a-a241-780713de2217", "address": "fa:16:3e:ef:c2:b4", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f79cb7e-7e", "ovs_interfaceid": "9f79cb7e-7ef6-4e1a-a241-780713de2217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c2:b4,bridge_name='br-int',has_traffic_filtering=True,id=9f79cb7e-7ef6-4e1a-a241-780713de2217,network=Network(a0d9c591-842a-4fcd-93e5-62cacb3f1d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f79cb7e-7e') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_vif [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c2:b4,bridge_name='br-int',has_traffic_filtering=True,id=9f79cb7e-7ef6-4e1a-a241-780713de2217,network=Network(a0d9c591-842a-4fcd-93e5-62cacb3f1d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f79cb7e-7e') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f79cb7e-7e, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7beb321c-7567-4411-a378-4c964b4d233e) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:47 user nova-compute[75745]: INFO os_vif [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c2:b4,bridge_name='br-int',has_traffic_filtering=True,id=9f79cb7e-7ef6-4e1a-a241-780713de2217,network=Network(a0d9c591-842a-4fcd-93e5-62cacb3f1d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f79cb7e-7e')
Dec 01 17:08:47 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-967863949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-967863949',id=10,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNJQ6Ls85E20B9JwJyODLi6L5WLfy6H87RMs9k8eKydMJ8U7Bv+G1AO3XADEvyUXeKa4DqapDG0KKZB6o4L4oqqYYcjzoS5y0Gkw1mDGthLvWBxAnOCXC13OwMrt/AWCA==',key_name='tempest-keypair-2600959',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:07:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='586f7ce69de240cb9e2d110530c2c7ef',ramdisk_id='',reservation_id='r-e9tvthiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-744386326',owner_user_name='tempest-TaggedBootDevicesTest-744386326-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:07:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9840763db2774692ae52f8a689ed9083',uuid=1372f3b7-6608-43a9-b1a5-fd7dfbaf303e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b6cfe1f-9722-41e1-9679-52398359a035", "address": "fa:16:3e:7c:30:af", "network": {"id": "32d435b7-174b-4e6c-9165-315876fea12a", "bridge": "br-int", "label": "tempest-device-tagging-net2-658876998", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6cfe1f-97", "ovs_interfaceid": "4b6cfe1f-9722-41e1-9679-52398359a035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converting VIF {"id": "4b6cfe1f-9722-41e1-9679-52398359a035", "address": "fa:16:3e:7c:30:af", "network": {"id": "32d435b7-174b-4e6c-9165-315876fea12a", "bridge": "br-int", "label": "tempest-device-tagging-net2-658876998", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6cfe1f-97", "ovs_interfaceid": "4b6cfe1f-9722-41e1-9679-52398359a035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:30:af,bridge_name='br-int',has_traffic_filtering=True,id=4b6cfe1f-9722-41e1-9679-52398359a035,network=Network(32d435b7-174b-4e6c-9165-315876fea12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b6cfe1f-97') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_vif [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:30:af,bridge_name='br-int',has_traffic_filtering=True,id=4b6cfe1f-9722-41e1-9679-52398359a035,network=Network(32d435b7-174b-4e6c-9165-315876fea12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b6cfe1f-97') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b6cfe1f-97, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG nova.compute.manager [req-fdf667b9-a1d3-4f1f-9ce3-d72f526cd52b req-76b609e6-79eb-44b7-bd9f-bcc950b05dae service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-plugged-d7c02fc7-a4d9-4c86-b18b-cf12d101f22f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fdf667b9-a1d3-4f1f-9ce3-d72f526cd52b req-76b609e6-79eb-44b7-bd9f-bcc950b05dae service nova] Acquiring lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fdf667b9-a1d3-4f1f-9ce3-d72f526cd52b req-76b609e6-79eb-44b7-bd9f-bcc950b05dae service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fdf667b9-a1d3-4f1f-9ce3-d72f526cd52b req-76b609e6-79eb-44b7-bd9f-bcc950b05dae service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG nova.compute.manager [req-fdf667b9-a1d3-4f1f-9ce3-d72f526cd52b req-76b609e6-79eb-44b7-bd9f-bcc950b05dae service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] No waiting events found dispatching network-vif-plugged-d7c02fc7-a4d9-4c86-b18b-cf12d101f22f {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:47 user nova-compute[75745]: WARNING nova.compute.manager [req-fdf667b9-a1d3-4f1f-9ce3-d72f526cd52b req-76b609e6-79eb-44b7-bd9f-bcc950b05dae service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received unexpected event network-vif-plugged-d7c02fc7-a4d9-4c86-b18b-cf12d101f22f for instance with vm_state active and task_state deleting.
Dec 01 17:08:47 user nova-compute[75745]: DEBUG nova.compute.manager [req-fdf667b9-a1d3-4f1f-9ce3-d72f526cd52b req-76b609e6-79eb-44b7-bd9f-bcc950b05dae service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-unplugged-f2f8e363-9e49-43ae-b61b-7ff8893c9f8f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fdf667b9-a1d3-4f1f-9ce3-d72f526cd52b req-76b609e6-79eb-44b7-bd9f-bcc950b05dae service nova] Acquiring lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fdf667b9-a1d3-4f1f-9ce3-d72f526cd52b req-76b609e6-79eb-44b7-bd9f-bcc950b05dae service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fdf667b9-a1d3-4f1f-9ce3-d72f526cd52b req-76b609e6-79eb-44b7-bd9f-bcc950b05dae service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG nova.compute.manager [req-fdf667b9-a1d3-4f1f-9ce3-d72f526cd52b req-76b609e6-79eb-44b7-bd9f-bcc950b05dae service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] No waiting events found dispatching network-vif-unplugged-f2f8e363-9e49-43ae-b61b-7ff8893c9f8f {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG nova.compute.manager [req-fdf667b9-a1d3-4f1f-9ce3-d72f526cd52b req-76b609e6-79eb-44b7-bd9f-bcc950b05dae service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-unplugged-f2f8e363-9e49-43ae-b61b-7ff8893c9f8f for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG nova.compute.manager [req-fdf667b9-a1d3-4f1f-9ce3-d72f526cd52b req-76b609e6-79eb-44b7-bd9f-bcc950b05dae service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-plugged-f2f8e363-9e49-43ae-b61b-7ff8893c9f8f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fdf667b9-a1d3-4f1f-9ce3-d72f526cd52b req-76b609e6-79eb-44b7-bd9f-bcc950b05dae service nova] Acquiring lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fdf667b9-a1d3-4f1f-9ce3-d72f526cd52b req-76b609e6-79eb-44b7-bd9f-bcc950b05dae service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fdf667b9-a1d3-4f1f-9ce3-d72f526cd52b req-76b609e6-79eb-44b7-bd9f-bcc950b05dae service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG nova.compute.manager [req-fdf667b9-a1d3-4f1f-9ce3-d72f526cd52b req-76b609e6-79eb-44b7-bd9f-bcc950b05dae service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] No waiting events found dispatching network-vif-plugged-f2f8e363-9e49-43ae-b61b-7ff8893c9f8f {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:47 user nova-compute[75745]: WARNING nova.compute.manager [req-fdf667b9-a1d3-4f1f-9ce3-d72f526cd52b req-76b609e6-79eb-44b7-bd9f-bcc950b05dae service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received unexpected event network-vif-plugged-f2f8e363-9e49-43ae-b61b-7ff8893c9f8f for instance with vm_state active and task_state deleting.
Dec 01 17:08:47 user nova-compute[75745]: DEBUG nova.compute.manager [req-47f1070d-a935-4988-b327-fb495d8780b5 req-56445307-7845-44cd-9e59-45e6dcd645f4 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-plugged-6e1b67ad-1619-4e40-906c-df31e0eab904 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-47f1070d-a935-4988-b327-fb495d8780b5 req-56445307-7845-44cd-9e59-45e6dcd645f4 service nova] Acquiring lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-47f1070d-a935-4988-b327-fb495d8780b5 req-56445307-7845-44cd-9e59-45e6dcd645f4 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-47f1070d-a935-4988-b327-fb495d8780b5 req-56445307-7845-44cd-9e59-45e6dcd645f4 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG nova.compute.manager [req-47f1070d-a935-4988-b327-fb495d8780b5 req-56445307-7845-44cd-9e59-45e6dcd645f4 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] No waiting events found dispatching network-vif-plugged-6e1b67ad-1619-4e40-906c-df31e0eab904 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:47 user nova-compute[75745]: WARNING nova.compute.manager [req-47f1070d-a935-4988-b327-fb495d8780b5 req-56445307-7845-44cd-9e59-45e6dcd645f4 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received unexpected event network-vif-plugged-6e1b67ad-1619-4e40-906c-df31e0eab904 for instance with vm_state active and task_state deleting.
Dec 01 17:08:47 user nova-compute[75745]: DEBUG nova.compute.manager [req-47f1070d-a935-4988-b327-fb495d8780b5 req-56445307-7845-44cd-9e59-45e6dcd645f4 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-unplugged-92b697c2-8400-4b91-9fd7-53df7f47c4e0 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-47f1070d-a935-4988-b327-fb495d8780b5 req-56445307-7845-44cd-9e59-45e6dcd645f4 service nova] Acquiring lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-47f1070d-a935-4988-b327-fb495d8780b5 req-56445307-7845-44cd-9e59-45e6dcd645f4 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-47f1070d-a935-4988-b327-fb495d8780b5 req-56445307-7845-44cd-9e59-45e6dcd645f4 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG nova.compute.manager [req-47f1070d-a935-4988-b327-fb495d8780b5 req-56445307-7845-44cd-9e59-45e6dcd645f4 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] No waiting events found dispatching network-vif-unplugged-92b697c2-8400-4b91-9fd7-53df7f47c4e0 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG nova.compute.manager [req-47f1070d-a935-4988-b327-fb495d8780b5 req-56445307-7845-44cd-9e59-45e6dcd645f4 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-unplugged-92b697c2-8400-4b91-9fd7-53df7f47c4e0 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG nova.compute.manager [req-47f1070d-a935-4988-b327-fb495d8780b5 req-56445307-7845-44cd-9e59-45e6dcd645f4 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-plugged-92b697c2-8400-4b91-9fd7-53df7f47c4e0 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-47f1070d-a935-4988-b327-fb495d8780b5 req-56445307-7845-44cd-9e59-45e6dcd645f4 service nova] Acquiring lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-47f1070d-a935-4988-b327-fb495d8780b5 req-56445307-7845-44cd-9e59-45e6dcd645f4 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-47f1070d-a935-4988-b327-fb495d8780b5 req-56445307-7845-44cd-9e59-45e6dcd645f4 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG nova.compute.manager [req-47f1070d-a935-4988-b327-fb495d8780b5 req-56445307-7845-44cd-9e59-45e6dcd645f4 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] No waiting events found dispatching network-vif-plugged-92b697c2-8400-4b91-9fd7-53df7f47c4e0 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:47 user nova-compute[75745]: WARNING nova.compute.manager [req-47f1070d-a935-4988-b327-fb495d8780b5 req-56445307-7845-44cd-9e59-45e6dcd645f4 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received unexpected event network-vif-plugged-92b697c2-8400-4b91-9fd7-53df7f47c4e0 for instance with vm_state active and task_state deleting.
Dec 01 17:08:47 user nova-compute[75745]: DEBUG nova.compute.manager [req-47f1070d-a935-4988-b327-fb495d8780b5 req-56445307-7845-44cd-9e59-45e6dcd645f4 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-unplugged-9f79cb7e-7ef6-4e1a-a241-780713de2217 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-47f1070d-a935-4988-b327-fb495d8780b5 req-56445307-7845-44cd-9e59-45e6dcd645f4 service nova] Acquiring lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-47f1070d-a935-4988-b327-fb495d8780b5 req-56445307-7845-44cd-9e59-45e6dcd645f4 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-47f1070d-a935-4988-b327-fb495d8780b5 req-56445307-7845-44cd-9e59-45e6dcd645f4 service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG nova.compute.manager [req-47f1070d-a935-4988-b327-fb495d8780b5 req-56445307-7845-44cd-9e59-45e6dcd645f4 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] No waiting events found dispatching network-vif-unplugged-9f79cb7e-7ef6-4e1a-a241-780713de2217 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG nova.compute.manager [req-47f1070d-a935-4988-b327-fb495d8780b5 req-56445307-7845-44cd-9e59-45e6dcd645f4 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-unplugged-9f79cb7e-7ef6-4e1a-a241-780713de2217 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fd3c2b47-836f-45b6-8d18-ab576de2a50e) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:47 user nova-compute[75745]: INFO os_vif [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:30:af,bridge_name='br-int',has_traffic_filtering=True,id=4b6cfe1f-9722-41e1-9679-52398359a035,network=Network(32d435b7-174b-4e6c-9165-315876fea12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b6cfe1f-97')
Dec 01 17:08:47 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-967863949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-967863949',id=10,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNJQ6Ls85E20B9JwJyODLi6L5WLfy6H87RMs9k8eKydMJ8U7Bv+G1AO3XADEvyUXeKa4DqapDG0KKZB6o4L4oqqYYcjzoS5y0Gkw1mDGthLvWBxAnOCXC13OwMrt/AWCA==',key_name='tempest-keypair-2600959',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:07:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='586f7ce69de240cb9e2d110530c2c7ef',ramdisk_id='',reservation_id='r-e9tvthiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-744386326',owner_user_name='tempest-TaggedBootDevicesTest-744386326-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:07:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9840763db2774692ae52f8a689ed9083',uuid=1372f3b7-6608-43a9-b1a5-fd7dfbaf303e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2f8e363-9e49-43ae-b61b-7ff8893c9f8f", "address": "fa:16:3e:20:41:d6", "network": {"id": "32d435b7-174b-4e6c-9165-315876fea12a", "bridge": "br-int", "label": "tempest-device-tagging-net2-658876998", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f8e363-9e", "ovs_interfaceid": "f2f8e363-9e49-43ae-b61b-7ff8893c9f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converting VIF {"id": "f2f8e363-9e49-43ae-b61b-7ff8893c9f8f", "address": "fa:16:3e:20:41:d6", "network": {"id": "32d435b7-174b-4e6c-9165-315876fea12a", "bridge": "br-int", "label": "tempest-device-tagging-net2-658876998", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f8e363-9e", "ovs_interfaceid": "f2f8e363-9e49-43ae-b61b-7ff8893c9f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:41:d6,bridge_name='br-int',has_traffic_filtering=True,id=f2f8e363-9e49-43ae-b61b-7ff8893c9f8f,network=Network(32d435b7-174b-4e6c-9165-315876fea12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2f8e363-9e') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_vif [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:41:d6,bridge_name='br-int',has_traffic_filtering=True,id=f2f8e363-9e49-43ae-b61b-7ff8893c9f8f,network=Network(32d435b7-174b-4e6c-9165-315876fea12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2f8e363-9e') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2f8e363-9e, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=faf0ac2e-6a08-46bf-b139-9488a7cf16d8) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:47 user nova-compute[75745]: INFO os_vif [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:41:d6,bridge_name='br-int',has_traffic_filtering=True,id=f2f8e363-9e49-43ae-b61b-7ff8893c9f8f,network=Network(32d435b7-174b-4e6c-9165-315876fea12a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2f8e363-9e')
Dec 01 17:08:47 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FbIkLqxs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:08:47 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fad586d-ada4-455a-acdc-2b87cc47e585]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:08:47 user nova-compute[75745]: No targets found.
Dec 01 17:08:47 user nova-compute[75745]: iSNS:
Dec 01 17:08:47 user nova-compute[75745]: No targets found.
Dec 01 17:08:47 user nova-compute[75745]: STATIC:
Dec 01 17:08:47 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c
Dec 01 17:08:47 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:47 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:47 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c
Dec 01 17:08:47 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:47 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:47 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749
Dec 01 17:08:47 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:47 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:47 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111
Dec 01 17:08:47 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:47 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:47 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de
Dec 01 17:08:47 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:47 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:47 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e
Dec 01 17:08:47 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:47 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:47 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121
Dec 01 17:08:47 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:47 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:47 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762
Dec 01 17:08:47 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:47 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:47 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04
Dec 01 17:08:47 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:47 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:47 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0
Dec 01 17:08:47 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:47 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:47 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9
Dec 01 17:08:47 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:47 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:47 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16
Dec 01 17:08:47 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:47 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:47 user nova-compute[75745]: FIRMWARE:
Dec 01 17:08:47 user nova-compute[75745]: No targets found.
Dec 01 17:08:47 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:08:47 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:08:47 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[677d4297-ef66-4b2b-abda-a7330973ca68]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36a650e-9636-480c-a099-a8579ae15910]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:47 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:47 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b819a830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e'): ({'sdd'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Removing single pathed devices sdd {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7984d891-db36-4d9f-83ef-8d24700ece3c]: (4, ('path checker states:\nup                  11\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[408b6ffa-98fc-439b-927b-6c2ebbe3d246]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Flushing IO for device /dev/sdd {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f62efb-cde5-4e29-93d7-2853078e6b90]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2422d9bf-6cac-4dde-816e-c193f575208f]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] SCSI volumes sdd have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80be46e-e8e5-48d2-bfea-e42c72457ee1]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84b186b-dbb3-467d-ba24-38867a04eddd]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e, portal: 172.16.0.220,3260]
Dec 01 17:08:47 user nova-compute[75745]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e, portal: 172.16.0.220,3260] successful.
Dec 01 17:08:47 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8751e4f8-9d97-4f54-a375-bd0f45e3862e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9044d2c2-2970-4bb5-b897-84fc54c6427c]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] <== disconnect_volume: return (380ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xMsYFESW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:08:47 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG nova.compute.manager [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XgKELjUI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd9bfb9f9-95a4-49f5-b781-5e78c83c54d1', 'attached_at': '', 'detached_at': '', 'volume_id': 'b000c1c2-a9f3-4629-b034-ef182141787e', 'serial': 'b000c1c2-a9f3-4629-b034-ef182141787e'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SWPtsvUY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdm', 'volume_id': '67e7fd43-4d07-4a4c-8027-2861e79e6e04'}, 'status': 'reserved', 'instance': 'd9bfb9f9-95a4-49f5-b781-5e78c83c54d1', 'attached_at': '', 'detached_at': '', 'volume_id': '67e7fd43-4d07-4a4c-8027-2861e79e6e04', 'serial'} {{(pid=75745) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XgKELjUI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:08:47 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded8baa7-0943-4dd4-92a4-1c5cd6f102d3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:08:47 user nova-compute[75745]: No targets found.
Dec 01 17:08:47 user nova-compute[75745]: iSNS:
Dec 01 17:08:47 user nova-compute[75745]: No targets found.
Dec 01 17:08:47 user nova-compute[75745]: STATIC:
Dec 01 17:08:47 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c
Dec 01 17:08:47 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:47 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:47 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c
Dec 01 17:08:47 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:47 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:47 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749
Dec 01 17:08:47 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:47 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:47 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111
Dec 01 17:08:47 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:47 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:47 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de
Dec 01 17:08:47 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:47 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:47 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121
Dec 01 17:08:47 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:47 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:47 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762
Dec 01 17:08:47 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:47 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:47 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04
Dec 01 17:08:47 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:47 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:47 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0
Dec 01 17:08:47 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:47 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:47 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9
Dec 01 17:08:47 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:47 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:47 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16
Dec 01 17:08:47 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:47 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:47 user nova-compute[75745]: FIRMWARE:
Dec 01 17:08:47 user nova-compute[75745]: No targets found.
Dec 01 17:08:47 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:08:47 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:08:47 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed387f2-dda9-43f4-bc4b-f91bfd9c5c1a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:47 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance c7fb74ee-dfa0-40e1-8773-99bd4a0402d5 is timed out.
Dec 01 17:08:47 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Successfully detached device sdc from instance c7fb74ee-dfa0-40e1-8773-99bd4a0402d5 from the live domain config.
Dec 01 17:08:47 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CTDvIONZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:08:47 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[03688b7f-014f-4232-910e-5648cd342985]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:47 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:47 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:47 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24dbcc9c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c'): ({'sdf'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Removing single pathed devices sdf {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[597f0681-7f40-42fa-ad1e-cc489616beae]: (4, ('path checker states:\nup                  10\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f515dd-eac3-4fb9-9517-1cca9962f3fe]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Flushing IO for device /dev/sdf {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eea5294-d4fa-4aa4-8868-1da178eff72a]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:08:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.031s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[41903ab1-cc1d-4ca0-93b2-723ee95a9226]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] SCSI volumes sdf have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67a7d75-4ef6-4615-b806-806e4dff4ae4]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[de564ee0-1f78-4998-975d-8af6f44272c1]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c, portal: 172.16.0.220,3260]
Dec 01 17:08:48 user nova-compute[75745]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c, portal: 172.16.0.220,3260] successful.
Dec 01 17:08:48 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c89cdf46-af77-47c8-a1fc-7a9a26f4b05c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[72351aef-841c-4062-91bb-de2adf40c074]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] <== disconnect_volume: return (351ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.341s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:08:48 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:08:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:08:48 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:08:48 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TbdYMtaf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:08:48 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:08:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[56440326-f047-4028-af3d-8cb6f267ceba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:08:48 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d8db0e-d615-436f-970c-a20752a3bb18]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e] added
Dec 01 17:08:48 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[998b4fc6-7f92-4fac-bff3-de1c51dc479f]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6de5d9-5788-4001-bd5c-0a1bddedd480]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XgKELjUI {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XgKELjUI" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[255dbd0f-9260-4631-8ec4-5006d889fea9]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XgKELjUI'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e16a09-5386-4b7e-bfac-4c6fbe721633]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Acquiring lock "5c6c7551-7045-4129-9908-c0c6fbd93124" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Acquiring lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:48 user nova-compute[75745]: INFO nova.compute.manager [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Terminating instance
Dec 01 17:08:48 user nova-compute[75745]: DEBUG nova.compute.manager [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2d44c0-dfb5-49fd-b65f-620ca8e4be2a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:48 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:48 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --login" returned: 0 in 0.111s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4b440f-82e6-42e3-8a0c-e538e4f971c2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e, portal: 172.16.0.220,3260]
Dec 01 17:08:48 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e, portal: 172.16.0.220,3260] successful.
Dec 01 17:08:48 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a94a16a-a475-43da-8890-5d8e266f6d35]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfb10a3-eacd-4377-af8b-a2bf26b79b86]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:48 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:48 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:48 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.360s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[042fb15c-cc8f-4930-b470-8318845179c5]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XgKELjUI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG nova.compute.manager [req-a6cef59b-e335-4e8f-b32f-c1c2fb15a16b req-d127b3dc-1601-41fc-8f23-5ff55d864fba service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-unplugged-de0d310c-2bc9-4434-8b2b-253a88febaa0 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a6cef59b-e335-4e8f-b32f-c1c2fb15a16b req-d127b3dc-1601-41fc-8f23-5ff55d864fba service nova] Acquiring lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a6cef59b-e335-4e8f-b32f-c1c2fb15a16b req-d127b3dc-1601-41fc-8f23-5ff55d864fba service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a6cef59b-e335-4e8f-b32f-c1c2fb15a16b req-d127b3dc-1601-41fc-8f23-5ff55d864fba service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG nova.compute.manager [req-a6cef59b-e335-4e8f-b32f-c1c2fb15a16b req-d127b3dc-1601-41fc-8f23-5ff55d864fba service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] No waiting events found dispatching network-vif-unplugged-de0d310c-2bc9-4434-8b2b-253a88febaa0 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG nova.compute.manager [req-a6cef59b-e335-4e8f-b32f-c1c2fb15a16b req-d127b3dc-1601-41fc-8f23-5ff55d864fba service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-unplugged-de0d310c-2bc9-4434-8b2b-253a88febaa0 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-534c2da7-e8e5-4f8d-b44d-03bae18acb9a tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Acquiring lock "9d4bc58d-90b6-4621-80a9-0b72194b10da" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-534c2da7-e8e5-4f8d-b44d-03bae18acb9a tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Lock "9d4bc58d-90b6-4621-80a9-0b72194b10da" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-534c2da7-e8e5-4f8d-b44d-03bae18acb9a tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Acquiring lock "9d4bc58d-90b6-4621-80a9-0b72194b10da-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-534c2da7-e8e5-4f8d-b44d-03bae18acb9a tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Lock "9d4bc58d-90b6-4621-80a9-0b72194b10da-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-534c2da7-e8e5-4f8d-b44d-03bae18acb9a tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Lock "9d4bc58d-90b6-4621-80a9-0b72194b10da-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:49 user nova-compute[75745]: INFO nova.compute.manager [None req-534c2da7-e8e5-4f8d-b44d-03bae18acb9a tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Terminating instance
Dec 01 17:08:49 user nova-compute[75745]: DEBUG nova.compute.manager [None req-534c2da7-e8e5-4f8d-b44d-03bae18acb9a tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG nova.compute.manager [req-fcb5311e-b3e9-4abc-895a-b19f663898ee req-eef7356a-1892-42bd-98dc-f1f2655998fb service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-plugged-9f79cb7e-7ef6-4e1a-a241-780713de2217 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fcb5311e-b3e9-4abc-895a-b19f663898ee req-eef7356a-1892-42bd-98dc-f1f2655998fb service nova] Acquiring lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fcb5311e-b3e9-4abc-895a-b19f663898ee req-eef7356a-1892-42bd-98dc-f1f2655998fb service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fcb5311e-b3e9-4abc-895a-b19f663898ee req-eef7356a-1892-42bd-98dc-f1f2655998fb service nova] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG nova.compute.manager [req-fcb5311e-b3e9-4abc-895a-b19f663898ee req-eef7356a-1892-42bd-98dc-f1f2655998fb service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] No waiting events found dispatching network-vif-plugged-9f79cb7e-7ef6-4e1a-a241-780713de2217 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:49 user nova-compute[75745]: WARNING nova.compute.manager [req-fcb5311e-b3e9-4abc-895a-b19f663898ee req-eef7356a-1892-42bd-98dc-f1f2655998fb service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received unexpected event network-vif-plugged-9f79cb7e-7ef6-4e1a-a241-780713de2217 for instance with vm_state active and task_state deleting.
Dec 01 17:08:49 user nova-compute[75745]: DEBUG nova.compute.manager [req-fcb5311e-b3e9-4abc-895a-b19f663898ee req-eef7356a-1892-42bd-98dc-f1f2655998fb service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-unplugged-c6812409-296e-40f5-bdfc-b7cedf33f85b {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fcb5311e-b3e9-4abc-895a-b19f663898ee req-eef7356a-1892-42bd-98dc-f1f2655998fb service nova] Acquiring lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fcb5311e-b3e9-4abc-895a-b19f663898ee req-eef7356a-1892-42bd-98dc-f1f2655998fb service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fcb5311e-b3e9-4abc-895a-b19f663898ee req-eef7356a-1892-42bd-98dc-f1f2655998fb service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG nova.compute.manager [req-fcb5311e-b3e9-4abc-895a-b19f663898ee req-eef7356a-1892-42bd-98dc-f1f2655998fb service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] No waiting events found dispatching network-vif-unplugged-c6812409-296e-40f5-bdfc-b7cedf33f85b {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG nova.compute.manager [req-fcb5311e-b3e9-4abc-895a-b19f663898ee req-eef7356a-1892-42bd-98dc-f1f2655998fb service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-unplugged-c6812409-296e-40f5-bdfc-b7cedf33f85b for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG nova.compute.manager [req-ca839bb7-8ab5-4755-8848-e83a3e819622 req-f7d299eb-e322-4452-9e63-303db29e65e2 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-unplugged-4bc79fe9-e1e7-4040-ae00-e231301a8c58 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ca839bb7-8ab5-4755-8848-e83a3e819622 req-f7d299eb-e322-4452-9e63-303db29e65e2 service nova] Acquiring lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ca839bb7-8ab5-4755-8848-e83a3e819622 req-f7d299eb-e322-4452-9e63-303db29e65e2 service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ca839bb7-8ab5-4755-8848-e83a3e819622 req-f7d299eb-e322-4452-9e63-303db29e65e2 service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG nova.compute.manager [req-ca839bb7-8ab5-4755-8848-e83a3e819622 req-f7d299eb-e322-4452-9e63-303db29e65e2 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] No waiting events found dispatching network-vif-unplugged-4bc79fe9-e1e7-4040-ae00-e231301a8c58 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG nova.compute.manager [req-ca839bb7-8ab5-4755-8848-e83a3e819622 req-f7d299eb-e322-4452-9e63-303db29e65e2 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-unplugged-4bc79fe9-e1e7-4040-ae00-e231301a8c58 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] <== connect_volume: return (1749ms) {'type': 'block', 'scsi_wwn': '23966393238363761', 'path': '/dev/sdd'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966393238363761', 'path': '/dev/sdd'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.708s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG nova.objects.instance [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Lazy-loading 'flavor' on Instance uuid d9bfb9f9-95a4-49f5-b781-5e78c83c54d1 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab61780-decd-4c4f-b570-45ee5e571db5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:08:49 user nova-compute[75745]: No targets found.
Dec 01 17:08:49 user nova-compute[75745]: iSNS:
Dec 01 17:08:49 user nova-compute[75745]: No targets found.
Dec 01 17:08:49 user nova-compute[75745]: STATIC:
Dec 01 17:08:49 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c
Dec 01 17:08:49 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:49 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:49 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749
Dec 01 17:08:49 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:49 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:49 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111
Dec 01 17:08:49 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:49 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:49 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de
Dec 01 17:08:49 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:49 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:49 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121
Dec 01 17:08:49 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:49 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:49 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762
Dec 01 17:08:49 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:49 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:49 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04
Dec 01 17:08:49 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:49 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:49 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0
Dec 01 17:08:49 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:49 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:49 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e
Dec 01 17:08:49 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:49 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:49 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9
Dec 01 17:08:49 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:49 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:49 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16
Dec 01 17:08:49 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:49 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:49 user nova-compute[75745]: FIRMWARE:
Dec 01 17:08:49 user nova-compute[75745]: No targets found.
Dec 01 17:08:49 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:08:49 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:08:49 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2258527a-719a-44e6-91d5-c2d20485cde6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efffdc3-648c-4c69-8b3f-2ce8c09bd19a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:49 user nova-compute[75745]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)
Dec 01 17:08:49 user nova-compute[75745]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)
Dec 01 17:08:49 user nova-compute[75745]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)
Dec 01 17:08:49 user nova-compute[75745]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)
Dec 01 17:08:49 user nova-compute[75745]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)
Dec 01 17:08:49 user nova-compute[75745]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:08:49 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:49 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:49 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:49 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:49 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:49 user nova-compute[75745]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 (non-flash)
Dec 01 17:08:49 user nova-compute[75745]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)
Dec 01 17:08:49 user nova-compute[75745]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)
Dec 01 17:08:49 user nova-compute[75745]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)
Dec 01 17:08:49 user nova-compute[75745]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)
Dec 01 17:08:49 user nova-compute[75745]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:08:49 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:49 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:49 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:49 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:49 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b8249ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0'): ({'sdk'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Removing single pathed devices sdk {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c58271-2367-479b-afa9-c23506dcf16f]: (4, ('path checker states:\nup                  10\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2f8feb-38f0-4d80-92ac-22b0d5ac518b]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Flushing IO for device /dev/sdk {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e663ea-16e8-4fa9-ac0c-d28bc78c8104]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.041s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d679b0b-5fea-4572-a60f-9eed3aba9d29]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] SCSI volumes sdk have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b3d74d-766f-4a94-9799-9c39ef22492f]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.120s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7f6822-2d21-4901-9da2-896aeedbecc7]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0, portal: 172.16.0.220,3260]
Dec 01 17:08:50 user nova-compute[75745]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0, portal: 172.16.0.220,3260] successful.
Dec 01 17:08:50 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:549f164a-dddc-479f-8178-e3db004fe8b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.052s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bcd37a-cc13-48bb-beb0-e914cffa5712]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.519s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] <== disconnect_volume: return (2227ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.940s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[104a8601-b054-480d-8538-8b5e94a97bc4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:08:50 user nova-compute[75745]: No targets found.
Dec 01 17:08:50 user nova-compute[75745]: iSNS:
Dec 01 17:08:50 user nova-compute[75745]: No targets found.
Dec 01 17:08:50 user nova-compute[75745]: STATIC:
Dec 01 17:08:50 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c
Dec 01 17:08:50 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:50 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:50 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749
Dec 01 17:08:50 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:50 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:50 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111
Dec 01 17:08:50 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:50 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:50 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de
Dec 01 17:08:50 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:50 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:50 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121
Dec 01 17:08:50 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:50 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:50 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762
Dec 01 17:08:50 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:50 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:50 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04
Dec 01 17:08:50 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:50 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:50 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e
Dec 01 17:08:50 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:50 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:50 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9
Dec 01 17:08:50 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:50 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:50 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16
Dec 01 17:08:50 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:50 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:50 user nova-compute[75745]: FIRMWARE:
Dec 01 17:08:50 user nova-compute[75745]: No targets found.
Dec 01 17:08:50 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:08:50 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:08:50 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7cb039-3504-4f7f-9a2d-bc52d85144cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[12831be4-71f5-483f-bdec-68f078d691d2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:50 user nova-compute[75745]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)
Dec 01 17:08:50 user nova-compute[75745]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)
Dec 01 17:08:50 user nova-compute[75745]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)
Dec 01 17:08:50 user nova-compute[75745]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)
Dec 01 17:08:50 user nova-compute[75745]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:08:50 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:50 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:50 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:50 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:50 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:50 user nova-compute[75745]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)
Dec 01 17:08:50 user nova-compute[75745]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)
Dec 01 17:08:50 user nova-compute[75745]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)
Dec 01 17:08:50 user nova-compute[75745]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)
Dec 01 17:08:50 user nova-compute[75745]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 (non-flash)
Dec 01 17:08:50 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:50 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:50 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:50 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:50 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b819a3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9'): ({'sdb'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Removing single pathed devices sdb {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3917756c-48f9-46c8-9e65-09a7242013b3]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cc5abb-087d-4837-b508-62f6b9892567]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Flushing IO for device /dev/sdb {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad82d12a-6a64-4b97-857d-b9acd1b70279]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fb1718-9e35-4cb3-8f1e-21e1f72a8b67]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] SCSI volumes sdb have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe6d099-354f-4597-83f6-c24c37a2cfd6]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:50 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 02715ae1-5200-4df5-8430-2f19a610d2bb is timed out.
Dec 01 17:08:50 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Successfully detached device vdb from instance 02715ae1-5200-4df5-8430-2f19a610d2bb from the live domain config.
Dec 01 17:08:50 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Instance destroyed successfully.
Dec 01 17:08:50 user nova-compute[75745]: DEBUG nova.objects.instance [None req-534c2da7-e8e5-4f8d-b44d-03bae18acb9a tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Lazy-loading 'resources' on Instance uuid 9d4bc58d-90b6-4621-80a9-0b72194b10da {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DmiXsNCw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, None), 'kwargs': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:08:50 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-534c2da7-e8e5-4f8d-b44d-03bae18acb9a tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:06:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-174829171',display_name='tempest-VolumesActionsTest-instance-174829171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-174829171',id=9,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:06:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='304bee6e8498432fa7a1e04e3cac5bc1',ramdisk_id='',reservation_id='r-tzkgadl3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1268939950',owner_user_name='tempest-VolumesActionsTest-1268939950-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:06:56Z,user_data=None,user_id='9250484734b54064bceffe0a3530b468',uuid=9d4bc58d-90b6-4621-80a9-0b72194b10da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b6d1ec0-f24a-4552-8851-861f7494eb49", "address": "fa:16:3e:c3:f4:38", "network": {"id": "a4de24de-6059-4a2a-bf8c-2a234f6c7d08", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1860496659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "304bee6e8498432fa7a1e04e3cac5bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6d1ec0-f2", "ovs_interfaceid": "6b6d1ec0-f24a-4552-8851-861f7494eb49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-534c2da7-e8e5-4f8d-b44d-03bae18acb9a tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Converting VIF {"id": "6b6d1ec0-f24a-4552-8851-861f7494eb49", "address": "fa:16:3e:c3:f4:38", "network": {"id": "a4de24de-6059-4a2a-bf8c-2a234f6c7d08", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1860496659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "304bee6e8498432fa7a1e04e3cac5bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6d1ec0-f2", "ovs_interfaceid": "6b6d1ec0-f24a-4552-8851-861f7494eb49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-534c2da7-e8e5-4f8d-b44d-03bae18acb9a tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f4:38,bridge_name='br-int',has_traffic_filtering=True,id=6b6d1ec0-f24a-4552-8851-861f7494eb49,network=Network(a4de24de-6059-4a2a-bf8c-2a234f6c7d08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b6d1ec0-f2') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_vif [None req-534c2da7-e8e5-4f8d-b44d-03bae18acb9a tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f4:38,bridge_name='br-int',has_traffic_filtering=True,id=6b6d1ec0-f24a-4552-8851-861f7494eb49,network=Network(a4de24de-6059-4a2a-bf8c-2a234f6c7d08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b6d1ec0-f2') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b6d1ec0-f2, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75745) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.122s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0855d35a-4890-4f12-b2dd-ef23b7057952]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9, portal: 172.16.0.220,3260]
Dec 01 17:08:50 user nova-compute[75745]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9, portal: 172.16.0.220,3260] successful.
Dec 01 17:08:50 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3a909f6-670c-4801-83b3-67dcc39f18b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.053s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b04fcf-29c4-4744-8787-74428b0356b8]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.452s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] <== disconnect_volume: return (2392ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:08:50 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Deleting instance files /opt/stack/data/nova/instances/1372f3b7-6608-43a9-b1a5-fd7dfbaf303e_del
Dec 01 17:08:50 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Deletion of /opt/stack/data/nova/instances/1372f3b7-6608-43a9-b1a5-fd7dfbaf303e_del complete
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.121s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5f8b97-529c-47b0-8267-f44bcc985ba4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:08:50 user nova-compute[75745]: No targets found.
Dec 01 17:08:50 user nova-compute[75745]: iSNS:
Dec 01 17:08:50 user nova-compute[75745]: No targets found.
Dec 01 17:08:50 user nova-compute[75745]: STATIC:
Dec 01 17:08:50 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c
Dec 01 17:08:50 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:50 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:50 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749
Dec 01 17:08:50 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:50 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:50 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111
Dec 01 17:08:50 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:50 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:50 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de
Dec 01 17:08:50 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:50 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:50 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121
Dec 01 17:08:50 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:50 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:50 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762
Dec 01 17:08:50 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:50 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:50 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04
Dec 01 17:08:50 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:50 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:50 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e
Dec 01 17:08:50 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:50 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:50 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16
Dec 01 17:08:50 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:50 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:50 user nova-compute[75745]: FIRMWARE:
Dec 01 17:08:50 user nova-compute[75745]: No targets found.
Dec 01 17:08:50 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:08:50 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:08:50 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4b4e4ec5-995f-4782-b22d-5a32b07ee58b) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[86328eeb-406b-4c6d-8357-a6f5d8af3ebe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:50 user nova-compute[75745]: INFO nova.compute.manager [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Took 6.25 seconds to destroy the instance on the hypervisor.
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd494986-be03-449b-940f-269a05f78ede]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:50 user nova-compute[75745]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)
Dec 01 17:08:50 user nova-compute[75745]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)
Dec 01 17:08:50 user nova-compute[75745]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)
Dec 01 17:08:50 user nova-compute[75745]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)
Dec 01 17:08:50 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:50 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:50 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:50 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:50 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:50 user nova-compute[75745]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 (non-flash)
Dec 01 17:08:50 user nova-compute[75745]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)
Dec 01 17:08:50 user nova-compute[75745]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)
Dec 01 17:08:50 user nova-compute[75745]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)
Dec 01 17:08:50 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:50 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:50 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:50 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:50 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b8249e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16'): ({'sdl'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Removing single pathed devices sdl {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:50 user nova-compute[75745]: INFO os_vif [None req-534c2da7-e8e5-4f8d-b44d-03bae18acb9a tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f4:38,bridge_name='br-int',has_traffic_filtering=True,id=6b6d1ec0-f24a-4552-8851-861f7494eb49,network=Network(a4de24de-6059-4a2a-bf8c-2a234f6c7d08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b6d1ec0-f2')
Dec 01 17:08:50 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-534c2da7-e8e5-4f8d-b44d-03bae18acb9a tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Deleting instance files /opt/stack/data/nova/instances/9d4bc58d-90b6-4621-80a9-0b72194b10da_del
Dec 01 17:08:50 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-534c2da7-e8e5-4f8d-b44d-03bae18acb9a tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Deletion of /opt/stack/data/nova/instances/9d4bc58d-90b6-4621-80a9-0b72194b10da_del complete
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b6cc91-f1a6-4803-bfab-47cb2f569e82]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa65c23-a2c1-452f-8289-40e00bf31311]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Flushing IO for device /dev/sdl {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.014s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea4f45f-9894-4c5c-b62d-d1da7b13524b]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:50 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Instance destroyed successfully.
Dec 01 17:08:50 user nova-compute[75745]: DEBUG nova.objects.instance [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Lazy-loading 'resources' on Instance uuid 5c6c7551-7045-4129-9908-c0c6fbd93124 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.052s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6759040c-7374-4cda-afbe-6ec057b727c3]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Checking to see if SCSI volumes sdl have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] SCSI volumes sdl have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO8a53d5e1-99db8be4c6c6abc4', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8a53d5e1', '/dev/disk/by-id/scsi-23939646238626534') {{(pid=86714) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[44933523-3c72-44c5-bcb9-1d46302d1065]: (4, None) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-167593192',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-167593192',id=11,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2S2wrkFBC9gY+Oe2HeW09yg38m59m78rYiqY7RnrDbPltQD4fWEhA5ttMZ/yujzCosNKXVpUVdmyGZKVGT7vN2JsjNz8AoSe3JK/sCACYt+isKHoPZHOig/W1x5tQ1pA==',key_name='tempest-keypair-2095316425',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:07:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75997c4cca1f4ebc9037a6dfc36a92b4',ramdisk_id='',reservation_id='r-z06l84ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-310064596',owner_user_name='tempest-TaggedBootDevicesTest_v242-310064596-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:07:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c78ca75618254393ab729856fb8905b7',uuid=5c6c7551-7045-4129-9908-c0c6fbd93124,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de0d310c-2bc9-4434-8b2b-253a88febaa0", "address": "fa:16:3e:3f:e1:39", "network": {"id": "8d239238-e90b-4408-86f0-a143eb9ac337", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1071206325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0d310c-2b", "ovs_interfaceid": "de0d310c-2bc9-4434-8b2b-253a88febaa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converting VIF {"id": "de0d310c-2bc9-4434-8b2b-253a88febaa0", "address": "fa:16:3e:3f:e1:39", "network": {"id": "8d239238-e90b-4408-86f0-a143eb9ac337", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1071206325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0d310c-2b", "ovs_interfaceid": "de0d310c-2bc9-4434-8b2b-253a88febaa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:e1:39,bridge_name='br-int',has_traffic_filtering=True,id=de0d310c-2bc9-4434-8b2b-253a88febaa0,network=Network(8d239238-e90b-4408-86f0-a143eb9ac337),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde0d310c-2b') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_vif [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:e1:39,bridge_name='br-int',has_traffic_filtering=True,id=de0d310c-2bc9-4434-8b2b-253a88febaa0,network=Network(8d239238-e90b-4408-86f0-a143eb9ac337),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde0d310c-2b') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:08:50 user nova-compute[75745]: INFO nova.compute.manager [None req-534c2da7-e8e5-4f8d-b44d-03bae18acb9a tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Took 1.74 seconds to destroy the instance on the hypervisor.
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-534c2da7-e8e5-4f8d-b44d-03bae18acb9a tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde0d310c-2b, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[52109178-f4e9-4d6f-82d1-25eabed4c7a7]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG nova.compute.manager [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-plugged-de0d310c-2bc9-4434-8b2b-253a88febaa0 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] Acquiring lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG nova.compute.manager [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] No waiting events found dispatching network-vif-plugged-de0d310c-2bc9-4434-8b2b-253a88febaa0 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:50 user nova-compute[75745]: WARNING nova.compute.manager [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received unexpected event network-vif-plugged-de0d310c-2bc9-4434-8b2b-253a88febaa0 for instance with vm_state active and task_state deleting.
Dec 01 17:08:50 user nova-compute[75745]: DEBUG nova.compute.manager [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-unplugged-a5ecb053-fd41-42ea-8abe-4c504b6c7882 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] Acquiring lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG nova.compute.manager [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] No waiting events found dispatching network-vif-unplugged-a5ecb053-fd41-42ea-8abe-4c504b6c7882 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG nova.compute.manager [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-unplugged-a5ecb053-fd41-42ea-8abe-4c504b6c7882 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG nova.compute.manager [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-plugged-a5ecb053-fd41-42ea-8abe-4c504b6c7882 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] Acquiring lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG nova.compute.manager [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] No waiting events found dispatching network-vif-plugged-a5ecb053-fd41-42ea-8abe-4c504b6c7882 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:50 user nova-compute[75745]: WARNING nova.compute.manager [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received unexpected event network-vif-plugged-a5ecb053-fd41-42ea-8abe-4c504b6c7882 for instance with vm_state active and task_state deleting.
Dec 01 17:08:50 user nova-compute[75745]: DEBUG nova.compute.manager [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-unplugged-9d9f0b3d-a677-4db0-a8be-b19006908125 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] Acquiring lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG nova.compute.manager [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] No waiting events found dispatching network-vif-unplugged-9d9f0b3d-a677-4db0-a8be-b19006908125 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG nova.compute.manager [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-unplugged-9d9f0b3d-a677-4db0-a8be-b19006908125 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG nova.compute.manager [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-plugged-9d9f0b3d-a677-4db0-a8be-b19006908125 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] Acquiring lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG nova.compute.manager [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] No waiting events found dispatching network-vif-plugged-9d9f0b3d-a677-4db0-a8be-b19006908125 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:50 user nova-compute[75745]: WARNING nova.compute.manager [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received unexpected event network-vif-plugged-9d9f0b3d-a677-4db0-a8be-b19006908125 for instance with vm_state active and task_state deleting.
Dec 01 17:08:50 user nova-compute[75745]: DEBUG nova.compute.manager [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-unplugged-847be9c3-c4d1-4280-8b85-56697d11a876 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] Acquiring lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG nova.compute.manager [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] No waiting events found dispatching network-vif-unplugged-847be9c3-c4d1-4280-8b85-56697d11a876 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG nova.compute.manager [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-unplugged-847be9c3-c4d1-4280-8b85-56697d11a876 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG nova.compute.manager [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-plugged-847be9c3-c4d1-4280-8b85-56697d11a876 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] Acquiring lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG nova.compute.manager [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] No waiting events found dispatching network-vif-plugged-847be9c3-c4d1-4280-8b85-56697d11a876 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:50 user nova-compute[75745]: WARNING nova.compute.manager [req-0573e8a5-d4f9-4eb8-9162-3c59fb6b100a req-7bde1557-57ec-4a56-a4ff-fb123c3f4e08 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received unexpected event network-vif-plugged-847be9c3-c4d1-4280-8b85-56697d11a876 for instance with vm_state active and task_state deleting.
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd9a141-4455-4449-966e-eb1e11fbc35d]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16, portal: 172.16.0.220,3260]
Dec 01 17:08:50 user nova-compute[75745]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16, portal: 172.16.0.220,3260] successful.
Dec 01 17:08:50 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] COPY block job progress, current cursor: 73400320 final cursor: 1073741824 {{(pid=75745) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=30c02b78-ea89-4ca8-8dcc-8582af0ed0ee) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b29cb5db-9033-42b2-97ee-ccd5651fbb16 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.051s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0059aa03-c219-4f0e-a7a4-8808cf9cb7d6]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.471s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] <== disconnect_volume: return (592ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:51 user nova-compute[75745]: INFO os_vif [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:e1:39,bridge_name='br-int',has_traffic_filtering=True,id=de0d310c-2bc9-4434-8b2b-253a88febaa0,network=Network(8d239238-e90b-4408-86f0-a143eb9ac337),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde0d310c-2b')
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-167593192',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-167593192',id=11,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2S2wrkFBC9gY+Oe2HeW09yg38m59m78rYiqY7RnrDbPltQD4fWEhA5ttMZ/yujzCosNKXVpUVdmyGZKVGT7vN2JsjNz8AoSe3JK/sCACYt+isKHoPZHOig/W1x5tQ1pA==',key_name='tempest-keypair-2095316425',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:07:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75997c4cca1f4ebc9037a6dfc36a92b4',ramdisk_id='',reservation_id='r-z06l84ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-310064596',owner_user_name='tempest-TaggedBootDevicesTest_v242-310064596-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:07:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c78ca75618254393ab729856fb8905b7',uuid=5c6c7551-7045-4129-9908-c0c6fbd93124,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5ecb053-fd41-42ea-8abe-4c504b6c7882", "address": "fa:16:3e:56:bb:b9", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5ecb053-fd", "ovs_interfaceid": "a5ecb053-fd41-42ea-8abe-4c504b6c7882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converting VIF {"id": "a5ecb053-fd41-42ea-8abe-4c504b6c7882", "address": "fa:16:3e:56:bb:b9", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5ecb053-fd", "ovs_interfaceid": "a5ecb053-fd41-42ea-8abe-4c504b6c7882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:bb:b9,bridge_name='br-int',has_traffic_filtering=True,id=a5ecb053-fd41-42ea-8abe-4c504b6c7882,network=Network(027c842b-831c-4cd4-8a9f-cca60bb6b647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa5ecb053-fd') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG os_vif [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:bb:b9,bridge_name='br-int',has_traffic_filtering=True,id=a5ecb053-fd41-42ea-8abe-4c504b6c7882,network=Network(027c842b-831c-4cd4-8a9f-cca60bb6b647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa5ecb053-fd') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5ecb053-fd, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=22471f14-ecdb-48a3-b8f0-504d8ff9b4fc) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:51 user nova-compute[75745]: INFO os_vif [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:bb:b9,bridge_name='br-int',has_traffic_filtering=True,id=a5ecb053-fd41-42ea-8abe-4c504b6c7882,network=Network(027c842b-831c-4cd4-8a9f-cca60bb6b647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa5ecb053-fd')
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-167593192',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-167593192',id=11,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2S2wrkFBC9gY+Oe2HeW09yg38m59m78rYiqY7RnrDbPltQD4fWEhA5ttMZ/yujzCosNKXVpUVdmyGZKVGT7vN2JsjNz8AoSe3JK/sCACYt+isKHoPZHOig/W1x5tQ1pA==',key_name='tempest-keypair-2095316425',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:07:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75997c4cca1f4ebc9037a6dfc36a92b4',ramdisk_id='',reservation_id='r-z06l84ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-310064596',owner_user_name='tempest-TaggedBootDevicesTest_v242-310064596-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:07:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c78ca75618254393ab729856fb8905b7',uuid=5c6c7551-7045-4129-9908-c0c6fbd93124,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4bc79fe9-e1e7-4040-ae00-e231301a8c58", "address": "fa:16:3e:b8:6d:f8", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc79fe9-e1", "ovs_interfaceid": "4bc79fe9-e1e7-4040-ae00-e231301a8c58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converting VIF {"id": "4bc79fe9-e1e7-4040-ae00-e231301a8c58", "address": "fa:16:3e:b8:6d:f8", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc79fe9-e1", "ovs_interfaceid": "4bc79fe9-e1e7-4040-ae00-e231301a8c58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:6d:f8,bridge_name='br-int',has_traffic_filtering=True,id=4bc79fe9-e1e7-4040-ae00-e231301a8c58,network=Network(027c842b-831c-4cd4-8a9f-cca60bb6b647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4bc79fe9-e1') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG os_vif [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:6d:f8,bridge_name='br-int',has_traffic_filtering=True,id=4bc79fe9-e1e7-4040-ae00-e231301a8c58,network=Network(027c842b-831c-4cd4-8a9f-cca60bb6b647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4bc79fe9-e1') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4bc79fe9-e1, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-bd94fa73-a5c4-49cf-b34b-6d90b3e9fd26 req-ba307be5-b989-45d4-ae1a-46bc2500e314 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-plugged-c6812409-296e-40f5-bdfc-b7cedf33f85b {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-bd94fa73-a5c4-49cf-b34b-6d90b3e9fd26 req-ba307be5-b989-45d4-ae1a-46bc2500e314 service nova] Acquiring lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-bd94fa73-a5c4-49cf-b34b-6d90b3e9fd26 req-ba307be5-b989-45d4-ae1a-46bc2500e314 service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-bd94fa73-a5c4-49cf-b34b-6d90b3e9fd26 req-ba307be5-b989-45d4-ae1a-46bc2500e314 service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-bd94fa73-a5c4-49cf-b34b-6d90b3e9fd26 req-ba307be5-b989-45d4-ae1a-46bc2500e314 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] No waiting events found dispatching network-vif-plugged-c6812409-296e-40f5-bdfc-b7cedf33f85b {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:51 user nova-compute[75745]: WARNING nova.compute.manager [req-bd94fa73-a5c4-49cf-b34b-6d90b3e9fd26 req-ba307be5-b989-45d4-ae1a-46bc2500e314 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received unexpected event network-vif-plugged-c6812409-296e-40f5-bdfc-b7cedf33f85b for instance with vm_state active and task_state deleting.
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-bd94fa73-a5c4-49cf-b34b-6d90b3e9fd26 req-ba307be5-b989-45d4-ae1a-46bc2500e314 service nova] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Received event network-vif-unplugged-6b6d1ec0-f24a-4552-8851-861f7494eb49 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-bd94fa73-a5c4-49cf-b34b-6d90b3e9fd26 req-ba307be5-b989-45d4-ae1a-46bc2500e314 service nova] Acquiring lock "9d4bc58d-90b6-4621-80a9-0b72194b10da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-bd94fa73-a5c4-49cf-b34b-6d90b3e9fd26 req-ba307be5-b989-45d4-ae1a-46bc2500e314 service nova] Lock "9d4bc58d-90b6-4621-80a9-0b72194b10da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-bd94fa73-a5c4-49cf-b34b-6d90b3e9fd26 req-ba307be5-b989-45d4-ae1a-46bc2500e314 service nova] Lock "9d4bc58d-90b6-4621-80a9-0b72194b10da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-bd94fa73-a5c4-49cf-b34b-6d90b3e9fd26 req-ba307be5-b989-45d4-ae1a-46bc2500e314 service nova] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] No waiting events found dispatching network-vif-unplugged-6b6d1ec0-f24a-4552-8851-861f7494eb49 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-bd94fa73-a5c4-49cf-b34b-6d90b3e9fd26 req-ba307be5-b989-45d4-ae1a-46bc2500e314 service nova] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Received event network-vif-unplugged-6b6d1ec0-f24a-4552-8851-861f7494eb49 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-bd94fa73-a5c4-49cf-b34b-6d90b3e9fd26 req-ba307be5-b989-45d4-ae1a-46bc2500e314 service nova] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Received event network-vif-plugged-6b6d1ec0-f24a-4552-8851-861f7494eb49 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-bd94fa73-a5c4-49cf-b34b-6d90b3e9fd26 req-ba307be5-b989-45d4-ae1a-46bc2500e314 service nova] Acquiring lock "9d4bc58d-90b6-4621-80a9-0b72194b10da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-bd94fa73-a5c4-49cf-b34b-6d90b3e9fd26 req-ba307be5-b989-45d4-ae1a-46bc2500e314 service nova] Lock "9d4bc58d-90b6-4621-80a9-0b72194b10da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-bd94fa73-a5c4-49cf-b34b-6d90b3e9fd26 req-ba307be5-b989-45d4-ae1a-46bc2500e314 service nova] Lock "9d4bc58d-90b6-4621-80a9-0b72194b10da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-bd94fa73-a5c4-49cf-b34b-6d90b3e9fd26 req-ba307be5-b989-45d4-ae1a-46bc2500e314 service nova] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] No waiting events found dispatching network-vif-plugged-6b6d1ec0-f24a-4552-8851-861f7494eb49 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:51 user nova-compute[75745]: WARNING nova.compute.manager [req-bd94fa73-a5c4-49cf-b34b-6d90b3e9fd26 req-ba307be5-b989-45d4-ae1a-46bc2500e314 service nova] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Received unexpected event network-vif-plugged-6b6d1ec0-f24a-4552-8851-861f7494eb49 for instance with vm_state active and task_state deleting.
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] COPY block job progress, current cursor: 146800640 final cursor: 1073741824 {{(pid=75745) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=28c2586f-087a-4be6-88dc-5cda86df6d39) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:51 user nova-compute[75745]: INFO os_vif [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:6d:f8,bridge_name='br-int',has_traffic_filtering=True,id=4bc79fe9-e1e7-4040-ae00-e231301a8c58,network=Network(027c842b-831c-4cd4-8a9f-cca60bb6b647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4bc79fe9-e1')
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-167593192',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-167593192',id=11,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2S2wrkFBC9gY+Oe2HeW09yg38m59m78rYiqY7RnrDbPltQD4fWEhA5ttMZ/yujzCosNKXVpUVdmyGZKVGT7vN2JsjNz8AoSe3JK/sCACYt+isKHoPZHOig/W1x5tQ1pA==',key_name='tempest-keypair-2095316425',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:07:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75997c4cca1f4ebc9037a6dfc36a92b4',ramdisk_id='',reservation_id='r-z06l84ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-310064596',owner_user_name='tempest-TaggedBootDevicesTest_v242-310064596-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:07:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c78ca75618254393ab729856fb8905b7',uuid=5c6c7551-7045-4129-9908-c0c6fbd93124,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d9f0b3d-a677-4db0-a8be-b19006908125", "address": "fa:16:3e:d2:26:2b", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d9f0b3d-a6", "ovs_interfaceid": "9d9f0b3d-a677-4db0-a8be-b19006908125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converting VIF {"id": "9d9f0b3d-a677-4db0-a8be-b19006908125", "address": "fa:16:3e:d2:26:2b", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d9f0b3d-a6", "ovs_interfaceid": "9d9f0b3d-a677-4db0-a8be-b19006908125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:26:2b,bridge_name='br-int',has_traffic_filtering=True,id=9d9f0b3d-a677-4db0-a8be-b19006908125,network=Network(027c842b-831c-4cd4-8a9f-cca60bb6b647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d9f0b3d-a6') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG os_vif [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:26:2b,bridge_name='br-int',has_traffic_filtering=True,id=9d9f0b3d-a677-4db0-a8be-b19006908125,network=Network(027c842b-831c-4cd4-8a9f-cca60bb6b647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d9f0b3d-a6') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d9f0b3d-a6, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-d6e25183-d928-4c38-af29-df135ae76a94 req-2f6d2da0-8942-4066-8cbd-fbb6907de0a9 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-plugged-4bc79fe9-e1e7-4040-ae00-e231301a8c58 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d6e25183-d928-4c38-af29-df135ae76a94 req-2f6d2da0-8942-4066-8cbd-fbb6907de0a9 service nova] Acquiring lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d6e25183-d928-4c38-af29-df135ae76a94 req-2f6d2da0-8942-4066-8cbd-fbb6907de0a9 service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d6e25183-d928-4c38-af29-df135ae76a94 req-2f6d2da0-8942-4066-8cbd-fbb6907de0a9 service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-d6e25183-d928-4c38-af29-df135ae76a94 req-2f6d2da0-8942-4066-8cbd-fbb6907de0a9 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] No waiting events found dispatching network-vif-plugged-4bc79fe9-e1e7-4040-ae00-e231301a8c58 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:51 user nova-compute[75745]: WARNING nova.compute.manager [req-d6e25183-d928-4c38-af29-df135ae76a94 req-2f6d2da0-8942-4066-8cbd-fbb6907de0a9 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received unexpected event network-vif-plugged-4bc79fe9-e1e7-4040-ae00-e231301a8c58 for instance with vm_state active and task_state deleting.
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-d6e25183-d928-4c38-af29-df135ae76a94 req-2f6d2da0-8942-4066-8cbd-fbb6907de0a9 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-unplugged-754453de-6c68-4cdd-acc4-2307e4b6d3d2 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d6e25183-d928-4c38-af29-df135ae76a94 req-2f6d2da0-8942-4066-8cbd-fbb6907de0a9 service nova] Acquiring lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d6e25183-d928-4c38-af29-df135ae76a94 req-2f6d2da0-8942-4066-8cbd-fbb6907de0a9 service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d6e25183-d928-4c38-af29-df135ae76a94 req-2f6d2da0-8942-4066-8cbd-fbb6907de0a9 service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-d6e25183-d928-4c38-af29-df135ae76a94 req-2f6d2da0-8942-4066-8cbd-fbb6907de0a9 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] No waiting events found dispatching network-vif-unplugged-754453de-6c68-4cdd-acc4-2307e4b6d3d2 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-d6e25183-d928-4c38-af29-df135ae76a94 req-2f6d2da0-8942-4066-8cbd-fbb6907de0a9 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-unplugged-754453de-6c68-4cdd-acc4-2307e4b6d3d2 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-d6e25183-d928-4c38-af29-df135ae76a94 req-2f6d2da0-8942-4066-8cbd-fbb6907de0a9 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-plugged-754453de-6c68-4cdd-acc4-2307e4b6d3d2 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d6e25183-d928-4c38-af29-df135ae76a94 req-2f6d2da0-8942-4066-8cbd-fbb6907de0a9 service nova] Acquiring lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d6e25183-d928-4c38-af29-df135ae76a94 req-2f6d2da0-8942-4066-8cbd-fbb6907de0a9 service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d6e25183-d928-4c38-af29-df135ae76a94 req-2f6d2da0-8942-4066-8cbd-fbb6907de0a9 service nova] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-d6e25183-d928-4c38-af29-df135ae76a94 req-2f6d2da0-8942-4066-8cbd-fbb6907de0a9 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] No waiting events found dispatching network-vif-plugged-754453de-6c68-4cdd-acc4-2307e4b6d3d2 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:51 user nova-compute[75745]: WARNING nova.compute.manager [req-d6e25183-d928-4c38-af29-df135ae76a94 req-2f6d2da0-8942-4066-8cbd-fbb6907de0a9 service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received unexpected event network-vif-plugged-754453de-6c68-4cdd-acc4-2307e4b6d3d2 for instance with vm_state active and task_state deleting.
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2ecd3204-b327-4a1a-9a9a-bc7be83c6f19) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:51 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Took 0.78 seconds to deallocate network for instance.
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.objects.instance [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Lazy-loading 'flavor' on Instance uuid c7fb74ee-dfa0-40e1-8773-99bd4a0402d5 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:51 user nova-compute[75745]: INFO os_vif [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:26:2b,bridge_name='br-int',has_traffic_filtering=True,id=9d9f0b3d-a677-4db0-a8be-b19006908125,network=Network(027c842b-831c-4cd4-8a9f-cca60bb6b647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d9f0b3d-a6')
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-167593192',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-167593192',id=11,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2S2wrkFBC9gY+Oe2HeW09yg38m59m78rYiqY7RnrDbPltQD4fWEhA5ttMZ/yujzCosNKXVpUVdmyGZKVGT7vN2JsjNz8AoSe3JK/sCACYt+isKHoPZHOig/W1x5tQ1pA==',key_name='tempest-keypair-2095316425',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:07:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75997c4cca1f4ebc9037a6dfc36a92b4',ramdisk_id='',reservation_id='r-z06l84ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-310064596',owner_user_name='tempest-TaggedBootDevicesTest_v242-310064596-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:07:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c78ca75618254393ab729856fb8905b7',uuid=5c6c7551-7045-4129-9908-c0c6fbd93124,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "754453de-6c68-4cdd-acc4-2307e4b6d3d2", "address": "fa:16:3e:e2:b2:aa", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap754453de-6c", "ovs_interfaceid": "754453de-6c68-4cdd-acc4-2307e4b6d3d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converting VIF {"id": "754453de-6c68-4cdd-acc4-2307e4b6d3d2", "address": "fa:16:3e:e2:b2:aa", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap754453de-6c", "ovs_interfaceid": "754453de-6c68-4cdd-acc4-2307e4b6d3d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:b2:aa,bridge_name='br-int',has_traffic_filtering=True,id=754453de-6c68-4cdd-acc4-2307e4b6d3d2,network=Network(027c842b-831c-4cd4-8a9f-cca60bb6b647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap754453de-6c') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG os_vif [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:b2:aa,bridge_name='br-int',has_traffic_filtering=True,id=754453de-6c68-4cdd-acc4-2307e4b6d3d2,network=Network(027c842b-831c-4cd4-8a9f-cca60bb6b647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap754453de-6c') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap754453de-6c, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1d203ae6-0382-4a7f-b8e7-6451b177dfb9 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Lock "c7fb74ee-dfa0-40e1-8773-99bd4a0402d5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.694s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7fb0c8ff-3840-4638-b514-f092cc45abf7) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-534c2da7-e8e5-4f8d-b44d-03bae18acb9a tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-534c2da7-e8e5-4f8d-b44d-03bae18acb9a tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:51 user nova-compute[75745]: INFO os_vif [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:b2:aa,bridge_name='br-int',has_traffic_filtering=True,id=754453de-6c68-4cdd-acc4-2307e4b6d3d2,network=Network(027c842b-831c-4cd4-8a9f-cca60bb6b647),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap754453de-6c')
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-167593192',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-167593192',id=11,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2S2wrkFBC9gY+Oe2HeW09yg38m59m78rYiqY7RnrDbPltQD4fWEhA5ttMZ/yujzCosNKXVpUVdmyGZKVGT7vN2JsjNz8AoSe3JK/sCACYt+isKHoPZHOig/W1x5tQ1pA==',key_name='tempest-keypair-2095316425',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:07:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75997c4cca1f4ebc9037a6dfc36a92b4',ramdisk_id='',reservation_id='r-z06l84ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-310064596',owner_user_name='tempest-TaggedBootDevicesTest_v242-310064596-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:07:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c78ca75618254393ab729856fb8905b7',uuid=5c6c7551-7045-4129-9908-c0c6fbd93124,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "847be9c3-c4d1-4280-8b85-56697d11a876", "address": "fa:16:3e:67:52:ab", "network": {"id": "2a7db2ed-f938-42c6-b85c-8a94ac2717a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-811431562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap847be9c3-c4", "ovs_interfaceid": "847be9c3-c4d1-4280-8b85-56697d11a876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converting VIF {"id": "847be9c3-c4d1-4280-8b85-56697d11a876", "address": "fa:16:3e:67:52:ab", "network": {"id": "2a7db2ed-f938-42c6-b85c-8a94ac2717a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-811431562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap847be9c3-c4", "ovs_interfaceid": "847be9c3-c4d1-4280-8b85-56697d11a876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:52:ab,bridge_name='br-int',has_traffic_filtering=True,id=847be9c3-c4d1-4280-8b85-56697d11a876,network=Network(2a7db2ed-f938-42c6-b85c-8a94ac2717a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap847be9c3-c4') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG os_vif [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:52:ab,bridge_name='br-int',has_traffic_filtering=True,id=847be9c3-c4d1-4280-8b85-56697d11a876,network=Network(2a7db2ed-f938-42c6-b85c-8a94ac2717a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap847be9c3-c4') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap847be9c3-c4, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3af1acbb-9c3d-456c-982c-77fda28058ca) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:51 user nova-compute[75745]: INFO os_vif [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:52:ab,bridge_name='br-int',has_traffic_filtering=True,id=847be9c3-c4d1-4280-8b85-56697d11a876,network=Network(2a7db2ed-f938-42c6-b85c-8a94ac2717a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap847be9c3-c4')
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-167593192',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-167593192',id=11,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2S2wrkFBC9gY+Oe2HeW09yg38m59m78rYiqY7RnrDbPltQD4fWEhA5ttMZ/yujzCosNKXVpUVdmyGZKVGT7vN2JsjNz8AoSe3JK/sCACYt+isKHoPZHOig/W1x5tQ1pA==',key_name='tempest-keypair-2095316425',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:07:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75997c4cca1f4ebc9037a6dfc36a92b4',ramdisk_id='',reservation_id='r-z06l84ik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-310064596',owner_user_name='tempest-TaggedBootDevicesTest_v242-310064596-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:07:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c78ca75618254393ab729856fb8905b7',uuid=5c6c7551-7045-4129-9908-c0c6fbd93124,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6812409-296e-40f5-bdfc-b7cedf33f85b", "address": "fa:16:3e:db:bf:df", "network": {"id": "2a7db2ed-f938-42c6-b85c-8a94ac2717a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-811431562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6812409-29", "ovs_interfaceid": "c6812409-296e-40f5-bdfc-b7cedf33f85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converting VIF {"id": "c6812409-296e-40f5-bdfc-b7cedf33f85b", "address": "fa:16:3e:db:bf:df", "network": {"id": "2a7db2ed-f938-42c6-b85c-8a94ac2717a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-811431562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6812409-29", "ovs_interfaceid": "c6812409-296e-40f5-bdfc-b7cedf33f85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:bf:df,bridge_name='br-int',has_traffic_filtering=True,id=c6812409-296e-40f5-bdfc-b7cedf33f85b,network=Network(2a7db2ed-f938-42c6-b85c-8a94ac2717a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6812409-29') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG os_vif [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:bf:df,bridge_name='br-int',has_traffic_filtering=True,id=c6812409-296e-40f5-bdfc-b7cedf33f85b,network=Network(2a7db2ed-f938-42c6-b85c-8a94ac2717a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6812409-29') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc6812409-29, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=544e9ba8-f7e4-408f-bfe6-3b67789370b3) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:51 user nova-compute[75745]: INFO os_vif [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:bf:df,bridge_name='br-int',has_traffic_filtering=True,id=c6812409-296e-40f5-bdfc-b7cedf33f85b,network=Network(2a7db2ed-f938-42c6-b85c-8a94ac2717a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6812409-29')
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tYLBabph', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:08:51 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:08:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e375a6d-479f-4c6e-ac93-f5c63f006b4a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:08:51 user nova-compute[75745]: No targets found.
Dec 01 17:08:51 user nova-compute[75745]: iSNS:
Dec 01 17:08:51 user nova-compute[75745]: No targets found.
Dec 01 17:08:51 user nova-compute[75745]: STATIC:
Dec 01 17:08:51 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c
Dec 01 17:08:51 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:51 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:51 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749
Dec 01 17:08:51 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:51 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:51 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111
Dec 01 17:08:51 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:51 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:51 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de
Dec 01 17:08:51 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:51 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:51 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121
Dec 01 17:08:51 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:51 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:51 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762
Dec 01 17:08:51 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:51 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:51 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04
Dec 01 17:08:51 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:51 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:51 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e
Dec 01 17:08:51 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:51 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:51 user nova-compute[75745]: FIRMWARE:
Dec 01 17:08:51 user nova-compute[75745]: No targets found.
Dec 01 17:08:51 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:08:51 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:08:51 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e12227a-2aeb-4cf5-bb59-4a3134383cdf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c8e44f-7cd0-4c6e-b82e-df1de7e028a8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:51 user nova-compute[75745]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)
Dec 01 17:08:51 user nova-compute[75745]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)
Dec 01 17:08:51 user nova-compute[75745]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)
Dec 01 17:08:51 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:51 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:51 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:51 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:51 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:51 user nova-compute[75745]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)
Dec 01 17:08:51 user nova-compute[75745]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)
Dec 01 17:08:51 user nova-compute[75745]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)
Dec 01 17:08:51 user nova-compute[75745]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de (non-flash)
Dec 01 17:08:51 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:51 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:51 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:51 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24d830de10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de'): ({'sdc'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Removing single pathed devices sdc {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] COPY block job progress, current cursor: 262144000 final cursor: 1073741824 {{(pid=75745) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2a731a-ca64-4816-a9c8-01abc4dfa321]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f299b74c-3190-4f9e-987b-21c1c9ad8fc6]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Flushing IO for device /dev/sdc {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8b64c4-7bd2-4294-8071-efcfec473696]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6777b98d-8fa2-477d-9aca-49beea133493]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] SCSI volumes sdc have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-534c2da7-e8e5-4f8d-b44d-03bae18acb9a tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-534c2da7-e8e5-4f8d-b44d-03bae18acb9a tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d662736f-ce9e-4202-a60d-1739a6c96c30]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-534c2da7-e8e5-4f8d-b44d-03bae18acb9a tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.540s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f6c2b3-2abf-4e0a-bac2-c476ceecdded]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de, portal: 172.16.0.220,3260]
Dec 01 17:08:52 user nova-compute[75745]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de, portal: 172.16.0.220,3260] successful.
Dec 01 17:08:52 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:52 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-534c2da7-e8e5-4f8d-b44d-03bae18acb9a tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Deleted allocations for instance 9d4bc58d-90b6-4621-80a9-0b72194b10da
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40deba30-bea8-4474-9760-b572f1f764de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb04049-11d9-43be-9f7a-14af40de2dbe]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.446s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] <== disconnect_volume: return (448ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jCHLSPqX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:08:52 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d5c6f2-636c-4617-8ce3-a069f75c04d8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:08:52 user nova-compute[75745]: No targets found.
Dec 01 17:08:52 user nova-compute[75745]: iSNS:
Dec 01 17:08:52 user nova-compute[75745]: No targets found.
Dec 01 17:08:52 user nova-compute[75745]: STATIC:
Dec 01 17:08:52 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c
Dec 01 17:08:52 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:52 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:52 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749
Dec 01 17:08:52 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:52 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:52 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111
Dec 01 17:08:52 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:52 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:52 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121
Dec 01 17:08:52 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:52 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:52 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762
Dec 01 17:08:52 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:52 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:52 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04
Dec 01 17:08:52 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:52 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:52 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e
Dec 01 17:08:52 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:52 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:52 user nova-compute[75745]: FIRMWARE:
Dec 01 17:08:52 user nova-compute[75745]: No targets found.
Dec 01 17:08:52 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:08:52 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:08:52 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c528c9d0-4bd7-4726-afe5-a82b210fe19c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aee2f2c-ca3a-4d87-b829-bdd510ba16e6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:52 user nova-compute[75745]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)
Dec 01 17:08:52 user nova-compute[75745]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)
Dec 01 17:08:52 user nova-compute[75745]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)
Dec 01 17:08:52 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:52 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:52 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:52 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:52 user nova-compute[75745]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)
Dec 01 17:08:52 user nova-compute[75745]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)
Dec 01 17:08:52 user nova-compute[75745]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)
Dec 01 17:08:52 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:52 user nova-compute[75745]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 (non-flash)
Dec 01 17:08:52 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:52 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24dbd6bbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762'): ({'sdg'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Removing single pathed devices sdg {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca4dffe-9de3-4c00-84ce-f542a07d5662]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-534c2da7-e8e5-4f8d-b44d-03bae18acb9a tempest-VolumesActionsTest-1268939950 tempest-VolumesActionsTest-1268939950-project-member] Lock "9d4bc58d-90b6-4621-80a9-0b72194b10da" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.387s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3008cd0a-23c6-4a1c-ae6a-2f482042de90]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Flushing IO for device /dev/sdg {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] COPY block job progress, current cursor: 375390208 final cursor: 1073741824 {{(pid=75745) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a3c5c4-f7c7-405a-8707-8203a6957ecc]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.048s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0042911-ca21-490e-9038-96e4ce3b1b92]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] SCSI volumes sdg have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00c09612-9b3d-4de7-891a-eac29eb805c0 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Acquiring lock "c7fb74ee-dfa0-40e1-8773-99bd4a0402d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00c09612-9b3d-4de7-891a-eac29eb805c0 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Lock "c7fb74ee-dfa0-40e1-8773-99bd4a0402d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00c09612-9b3d-4de7-891a-eac29eb805c0 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Acquiring lock "c7fb74ee-dfa0-40e1-8773-99bd4a0402d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00c09612-9b3d-4de7-891a-eac29eb805c0 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Lock "c7fb74ee-dfa0-40e1-8773-99bd4a0402d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00c09612-9b3d-4de7-891a-eac29eb805c0 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Lock "c7fb74ee-dfa0-40e1-8773-99bd4a0402d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG nova.objects.instance [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lazy-loading 'flavor' on Instance uuid 02715ae1-5200-4df5-8430-2f19a610d2bb {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:52 user nova-compute[75745]: INFO nova.compute.manager [None req-00c09612-9b3d-4de7-891a-eac29eb805c0 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Terminating instance
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e944d46-7bf6-4d52-8ab1-4d2251a87bb3]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00c09612-9b3d-4de7-891a-eac29eb805c0 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-05119526-efbf-4707-8f98-fcd625c7ed13 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lock "02715ae1-5200-4df5-8430-2f19a610d2bb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.135s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 -p 172.16.0.220:3260 --logout" returned: 0 in 0.124s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81ac3e1-52cc-4fab-8ed4-b23550ce0ee7]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762, portal: 172.16.0.220,3260]
Dec 01 17:08:52 user nova-compute[75745]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762, portal: 172.16.0.220,3260] successful.
Dec 01 17:08:52 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b42faef-d887-46fe-b858-224dcdfad762 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d002ca-1e2d-4ef0-996c-5899c8307d75]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.451s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] <== disconnect_volume: return (452ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JgsWeCyl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:08:52 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce17f00-17b6-4025-8beb-b07dace435df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:08:52 user nova-compute[75745]: No targets found.
Dec 01 17:08:52 user nova-compute[75745]: iSNS:
Dec 01 17:08:52 user nova-compute[75745]: No targets found.
Dec 01 17:08:52 user nova-compute[75745]: STATIC:
Dec 01 17:08:52 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c
Dec 01 17:08:52 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:52 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:52 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749
Dec 01 17:08:52 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:52 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:52 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111
Dec 01 17:08:52 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:52 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:52 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121
Dec 01 17:08:52 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:52 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:52 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04
Dec 01 17:08:52 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:52 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:52 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e
Dec 01 17:08:52 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:52 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:52 user nova-compute[75745]: FIRMWARE:
Dec 01 17:08:52 user nova-compute[75745]: No targets found.
Dec 01 17:08:52 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:08:52 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:08:52 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c54d1a0-d315-4232-b783-5d97963fa504]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd6327a-f15d-483c-aa88-e7f686967154]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:52 user nova-compute[75745]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)
Dec 01 17:08:52 user nova-compute[75745]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)
Dec 01 17:08:52 user nova-compute[75745]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)
Dec 01 17:08:52 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:52 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:52 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:52 user nova-compute[75745]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)
Dec 01 17:08:52 user nova-compute[75745]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)
Dec 01 17:08:52 user nova-compute[75745]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)
Dec 01 17:08:52 user nova-compute[75745]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 (non-flash)
Dec 01 17:08:52 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:52 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24dbd6bbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749'): ({'sde'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Removing single pathed devices sde {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7edb9f-abe5-4642-9a6e-2044554d369b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] COPY block job progress, current cursor: 543162368 final cursor: 1073741824 {{(pid=75745) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f9e56b-b65b-483d-8b69-5dc04b1916ff]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Flushing IO for device /dev/sde {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG nova.compute.manager [req-f5c2cb80-9421-4c3c-ad6f-9305c8ea44c9 req-9043395f-7c10-4ad6-8c7e-d5b240efc0e6 service nova] [instance: 9d4bc58d-90b6-4621-80a9-0b72194b10da] Received event network-vif-deleted-6b6d1ec0-f24a-4552-8851-861f7494eb49 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[727ca6cc-3ffa-46fb-bfa0-b9ffde1726c7]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd5ddeb-2282-40af-a4ec-d1572032259d]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] SCSI volumes sde have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee19d992-8489-42bd-bd5f-2cf0a788d867]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d21112d-7731-490a-9b8a-f7c46033abf6]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749, portal: 172.16.0.220,3260]
Dec 01 17:08:53 user nova-compute[75745]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749, portal: 172.16.0.220,3260] successful.
Dec 01 17:08:53 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beb5e348-2521-40cf-99fe-4bf8f351e749 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.060s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7c5cae-2310-4baf-a4ab-012b2f1a80d1]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.461s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] <== disconnect_volume: return (464ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:08:53 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Deleting instance files /opt/stack/data/nova/instances/5c6c7551-7045-4129-9908-c0c6fbd93124_del
Dec 01 17:08:53 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Deletion of /opt/stack/data/nova/instances/5c6c7551-7045-4129-9908-c0c6fbd93124_del complete
Dec 01 17:08:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] COPY block job progress, current cursor: 696254464 final cursor: 1073741824 {{(pid=75745) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 17:08:53 user nova-compute[75745]: INFO nova.compute.manager [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Took 5.21 seconds to destroy the instance on the hypervisor.
Dec 01 17:08:53 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:08:53 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Instance destroyed successfully.
Dec 01 17:08:53 user nova-compute[75745]: DEBUG nova.objects.instance [None req-00c09612-9b3d-4de7-891a-eac29eb805c0 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Lazy-loading 'resources' on Instance uuid c7fb74ee-dfa0-40e1-8773-99bd4a0402d5 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-00c09612-9b3d-4de7-891a-eac29eb805c0 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2093162159',display_name='tempest-AttachSCSIVolumeTestJSON-server-2093162159',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2093162159',id=5,image_ref='875fd380-18d6-4a66-ac7b-9e2356a51945',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcNvJdXBy3wIJ5dV4f6g7puHwPxGXVj+1ua5O0MU/W2pSVV7MIKhdoMPngO6hx9lEABMKU3cuCp6ZPNJ1/w1JWFcnFZ8bXcUMadeA6wIqUXWc/XUcIsuwb/cJW0CHx18Q==',key_name='tempest-keypair-910136177',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:06:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dca0e64357e24c7098548625d1e269f1',ramdisk_id='',reservation_id='r-va47zz0e',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='875fd380-18d6-4a66-ac7b-9e2356a51945',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-17080036',owner_user_name='tempest-AttachSCSIVolumeTestJSON-17080036-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:06:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09bac2cfb1e04bc996cbf64610b63c57',uuid=c7fb74ee-dfa0-40e1-8773-99bd4a0402d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f", "address": "fa:16:3e:1d:54:77", "network": {"id": "1d5056ab-3b1d-40a2-b83f-5012d1e8c71f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1526171674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca0e64357e24c7098548625d1e269f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f98a2c5-bb", "ovs_interfaceid": "0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-00c09612-9b3d-4de7-891a-eac29eb805c0 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Converting VIF {"id": "0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f", "address": "fa:16:3e:1d:54:77", "network": {"id": "1d5056ab-3b1d-40a2-b83f-5012d1e8c71f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1526171674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca0e64357e24c7098548625d1e269f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f98a2c5-bb", "ovs_interfaceid": "0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-00c09612-9b3d-4de7-891a-eac29eb805c0 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:54:77,bridge_name='br-int',has_traffic_filtering=True,id=0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f,network=Network(1d5056ab-3b1d-40a2-b83f-5012d1e8c71f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f98a2c5-bb') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG os_vif [None req-00c09612-9b3d-4de7-891a-eac29eb805c0 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:54:77,bridge_name='br-int',has_traffic_filtering=True,id=0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f,network=Network(1d5056ab-3b1d-40a2-b83f-5012d1e8c71f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f98a2c5-bb') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f98a2c5-bb, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=19261309-cdc9-478a-9bbc-7235491a124f) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-402a7045-4962-490e-b90b-21fd9cd5f68c tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Acquiring lock "interface-02715ae1-5200-4df5-8430-2f19a610d2bb-8b8877f6-9183-46cb-964f-089f6b197d1e" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-402a7045-4962-490e-b90b-21fd9cd5f68c tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lock "interface-02715ae1-5200-4df5-8430-2f19a610d2bb-8b8877f6-9183-46cb-964f-089f6b197d1e" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:53 user nova-compute[75745]: INFO os_vif [None req-00c09612-9b3d-4de7-891a-eac29eb805c0 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:54:77,bridge_name='br-int',has_traffic_filtering=True,id=0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f,network=Network(1d5056ab-3b1d-40a2-b83f-5012d1e8c71f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f98a2c5-bb')
Dec 01 17:08:53 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-00c09612-9b3d-4de7-891a-eac29eb805c0 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Deleting instance files /opt/stack/data/nova/instances/c7fb74ee-dfa0-40e1-8773-99bd4a0402d5_del
Dec 01 17:08:53 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-00c09612-9b3d-4de7-891a-eac29eb805c0 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Deletion of /opt/stack/data/nova/instances/c7fb74ee-dfa0-40e1-8773-99bd4a0402d5_del complete
Dec 01 17:08:53 user nova-compute[75745]: DEBUG nova.objects.instance [None req-402a7045-4962-490e-b90b-21fd9cd5f68c tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lazy-loading 'flavor' on Instance uuid 02715ae1-5200-4df5-8430-2f19a610d2bb {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-402a7045-4962-490e-b90b-21fd9cd5f68c tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-307822093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-307822093',id=7,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcs8sgcxWpvAhCDukezlQYcNLHeLOr5mWfJj0puItGCkRZJXOGQ6MpM5uepe4ipPhQinPlSmQOH6fLeiZ2h4cJWUaoqQV3toeXUomzqHJu8XbHvxkd2bF7E/efoK+eL7A==',key_name='tempest-keypair-903294596',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:06:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5275e723c904fa183974b49d4530824',ramdisk_id='',reservation_id='r-1wsmmw87',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-161209440',owner_user_name='tempest-TaggedAttachmentsTest-161209440-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:06:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77cc6ad71fa84904acd8d24eec648c94',uuid=02715ae1-5200-4df5-8430-2f19a610d2bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b8877f6-9183-46cb-964f-089f6b197d1e", "address": "fa:16:3e:d5:67:2f", "network": {"id": "26980f90-5a9d-43ef-b565-452f33c31c2d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2066230581", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d5275e723c904fa183974b49d4530824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8877f6-91", "ovs_interfaceid": "8b8877f6-9183-46cb-964f-089f6b197d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-402a7045-4962-490e-b90b-21fd9cd5f68c tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Converting VIF {"id": "8b8877f6-9183-46cb-964f-089f6b197d1e", "address": "fa:16:3e:d5:67:2f", "network": {"id": "26980f90-5a9d-43ef-b565-452f33c31c2d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2066230581", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d5275e723c904fa183974b49d4530824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8877f6-91", "ovs_interfaceid": "8b8877f6-9183-46cb-964f-089f6b197d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-402a7045-4962-490e-b90b-21fd9cd5f68c tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:67:2f,bridge_name='br-int',has_traffic_filtering=True,id=8b8877f6-9183-46cb-964f-089f6b197d1e,network=Network(26980f90-5a9d-43ef-b565-452f33c31c2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8877f6-91') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-402a7045-4962-490e-b90b-21fd9cd5f68c tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d5:67:2f"/><model type="virtio"/><mtu size="1442"/><target dev="tap8b8877f6-91"/></interface> {{(pid=75745) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-402a7045-4962-490e-b90b-21fd9cd5f68c tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d5:67:2f"/><model type="virtio"/><mtu size="1442"/><target dev="tap8b8877f6-91"/></interface> {{(pid=75745) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-402a7045-4962-490e-b90b-21fd9cd5f68c tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Attempting to detach device tap8b8877f6-91 from instance 02715ae1-5200-4df5-8430-2f19a610d2bb from the persistent domain config. {{(pid=75745) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-402a7045-4962-490e-b90b-21fd9cd5f68c tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] detach device xml: <interface type="ethernet">
Dec 01 17:08:53 user nova-compute[75745]:   <mac address="fa:16:3e:d5:67:2f"/>
Dec 01 17:08:53 user nova-compute[75745]:   <model type="virtio"/>
Dec 01 17:08:53 user nova-compute[75745]:   <mtu size="1442"/>
Dec 01 17:08:53 user nova-compute[75745]:   <target dev="tap8b8877f6-91"/>
Dec 01 17:08:53 user nova-compute[75745]: </interface>
Dec 01 17:08:53 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-402a7045-4962-490e-b90b-21fd9cd5f68c tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d5:67:2f"/><model type="virtio"/><mtu size="1442"/><target dev="tap8b8877f6-91"/></interface> {{(pid=75745) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-402a7045-4962-490e-b90b-21fd9cd5f68c tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d5:67:2f"/><model type="virtio"/><mtu size="1442"/><target dev="tap8b8877f6-91"/></interface>not found in domain: <domain type='kvm' id='7'>
Dec 01 17:08:53 user nova-compute[75745]:   <name>instance-00000007</name>
Dec 01 17:08:53 user nova-compute[75745]:   <uuid>02715ae1-5200-4df5-8430-2f19a610d2bb</uuid>
Dec 01 17:08:53 user nova-compute[75745]:   <metadata>
Dec 01 17:08:53 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:08:53 user nova-compute[75745]:   <nova:package version="0.0.0"/>
Dec 01 17:08:53 user nova-compute[75745]:   <nova:name>tempest-device-tagging-server-307822093</nova:name>
Dec 01 17:08:53 user nova-compute[75745]:   <nova:creationTime>2023-12-01 17:08:08</nova:creationTime>
Dec 01 17:08:53 user nova-compute[75745]:   <nova:flavor name="m1.tiny">
Dec 01 17:08:53 user nova-compute[75745]:     <nova:memory>512</nova:memory>
Dec 01 17:08:53 user nova-compute[75745]:     <nova:disk>1</nova:disk>
Dec 01 17:08:53 user nova-compute[75745]:     <nova:swap>0</nova:swap>
Dec 01 17:08:53 user nova-compute[75745]:     <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:08:53 user nova-compute[75745]:     <nova:vcpus>1</nova:vcpus>
Dec 01 17:08:53 user nova-compute[75745]:   </nova:flavor>
Dec 01 17:08:53 user nova-compute[75745]:   <nova:owner>
Dec 01 17:08:53 user nova-compute[75745]:     <nova:user uuid="77cc6ad71fa84904acd8d24eec648c94">tempest-TaggedAttachmentsTest-161209440-project-member</nova:user>
Dec 01 17:08:53 user nova-compute[75745]:     <nova:project uuid="d5275e723c904fa183974b49d4530824">tempest-TaggedAttachmentsTest-161209440</nova:project>
Dec 01 17:08:53 user nova-compute[75745]:   </nova:owner>
Dec 01 17:08:53 user nova-compute[75745]:   <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:08:53 user nova-compute[75745]:   <nova:ports>
Dec 01 17:08:53 user nova-compute[75745]:     <nova:port uuid="f2e5d5e1-b6be-444f-b8b6-c8f26cef560b">
Dec 01 17:08:53 user nova-compute[75745]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 01 17:08:53 user nova-compute[75745]:     </nova:port>
Dec 01 17:08:53 user nova-compute[75745]:     <nova:port uuid="8b8877f6-9183-46cb-964f-089f6b197d1e">
Dec 01 17:08:53 user nova-compute[75745]:       <nova:ip type="fixed" address="10.10.10.23" ipVersion="4"/>
Dec 01 17:08:53 user nova-compute[75745]:     </nova:port>
Dec 01 17:08:53 user nova-compute[75745]:   </nova:ports>
Dec 01 17:08:53 user nova-compute[75745]: </nova:instance>
Dec 01 17:08:53 user nova-compute[75745]:   </metadata>
Dec 01 17:08:53 user nova-compute[75745]:   <memory unit='KiB'>524288</memory>
Dec 01 17:08:53 user nova-compute[75745]:   <currentMemory unit='KiB'>524288</currentMemory>
Dec 01 17:08:53 user nova-compute[75745]:   <vcpu placement='static'>1</vcpu>
Dec 01 17:08:53 user nova-compute[75745]:   <resource>
Dec 01 17:08:53 user nova-compute[75745]:     <partition>/machine</partition>
Dec 01 17:08:53 user nova-compute[75745]:   </resource>
Dec 01 17:08:53 user nova-compute[75745]:   <sysinfo type='smbios'>
Dec 01 17:08:53 user nova-compute[75745]:     <system>
Dec 01 17:08:53 user nova-compute[75745]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Dec 01 17:08:53 user nova-compute[75745]:       <entry name='product'>OpenStack Nova</entry>
Dec 01 17:08:53 user nova-compute[75745]:       <entry name='version'>0.0.0</entry>
Dec 01 17:08:53 user nova-compute[75745]:       <entry name='serial'>02715ae1-5200-4df5-8430-2f19a610d2bb</entry>
Dec 01 17:08:53 user nova-compute[75745]:       <entry name='uuid'>02715ae1-5200-4df5-8430-2f19a610d2bb</entry>
Dec 01 17:08:53 user nova-compute[75745]:       <entry name='family'>Virtual Machine</entry>
Dec 01 17:08:53 user nova-compute[75745]:     </system>
Dec 01 17:08:53 user nova-compute[75745]:   </sysinfo>
Dec 01 17:08:53 user nova-compute[75745]:   <os>
Dec 01 17:08:53 user nova-compute[75745]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Dec 01 17:08:53 user nova-compute[75745]:     <boot dev='hd'/>
Dec 01 17:08:53 user nova-compute[75745]:     <smbios mode='sysinfo'/>
Dec 01 17:08:53 user nova-compute[75745]:   </os>
Dec 01 17:08:53 user nova-compute[75745]:   <features>
Dec 01 17:08:53 user nova-compute[75745]:     <acpi/>
Dec 01 17:08:53 user nova-compute[75745]:     <apic/>
Dec 01 17:08:53 user nova-compute[75745]:     <vmcoreinfo state='on'/>
Dec 01 17:08:53 user nova-compute[75745]:   </features>
Dec 01 17:08:53 user nova-compute[75745]:   <cpu mode='custom' match='exact' check='full'>
Dec 01 17:08:53 user nova-compute[75745]:     <model fallback='forbid'>Nehalem</model>
Dec 01 17:08:53 user nova-compute[75745]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Dec 01 17:08:53 user nova-compute[75745]:     <feature policy='require' name='vme'/>
Dec 01 17:08:53 user nova-compute[75745]:     <feature policy='require' name='x2apic'/>
Dec 01 17:08:53 user nova-compute[75745]:     <feature policy='require' name='hypervisor'/>
Dec 01 17:08:53 user nova-compute[75745]:   </cpu>
Dec 01 17:08:53 user nova-compute[75745]:   <clock offset='utc'>
Dec 01 17:08:53 user nova-compute[75745]:     <timer name='pit' tickpolicy='delay'/>
Dec 01 17:08:53 user nova-compute[75745]:     <timer name='rtc' tickpolicy='catchup'/>
Dec 01 17:08:53 user nova-compute[75745]:     <timer name='hpet' present='no'/>
Dec 01 17:08:53 user nova-compute[75745]:   </clock>
Dec 01 17:08:53 user nova-compute[75745]:   <on_poweroff>destroy</on_poweroff>
Dec 01 17:08:53 user nova-compute[75745]:   <on_reboot>restart</on_reboot>
Dec 01 17:08:53 user nova-compute[75745]:   <on_crash>destroy</on_crash>
Dec 01 17:08:53 user nova-compute[75745]:   <devices>
Dec 01 17:08:53 user nova-compute[75745]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 01 17:08:53 user nova-compute[75745]:     <disk type='file' device='disk'>
Dec 01 17:08:53 user nova-compute[75745]:       <driver name='qemu' type='qcow2' cache='none'/>
Dec 01 17:08:53 user nova-compute[75745]:       <source file='/opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk' index='2'/>
Dec 01 17:08:53 user nova-compute[75745]:       <backingStore type='file' index='3'>
Dec 01 17:08:53 user nova-compute[75745]:         <format type='raw'/>
Dec 01 17:08:53 user nova-compute[75745]:         <source file='/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf'/>
Dec 01 17:08:53 user nova-compute[75745]:         <backingStore/>
Dec 01 17:08:53 user nova-compute[75745]:       </backingStore>
Dec 01 17:08:53 user nova-compute[75745]:       <target dev='vda' bus='virtio'/>
Dec 01 17:08:53 user nova-compute[75745]:       <alias name='virtio-disk0'/>
Dec 01 17:08:53 user nova-compute[75745]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Dec 01 17:08:53 user nova-compute[75745]:     </disk>
Dec 01 17:08:53 user nova-compute[75745]:     <disk type='file' device='cdrom'>
Dec 01 17:08:53 user nova-compute[75745]:       <driver name='qemu' type='raw' cache='none'/>
Dec 01 17:08:53 user nova-compute[75745]:       <source file='/opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk.config' index='1'/>
Dec 01 17:08:53 user nova-compute[75745]:       <backingStore/>
Dec 01 17:08:53 user nova-compute[75745]:       <target dev='hda' bus='ide'/>
Dec 01 17:08:53 user nova-compute[75745]:       <readonly/>
Dec 01 17:08:53 user nova-compute[75745]:       <alias name='ide0-0-0'/>
Dec 01 17:08:53 user nova-compute[75745]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Dec 01 17:08:53 user nova-compute[75745]:     </disk>
Dec 01 17:08:53 user nova-compute[75745]:     <controller type='usb' index='0' model='none'>
Dec 01 17:08:53 user nova-compute[75745]:       <alias name='usb'/>
Dec 01 17:08:53 user nova-compute[75745]:     </controller>
Dec 01 17:08:53 user nova-compute[75745]:     <controller type='pci' index='0' model='pci-root'>
Dec 01 17:08:53 user nova-compute[75745]:       <alias name='pci.0'/>
Dec 01 17:08:53 user nova-compute[75745]:     </controller>
Dec 01 17:08:53 user nova-compute[75745]:     <controller type='ide' index='0'>
Dec 01 17:08:53 user nova-compute[75745]:       <alias name='ide'/>
Dec 01 17:08:53 user nova-compute[75745]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Dec 01 17:08:53 user nova-compute[75745]:     </controller>
Dec 01 17:08:53 user nova-compute[75745]:     <interface type='ethernet'>
Dec 01 17:08:53 user nova-compute[75745]:       <mac address='fa:16:3e:ff:a2:43'/>
Dec 01 17:08:53 user nova-compute[75745]:       <target dev='tapf2e5d5e1-b6'/>
Dec 01 17:08:53 user nova-compute[75745]:       <model type='virtio'/>
Dec 01 17:08:53 user nova-compute[75745]:       <mtu size='1442'/>
Dec 01 17:08:53 user nova-compute[75745]:       <alias name='net0'/>
Dec 01 17:08:53 user nova-compute[75745]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Dec 01 17:08:53 user nova-compute[75745]:     </interface>
Dec 01 17:08:53 user nova-compute[75745]:     <interface type='ethernet'>
Dec 01 17:08:53 user nova-compute[75745]:       <mac address='fa:16:3e:d5:67:2f'/>
Dec 01 17:08:53 user nova-compute[75745]:       <target dev='tap8b8877f6-91'/>
Dec 01 17:08:53 user nova-compute[75745]:       <model type='virtio'/>
Dec 01 17:08:53 user nova-compute[75745]:       <mtu size='1442'/>
Dec 01 17:08:53 user nova-compute[75745]:       <alias name='net1'/>
Dec 01 17:08:53 user nova-compute[75745]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Dec 01 17:08:53 user nova-compute[75745]:     </interface>
Dec 01 17:08:53 user nova-compute[75745]:     <serial type='pty'>
Dec 01 17:08:53 user nova-compute[75745]:       <source path='/dev/pts/6'/>
Dec 01 17:08:53 user nova-compute[75745]:       <log file='/opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/console.log' append='off'/>
Dec 01 17:08:53 user nova-compute[75745]:       <target type='isa-serial' port='0'>
Dec 01 17:08:53 user nova-compute[75745]:         <model name='isa-serial'/>
Dec 01 17:08:53 user nova-compute[75745]:       </target>
Dec 01 17:08:53 user nova-compute[75745]:       <alias name='serial0'/>
Dec 01 17:08:53 user nova-compute[75745]:     </serial>
Dec 01 17:08:53 user nova-compute[75745]:     <console type='pty' tty='/dev/pts/6'>
Dec 01 17:08:53 user nova-compute[75745]:       <source path='/dev/pts/6'/>
Dec 01 17:08:53 user nova-compute[75745]:       <log file='/opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/console.log' append='off'/>
Dec 01 17:08:53 user nova-compute[75745]:       <target type='serial' port='0'/>
Dec 01 17:08:53 user nova-compute[75745]:       <alias name='serial0'/>
Dec 01 17:08:53 user nova-compute[75745]:     </console>
Dec 01 17:08:53 user nova-compute[75745]:     <input type='mouse' bus='ps2'>
Dec 01 17:08:53 user nova-compute[75745]:       <alias name='input0'/>
Dec 01 17:08:53 user nova-compute[75745]:     </input>
Dec 01 17:08:53 user nova-compute[75745]:     <input type='keyboard' bus='ps2'>
Dec 01 17:08:53 user nova-compute[75745]:       <alias name='input1'/>
Dec 01 17:08:53 user nova-compute[75745]:     </input>
Dec 01 17:08:53 user nova-compute[75745]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Dec 01 17:08:53 user nova-compute[75745]:       <listen type='address' address='0.0.0.0'/>
Dec 01 17:08:53 user nova-compute[75745]:     </graphics>
Dec 01 17:08:53 user nova-compute[75745]:     <audio id='1' type='none'/>
Dec 01 17:08:53 user nova-compute[75745]:     <video>
Dec 01 17:08:53 user nova-compute[75745]:       <model type='virtio' heads='1' primary='yes'/>
Dec 01 17:08:53 user nova-compute[75745]:       <alias name='video0'/>
Dec 01 17:08:53 user nova-compute[75745]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Dec 01 17:08:53 user nova-compute[75745]:     </video>
Dec 01 17:08:53 user nova-compute[75745]:     <memballoon model='virtio'>
Dec 01 17:08:53 user nova-compute[75745]:       <stats period='10'/>
Dec 01 17:08:53 user nova-compute[75745]:       <alias name='balloon0'/>
Dec 01 17:08:53 user nova-compute[75745]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Dec 01 17:08:53 user nova-compute[75745]:     </memballoon>
Dec 01 17:08:53 user nova-compute[75745]:     <rng model='virtio'>
Dec 01 17:08:53 user nova-compute[75745]:       <backend model='random'>/dev/urandom</backend>
Dec 01 17:08:53 user nova-compute[75745]:       <alias name='rng0'/>
Dec 01 17:08:53 user nova-compute[75745]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Dec 01 17:08:53 user nova-compute[75745]:     </rng>
Dec 01 17:08:53 user nova-compute[75745]:   </devices>
Dec 01 17:08:53 user nova-compute[75745]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Dec 01 17:08:53 user nova-compute[75745]:     <label>libvirt-02715ae1-5200-4df5-8430-2f19a610d2bb</label>
Dec 01 17:08:53 user nova-compute[75745]:     <imagelabel>libvirt-02715ae1-5200-4df5-8430-2f19a610d2bb</imagelabel>
Dec 01 17:08:53 user nova-compute[75745]:   </seclabel>
Dec 01 17:08:53 user nova-compute[75745]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Dec 01 17:08:53 user nova-compute[75745]:     <label>+64055:+108</label>
Dec 01 17:08:53 user nova-compute[75745]:     <imagelabel>+64055:+108</imagelabel>
Dec 01 17:08:53 user nova-compute[75745]:   </seclabel>
Dec 01 17:08:53 user nova-compute[75745]: </domain>
Dec 01 17:08:53 user nova-compute[75745]:  {{(pid=75745) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Dec 01 17:08:53 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-402a7045-4962-490e-b90b-21fd9cd5f68c tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Successfully detached device tap8b8877f6-91 from instance 02715ae1-5200-4df5-8430-2f19a610d2bb from the persistent domain config.
Dec 01 17:08:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-402a7045-4962-490e-b90b-21fd9cd5f68c tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] (1/8): Attempting to detach device tap8b8877f6-91 with device alias net1 from instance 02715ae1-5200-4df5-8430-2f19a610d2bb from the live domain config. {{(pid=75745) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-402a7045-4962-490e-b90b-21fd9cd5f68c tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] detach device xml: <interface type="ethernet">
Dec 01 17:08:53 user nova-compute[75745]:   <mac address="fa:16:3e:d5:67:2f"/>
Dec 01 17:08:53 user nova-compute[75745]:   <model type="virtio"/>
Dec 01 17:08:53 user nova-compute[75745]:   <mtu size="1442"/>
Dec 01 17:08:53 user nova-compute[75745]:   <target dev="tap8b8877f6-91"/>
Dec 01 17:08:53 user nova-compute[75745]: </interface>
Dec 01 17:08:53 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:08:53 user nova-compute[75745]: INFO nova.compute.manager [None req-00c09612-9b3d-4de7-891a-eac29eb805c0 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Took 1.18 seconds to destroy the instance on the hypervisor.
Dec 01 17:08:53 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-00c09612-9b3d-4de7-891a-eac29eb805c0 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:08:53 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:08:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] COPY block job progress, current cursor: 853540864 final cursor: 1073741824 {{(pid=75745) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 17:08:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-402a7045-4962-490e-b90b-21fd9cd5f68c tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Start waiting for the detach event from libvirt for device tap8b8877f6-91 with device alias net1 for instance 02715ae1-5200-4df5-8430-2f19a610d2bb {{(pid=75745) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 17:08:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] COPY block job progress, current cursor: 970981376 final cursor: 1073741824 {{(pid=75745) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 17:08:54 user nova-compute[75745]: DEBUG nova.compute.manager [req-3305b7db-2cd7-4a37-8fc3-c8b196e068fd req-3e469aa5-998d-41ac-b15a-a77ec2ac93c8 service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Received event network-vif-unplugged-8b8877f6-9183-46cb-964f-089f6b197d1e {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3305b7db-2cd7-4a37-8fc3-c8b196e068fd req-3e469aa5-998d-41ac-b15a-a77ec2ac93c8 service nova] Acquiring lock "02715ae1-5200-4df5-8430-2f19a610d2bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3305b7db-2cd7-4a37-8fc3-c8b196e068fd req-3e469aa5-998d-41ac-b15a-a77ec2ac93c8 service nova] Lock "02715ae1-5200-4df5-8430-2f19a610d2bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3305b7db-2cd7-4a37-8fc3-c8b196e068fd req-3e469aa5-998d-41ac-b15a-a77ec2ac93c8 service nova] Lock "02715ae1-5200-4df5-8430-2f19a610d2bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:54 user nova-compute[75745]: DEBUG nova.compute.manager [req-3305b7db-2cd7-4a37-8fc3-c8b196e068fd req-3e469aa5-998d-41ac-b15a-a77ec2ac93c8 service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] No waiting events found dispatching network-vif-unplugged-8b8877f6-9183-46cb-964f-089f6b197d1e {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:54 user nova-compute[75745]: WARNING nova.compute.manager [req-3305b7db-2cd7-4a37-8fc3-c8b196e068fd req-3e469aa5-998d-41ac-b15a-a77ec2ac93c8 service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Received unexpected event network-vif-unplugged-8b8877f6-9183-46cb-964f-089f6b197d1e for instance with vm_state active and task_state None.
Dec 01 17:08:54 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:08:54 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Took 1.19 seconds to deallocate network for instance.
Dec 01 17:08:54 user nova-compute[75745]: DEBUG nova.compute.manager [req-512dcc0e-5857-433c-b1c7-442cdcdd9526 req-8c4ebc21-0686-4e85-a41e-d4c7ec23a1e2 service nova] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Received event network-vif-deleted-0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00c09612-9b3d-4de7-891a-eac29eb805c0 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00c09612-9b3d-4de7-891a-eac29eb805c0 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75745) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG nova.compute.manager [req-1da02e14-48f9-499c-bded-aa90312d566e req-70e381bf-08d1-4b88-aa2e-955c5078d70f service nova] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Received event network-vif-unplugged-0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1da02e14-48f9-499c-bded-aa90312d566e req-70e381bf-08d1-4b88-aa2e-955c5078d70f service nova] Acquiring lock "c7fb74ee-dfa0-40e1-8773-99bd4a0402d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1da02e14-48f9-499c-bded-aa90312d566e req-70e381bf-08d1-4b88-aa2e-955c5078d70f service nova] Lock "c7fb74ee-dfa0-40e1-8773-99bd4a0402d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1da02e14-48f9-499c-bded-aa90312d566e req-70e381bf-08d1-4b88-aa2e-955c5078d70f service nova] Lock "c7fb74ee-dfa0-40e1-8773-99bd4a0402d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG nova.compute.manager [req-1da02e14-48f9-499c-bded-aa90312d566e req-70e381bf-08d1-4b88-aa2e-955c5078d70f service nova] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] No waiting events found dispatching network-vif-unplugged-0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:55 user nova-compute[75745]: WARNING nova.compute.manager [req-1da02e14-48f9-499c-bded-aa90312d566e req-70e381bf-08d1-4b88-aa2e-955c5078d70f service nova] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Received unexpected event network-vif-unplugged-0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f for instance with vm_state deleted and task_state None.
Dec 01 17:08:55 user nova-compute[75745]: DEBUG nova.compute.manager [req-1da02e14-48f9-499c-bded-aa90312d566e req-70e381bf-08d1-4b88-aa2e-955c5078d70f service nova] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Received event network-vif-plugged-0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1da02e14-48f9-499c-bded-aa90312d566e req-70e381bf-08d1-4b88-aa2e-955c5078d70f service nova] Acquiring lock "c7fb74ee-dfa0-40e1-8773-99bd4a0402d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1da02e14-48f9-499c-bded-aa90312d566e req-70e381bf-08d1-4b88-aa2e-955c5078d70f service nova] Lock "c7fb74ee-dfa0-40e1-8773-99bd4a0402d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1da02e14-48f9-499c-bded-aa90312d566e req-70e381bf-08d1-4b88-aa2e-955c5078d70f service nova] Lock "c7fb74ee-dfa0-40e1-8773-99bd4a0402d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG nova.compute.manager [req-1da02e14-48f9-499c-bded-aa90312d566e req-70e381bf-08d1-4b88-aa2e-955c5078d70f service nova] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] No waiting events found dispatching network-vif-plugged-0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:55 user nova-compute[75745]: WARNING nova.compute.manager [req-1da02e14-48f9-499c-bded-aa90312d566e req-70e381bf-08d1-4b88-aa2e-955c5078d70f service nova] [instance: c7fb74ee-dfa0-40e1-8773-99bd4a0402d5] Received unexpected event network-vif-plugged-0f98a2c5-bbe2-4217-82a6-57b5e8cffb6f for instance with vm_state deleted and task_state None.
Dec 01 17:08:55 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SWPtsvUY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdm', 'volume_id': '67e7fd43-4d07-4a4c-8027-2861e79e6e04'}, None), 'kwargs': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:08:55 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:08:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[beec5749-9bb3-41e7-bc3a-f8d0da5e6646]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:08:55 user nova-compute[75745]: No targets found.
Dec 01 17:08:55 user nova-compute[75745]: iSNS:
Dec 01 17:08:55 user nova-compute[75745]: No targets found.
Dec 01 17:08:55 user nova-compute[75745]: STATIC:
Dec 01 17:08:55 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c
Dec 01 17:08:55 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:55 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:55 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111
Dec 01 17:08:55 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:55 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:55 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121
Dec 01 17:08:55 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:55 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:55 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04
Dec 01 17:08:55 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:55 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:55 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e
Dec 01 17:08:55 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:08:55 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:08:55 user nova-compute[75745]: FIRMWARE:
Dec 01 17:08:55 user nova-compute[75745]: No targets found.
Dec 01 17:08:55 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:08:55 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:08:55 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5abe5cb-e00a-4730-9f04-f1077778fdd3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[87497be8-3306-4867-b64d-82a5de5737f5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:55 user nova-compute[75745]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)
Dec 01 17:08:55 user nova-compute[75745]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)
Dec 01 17:08:55 user nova-compute[75745]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)
Dec 01 17:08:55 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:55 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:08:55 user nova-compute[75745]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 (non-flash)
Dec 01 17:08:55 user nova-compute[75745]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)
Dec 01 17:08:55 user nova-compute[75745]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)
Dec 01 17:08:55 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:08:55 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b8249ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04'): ({'sdm'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Removing single pathed devices sdm {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa0e28d-b311-4cfc-a39b-d18cc401889c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdm {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdm" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7abee7d-47b5-460c-942c-549dfc1ed05f]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Flushing IO for device /dev/sdm {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdm {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00c09612-9b3d-4de7-891a-eac29eb805c0 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdm" returned: 0 in 0.014s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[118b977c-2985-4e23-b1fd-a1ba9336733c]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdm/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00c09612-9b3d-4de7-891a-eac29eb805c0 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00c09612-9b3d-4de7-891a-eac29eb805c0 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdm/device/delete" returned: 0 in 0.051s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd3efc6-c709-4d00-acd5-a0674640368f]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Checking to see if SCSI volumes sdm have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] SCSI volumes sdm have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d902c4a8-6f19-411c-bb6f-2ca385da23ff]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:55 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-00c09612-9b3d-4de7-891a-eac29eb805c0 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Deleted allocations for instance c7fb74ee-dfa0-40e1-8773-99bd4a0402d5
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b487d91b-559b-4fb1-9d7c-ef6d94c62f51]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04, portal: 172.16.0.220,3260]
Dec 01 17:08:55 user nova-compute[75745]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04, portal: 172.16.0.220,3260] successful.
Dec 01 17:08:55 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67e7fd43-4d07-4a4c-8027-2861e79e6e04 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[235c2f2e-00c1-40c7-9692-f3ba37c4308e]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] <== disconnect_volume: return (369ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00c09612-9b3d-4de7-891a-eac29eb805c0 tempest-AttachSCSIVolumeTestJSON-17080036 tempest-AttachSCSIVolumeTestJSON-17080036-project-member] Lock "c7fb74ee-dfa0-40e1-8773-99bd4a0402d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.017s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG nova.compute.manager [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XgKELjUI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'd9bfb9f9-95a4-49f5-b781-5e78c83c54d1', 'attached_at': '', 'detached_at': '', 'volume_id': 'b000c1c2-a9f3-4629-b034-ef182141787e', 'serial'} {{(pid=75745) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Dec 01 17:08:55 user nova-compute[75745]: DEBUG nova.compute.manager [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] swap_volume: removing Cinder connection for volume 67e7fd43-4d07-4a4c-8027-2861e79e6e04 {{(pid=75745) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Dec 01 17:08:56 user nova-compute[75745]: DEBUG nova.compute.manager [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] swap_volume: Updating volume 67e7fd43-4d07-4a4c-8027-2861e79e6e04 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "XgKELjUI", "auth_password": "YJn2SXmGEaWcF9", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdd", "volume_id": "b000c1c2-a9f3-4629-b034-ef182141787e"}, "status": "reserved", "instance": "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1", "attached_at": "", "detached_at": "", "volume_id": "b000c1c2-a9f3-4629-b034-ef182141787e", "serial": "b000c1c2-a9f3-4629-b034-ef182141787e"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'b000c1c2-a9f3-4629-b034-ef182141787e', 'no_device': None, 'attachment_id': '589c6273-bff2-44a4-ae2c-8369c376aab2'} {{(pid=75745) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Dec 01 17:08:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a8b97d90-85ff-4323-9e62-c276938dc477 tempest-TestVolumeSwap-348476594 tempest-TestVolumeSwap-348476594-project-admin] Lock "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 21.116s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-48c09538-c862-4301-85ee-271094e6d9df req-de275a9d-eec7-41c7-8c63-9c91f9d3e831 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-deleted-f2f8e363-9e49-43ae-b61b-7ff8893c9f8f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:56 user nova-compute[75745]: INFO nova.compute.manager [req-48c09538-c862-4301-85ee-271094e6d9df req-de275a9d-eec7-41c7-8c63-9c91f9d3e831 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Neutron deleted interface f2f8e363-9e49-43ae-b61b-7ff8893c9f8f; detaching it from the instance and deleting it from the info cache
Dec 01 17:08:56 user nova-compute[75745]: DEBUG nova.network.neutron [req-48c09538-c862-4301-85ee-271094e6d9df req-de275a9d-eec7-41c7-8c63-9c91f9d3e831 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Updating instance_info_cache with network_info: [{"id": "d7c02fc7-a4d9-4c86-b18b-cf12d101f22f", "address": "fa:16:3e:09:96:2e", "network": {"id": "b1af6a14-56fa-4052-8593-93b13dc6a9a1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1377780155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7c02fc7-a4", "ovs_interfaceid": "d7c02fc7-a4d9-4c86-b18b-cf12d101f22f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4024ab4b-08e5-4f1f-866d-979bb1dee426", "address": "fa:16:3e:bc:fa:09", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4024ab4b-08", "ovs_interfaceid": "4024ab4b-08e5-4f1f-866d-979bb1dee426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6e1b67ad-1619-4e40-906c-df31e0eab904", "address": "fa:16:3e:a7:3f:00", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e1b67ad-16", "ovs_interfaceid": "6e1b67ad-1619-4e40-906c-df31e0eab904", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "92b697c2-8400-4b91-9fd7-53df7f47c4e0", "address": "fa:16:3e:95:8f:8d", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b697c2-84", "ovs_interfaceid": "92b697c2-8400-4b91-9fd7-53df7f47c4e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f79cb7e-7ef6-4e1a-a241-780713de2217", "address": "fa:16:3e:ef:c2:b4", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f79cb7e-7e", "ovs_interfaceid": "9f79cb7e-7ef6-4e1a-a241-780713de2217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b6cfe1f-9722-41e1-9679-52398359a035", "address": "fa:16:3e:7c:30:af", "network": {"id": "32d435b7-174b-4e6c-9165-315876fea12a", "bridge": "br-int", "label": "tempest-device-tagging-net2-658876998", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6cfe1f-97", "ovs_interfaceid": "4b6cfe1f-9722-41e1-9679-52398359a035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:08:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-48c09538-c862-4301-85ee-271094e6d9df req-de275a9d-eec7-41c7-8c63-9c91f9d3e831 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Detach interface failed, port_id=f2f8e363-9e49-43ae-b61b-7ff8893c9f8f, reason: Instance 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e could not be found. {{(pid=75745) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 17:08:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-48c09538-c862-4301-85ee-271094e6d9df req-de275a9d-eec7-41c7-8c63-9c91f9d3e831 service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Received event network-vif-plugged-8b8877f6-9183-46cb-964f-089f6b197d1e {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-48c09538-c862-4301-85ee-271094e6d9df req-de275a9d-eec7-41c7-8c63-9c91f9d3e831 service nova] Acquiring lock "02715ae1-5200-4df5-8430-2f19a610d2bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-48c09538-c862-4301-85ee-271094e6d9df req-de275a9d-eec7-41c7-8c63-9c91f9d3e831 service nova] Lock "02715ae1-5200-4df5-8430-2f19a610d2bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-48c09538-c862-4301-85ee-271094e6d9df req-de275a9d-eec7-41c7-8c63-9c91f9d3e831 service nova] Lock "02715ae1-5200-4df5-8430-2f19a610d2bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:08:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-48c09538-c862-4301-85ee-271094e6d9df req-de275a9d-eec7-41c7-8c63-9c91f9d3e831 service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] No waiting events found dispatching network-vif-plugged-8b8877f6-9183-46cb-964f-089f6b197d1e {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:08:56 user nova-compute[75745]: WARNING nova.compute.manager [req-48c09538-c862-4301-85ee-271094e6d9df req-de275a9d-eec7-41c7-8c63-9c91f9d3e831 service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Received unexpected event network-vif-plugged-8b8877f6-9183-46cb-964f-089f6b197d1e for instance with vm_state active and task_state None.
Dec 01 17:08:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-48c09538-c862-4301-85ee-271094e6d9df req-de275a9d-eec7-41c7-8c63-9c91f9d3e831 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-deleted-9f79cb7e-7ef6-4e1a-a241-780713de2217 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:56 user nova-compute[75745]: INFO nova.compute.manager [req-48c09538-c862-4301-85ee-271094e6d9df req-de275a9d-eec7-41c7-8c63-9c91f9d3e831 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Neutron deleted interface 9f79cb7e-7ef6-4e1a-a241-780713de2217; detaching it from the instance and deleting it from the info cache
Dec 01 17:08:56 user nova-compute[75745]: DEBUG nova.network.neutron [req-48c09538-c862-4301-85ee-271094e6d9df req-de275a9d-eec7-41c7-8c63-9c91f9d3e831 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Updating instance_info_cache with network_info: [{"id": "d7c02fc7-a4d9-4c86-b18b-cf12d101f22f", "address": "fa:16:3e:09:96:2e", "network": {"id": "b1af6a14-56fa-4052-8593-93b13dc6a9a1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1377780155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7c02fc7-a4", "ovs_interfaceid": "d7c02fc7-a4d9-4c86-b18b-cf12d101f22f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4024ab4b-08e5-4f1f-866d-979bb1dee426", "address": "fa:16:3e:bc:fa:09", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4024ab4b-08", "ovs_interfaceid": "4024ab4b-08e5-4f1f-866d-979bb1dee426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6e1b67ad-1619-4e40-906c-df31e0eab904", "address": "fa:16:3e:a7:3f:00", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e1b67ad-16", "ovs_interfaceid": "6e1b67ad-1619-4e40-906c-df31e0eab904", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "92b697c2-8400-4b91-9fd7-53df7f47c4e0", "address": "fa:16:3e:95:8f:8d", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b697c2-84", "ovs_interfaceid": "92b697c2-8400-4b91-9fd7-53df7f47c4e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b6cfe1f-9722-41e1-9679-52398359a035", "address": "fa:16:3e:7c:30:af", "network": {"id": "32d435b7-174b-4e6c-9165-315876fea12a", "bridge": "br-int", "label": "tempest-device-tagging-net2-658876998", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6cfe1f-97", "ovs_interfaceid": "4b6cfe1f-9722-41e1-9679-52398359a035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:08:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-48c09538-c862-4301-85ee-271094e6d9df req-de275a9d-eec7-41c7-8c63-9c91f9d3e831 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Detach interface failed, port_id=9f79cb7e-7ef6-4e1a-a241-780713de2217, reason: Instance 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e could not be found. {{(pid=75745) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 17:08:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-48c09538-c862-4301-85ee-271094e6d9df req-de275a9d-eec7-41c7-8c63-9c91f9d3e831 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-deleted-4b6cfe1f-9722-41e1-9679-52398359a035 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:56 user nova-compute[75745]: INFO nova.compute.manager [req-48c09538-c862-4301-85ee-271094e6d9df req-de275a9d-eec7-41c7-8c63-9c91f9d3e831 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Neutron deleted interface 4b6cfe1f-9722-41e1-9679-52398359a035; detaching it from the instance and deleting it from the info cache
Dec 01 17:08:56 user nova-compute[75745]: DEBUG nova.network.neutron [req-48c09538-c862-4301-85ee-271094e6d9df req-de275a9d-eec7-41c7-8c63-9c91f9d3e831 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Updating instance_info_cache with network_info: [{"id": "d7c02fc7-a4d9-4c86-b18b-cf12d101f22f", "address": "fa:16:3e:09:96:2e", "network": {"id": "b1af6a14-56fa-4052-8593-93b13dc6a9a1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1377780155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7c02fc7-a4", "ovs_interfaceid": "d7c02fc7-a4d9-4c86-b18b-cf12d101f22f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4024ab4b-08e5-4f1f-866d-979bb1dee426", "address": "fa:16:3e:bc:fa:09", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4024ab4b-08", "ovs_interfaceid": "4024ab4b-08e5-4f1f-866d-979bb1dee426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6e1b67ad-1619-4e40-906c-df31e0eab904", "address": "fa:16:3e:a7:3f:00", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e1b67ad-16", "ovs_interfaceid": "6e1b67ad-1619-4e40-906c-df31e0eab904", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "92b697c2-8400-4b91-9fd7-53df7f47c4e0", "address": "fa:16:3e:95:8f:8d", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b697c2-84", "ovs_interfaceid": "92b697c2-8400-4b91-9fd7-53df7f47c4e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:08:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-48c09538-c862-4301-85ee-271094e6d9df req-de275a9d-eec7-41c7-8c63-9c91f9d3e831 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Detach interface failed, port_id=4b6cfe1f-9722-41e1-9679-52398359a035, reason: Instance 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e could not be found. {{(pid=75745) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 17:08:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-48c09538-c862-4301-85ee-271094e6d9df req-de275a9d-eec7-41c7-8c63-9c91f9d3e831 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-deleted-92b697c2-8400-4b91-9fd7-53df7f47c4e0 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:56 user nova-compute[75745]: INFO nova.compute.manager [req-48c09538-c862-4301-85ee-271094e6d9df req-de275a9d-eec7-41c7-8c63-9c91f9d3e831 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Neutron deleted interface 92b697c2-8400-4b91-9fd7-53df7f47c4e0; detaching it from the instance and deleting it from the info cache
Dec 01 17:08:56 user nova-compute[75745]: DEBUG nova.network.neutron [req-48c09538-c862-4301-85ee-271094e6d9df req-de275a9d-eec7-41c7-8c63-9c91f9d3e831 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Updating instance_info_cache with network_info: [{"id": "d7c02fc7-a4d9-4c86-b18b-cf12d101f22f", "address": "fa:16:3e:09:96:2e", "network": {"id": "b1af6a14-56fa-4052-8593-93b13dc6a9a1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1377780155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7c02fc7-a4", "ovs_interfaceid": "d7c02fc7-a4d9-4c86-b18b-cf12d101f22f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4024ab4b-08e5-4f1f-866d-979bb1dee426", "address": "fa:16:3e:bc:fa:09", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4024ab4b-08", "ovs_interfaceid": "4024ab4b-08e5-4f1f-866d-979bb1dee426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6e1b67ad-1619-4e40-906c-df31e0eab904", "address": "fa:16:3e:a7:3f:00", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e1b67ad-16", "ovs_interfaceid": "6e1b67ad-1619-4e40-906c-df31e0eab904", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:08:56 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:08:56 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Took 6.33 seconds to deallocate network for instance.
Dec 01 17:08:57 user nova-compute[75745]: DEBUG nova.compute.manager [req-48c09538-c862-4301-85ee-271094e6d9df req-de275a9d-eec7-41c7-8c63-9c91f9d3e831 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Detach interface failed, port_id=92b697c2-8400-4b91-9fd7-53df7f47c4e0, reason: Instance 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e could not be found. {{(pid=75745) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 17:08:57 user nova-compute[75745]: DEBUG nova.compute.manager [req-6d08b22a-3e95-44d7-844f-fb285e0e3195 req-bb7d3bc9-87ea-4b2a-93df-24684b6290ae service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-deleted-c6812409-296e-40f5-bdfc-b7cedf33f85b {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:57 user nova-compute[75745]: INFO nova.compute.manager [req-6d08b22a-3e95-44d7-844f-fb285e0e3195 req-bb7d3bc9-87ea-4b2a-93df-24684b6290ae service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Neutron deleted interface c6812409-296e-40f5-bdfc-b7cedf33f85b; detaching it from the instance and deleting it from the info cache
Dec 01 17:08:57 user nova-compute[75745]: DEBUG nova.network.neutron [req-6d08b22a-3e95-44d7-844f-fb285e0e3195 req-bb7d3bc9-87ea-4b2a-93df-24684b6290ae service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Updating instance_info_cache with network_info: [{"id": "de0d310c-2bc9-4434-8b2b-253a88febaa0", "address": "fa:16:3e:3f:e1:39", "network": {"id": "8d239238-e90b-4408-86f0-a143eb9ac337", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1071206325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0d310c-2b", "ovs_interfaceid": "de0d310c-2bc9-4434-8b2b-253a88febaa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5ecb053-fd41-42ea-8abe-4c504b6c7882", "address": "fa:16:3e:56:bb:b9", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5ecb053-fd", "ovs_interfaceid": "a5ecb053-fd41-42ea-8abe-4c504b6c7882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4bc79fe9-e1e7-4040-ae00-e231301a8c58", "address": "fa:16:3e:b8:6d:f8", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc79fe9-e1", "ovs_interfaceid": "4bc79fe9-e1e7-4040-ae00-e231301a8c58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9d9f0b3d-a677-4db0-a8be-b19006908125", "address": "fa:16:3e:d2:26:2b", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d9f0b3d-a6", "ovs_interfaceid": "9d9f0b3d-a677-4db0-a8be-b19006908125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "754453de-6c68-4cdd-acc4-2307e4b6d3d2", "address": "fa:16:3e:e2:b2:aa", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap754453de-6c", "ovs_interfaceid": "754453de-6c68-4cdd-acc4-2307e4b6d3d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "847be9c3-c4d1-4280-8b85-56697d11a876", "address": "fa:16:3e:67:52:ab", "network": {"id": "2a7db2ed-f938-42c6-b85c-8a94ac2717a8", "bridge": "br-int", "label": "tempest-device-tagging-net2-811431562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap847be9c3-c4", "ovs_interfaceid": "847be9c3-c4d1-4280-8b85-56697d11a876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:08:57 user nova-compute[75745]: DEBUG nova.compute.manager [req-6d08b22a-3e95-44d7-844f-fb285e0e3195 req-bb7d3bc9-87ea-4b2a-93df-24684b6290ae service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Detach interface failed, port_id=c6812409-296e-40f5-bdfc-b7cedf33f85b, reason: Instance 5c6c7551-7045-4129-9908-c0c6fbd93124 could not be found. {{(pid=75745) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 17:08:57 user nova-compute[75745]: DEBUG nova.compute.manager [req-6d08b22a-3e95-44d7-844f-fb285e0e3195 req-bb7d3bc9-87ea-4b2a-93df-24684b6290ae service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-deleted-847be9c3-c4d1-4280-8b85-56697d11a876 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:57 user nova-compute[75745]: INFO nova.compute.manager [req-6d08b22a-3e95-44d7-844f-fb285e0e3195 req-bb7d3bc9-87ea-4b2a-93df-24684b6290ae service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Neutron deleted interface 847be9c3-c4d1-4280-8b85-56697d11a876; detaching it from the instance and deleting it from the info cache
Dec 01 17:08:57 user nova-compute[75745]: DEBUG nova.network.neutron [req-6d08b22a-3e95-44d7-844f-fb285e0e3195 req-bb7d3bc9-87ea-4b2a-93df-24684b6290ae service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Updating instance_info_cache with network_info: [{"id": "de0d310c-2bc9-4434-8b2b-253a88febaa0", "address": "fa:16:3e:3f:e1:39", "network": {"id": "8d239238-e90b-4408-86f0-a143eb9ac337", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1071206325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0d310c-2b", "ovs_interfaceid": "de0d310c-2bc9-4434-8b2b-253a88febaa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5ecb053-fd41-42ea-8abe-4c504b6c7882", "address": "fa:16:3e:56:bb:b9", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5ecb053-fd", "ovs_interfaceid": "a5ecb053-fd41-42ea-8abe-4c504b6c7882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4bc79fe9-e1e7-4040-ae00-e231301a8c58", "address": "fa:16:3e:b8:6d:f8", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc79fe9-e1", "ovs_interfaceid": "4bc79fe9-e1e7-4040-ae00-e231301a8c58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9d9f0b3d-a677-4db0-a8be-b19006908125", "address": "fa:16:3e:d2:26:2b", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d9f0b3d-a6", "ovs_interfaceid": "9d9f0b3d-a677-4db0-a8be-b19006908125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "754453de-6c68-4cdd-acc4-2307e4b6d3d2", "address": "fa:16:3e:e2:b2:aa", "network": {"id": "027c842b-831c-4cd4-8a9f-cca60bb6b647", "bridge": "br-int", "label": "tempest-device-tagging-net1-2038232856", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75997c4cca1f4ebc9037a6dfc36a92b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap754453de-6c", "ovs_interfaceid": "754453de-6c68-4cdd-acc4-2307e4b6d3d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:08:57 user nova-compute[75745]: DEBUG nova.compute.manager [req-6d08b22a-3e95-44d7-844f-fb285e0e3195 req-bb7d3bc9-87ea-4b2a-93df-24684b6290ae service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Detach interface failed, port_id=847be9c3-c4d1-4280-8b85-56697d11a876, reason: Instance 5c6c7551-7045-4129-9908-c0c6fbd93124 could not be found. {{(pid=75745) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 17:08:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Acquiring lock "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Lock "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:08:58 user nova-compute[75745]: INFO nova.compute.manager [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Detaching volume b000c1c2-a9f3-4629-b034-ef182141787e
Dec 01 17:08:58 user nova-compute[75745]: INFO nova.virt.block_device [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Attempting to driver detach volume b000c1c2-a9f3-4629-b034-ef182141787e from mountpoint /dev/vdb
Dec 01 17:08:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Attempting to detach device vdb from instance d9bfb9f9-95a4-49f5-b781-5e78c83c54d1 from the persistent domain config. {{(pid=75745) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 17:08:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:08:58 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:08:58 user nova-compute[75745]:   <source dev="/dev/sdd"/>
Dec 01 17:08:58 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:08:58 user nova-compute[75745]:   <serial>b000c1c2-a9f3-4629-b034-ef182141787e</serial>
Dec 01 17:08:58 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 17:08:58 user nova-compute[75745]: </disk>
Dec 01 17:08:58 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:08:58 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Successfully detached device vdb from instance d9bfb9f9-95a4-49f5-b781-5e78c83c54d1 from the persistent domain config.
Dec 01 17:08:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d9bfb9f9-95a4-49f5-b781-5e78c83c54d1 from the live domain config. {{(pid=75745) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 17:08:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:08:58 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:08:58 user nova-compute[75745]:   <source dev="/dev/sdd"/>
Dec 01 17:08:58 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:08:58 user nova-compute[75745]:   <serial>b000c1c2-a9f3-4629-b034-ef182141787e</serial>
Dec 01 17:08:58 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 17:08:58 user nova-compute[75745]: </disk>
Dec 01 17:08:58 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:08:58 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:08:58 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Took 4.94 seconds to deallocate network for instance.
Dec 01 17:08:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d9bfb9f9-95a4-49f5-b781-5e78c83c54d1 {{(pid=75745) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 17:08:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-0534e8f8-ca78-471d-9115-540ed64b6c99 req-8224634a-25f9-4550-87a8-39482e044507 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Received event network-vif-deleted-d7c02fc7-a4d9-4c86-b18b-cf12d101f22f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:58 user nova-compute[75745]: INFO nova.compute.manager [req-0534e8f8-ca78-471d-9115-540ed64b6c99 req-8224634a-25f9-4550-87a8-39482e044507 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Neutron deleted interface d7c02fc7-a4d9-4c86-b18b-cf12d101f22f; detaching it from the instance and deleting it from the info cache
Dec 01 17:08:58 user nova-compute[75745]: DEBUG nova.network.neutron [req-0534e8f8-ca78-471d-9115-540ed64b6c99 req-8224634a-25f9-4550-87a8-39482e044507 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Updating instance_info_cache with network_info: [{"id": "4024ab4b-08e5-4f1f-866d-979bb1dee426", "address": "fa:16:3e:bc:fa:09", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4024ab4b-08", "ovs_interfaceid": "4024ab4b-08e5-4f1f-866d-979bb1dee426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6e1b67ad-1619-4e40-906c-df31e0eab904", "address": "fa:16:3e:a7:3f:00", "network": {"id": "a0d9c591-842a-4fcd-93e5-62cacb3f1d30", "bridge": "br-int", "label": "tempest-device-tagging-net1-681624752", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "586f7ce69de240cb9e2d110530c2c7ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e1b67ad-16", "ovs_interfaceid": "6e1b67ad-1619-4e40-906c-df31e0eab904", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:08:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-0534e8f8-ca78-471d-9115-540ed64b6c99 req-8224634a-25f9-4550-87a8-39482e044507 service nova] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Detach interface failed, port_id=d7c02fc7-a4d9-4c86-b18b-cf12d101f22f, reason: Instance 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e could not be found. {{(pid=75745) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 17:08:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:08:59 user nova-compute[75745]: DEBUG nova.compute.manager [req-9e49f72f-749a-4efa-b4eb-de16c7fd177c req-6f4802f9-c830-45e3-b03c-8e8d04fe0dea service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-deleted-de0d310c-2bc9-4434-8b2b-253a88febaa0 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:59 user nova-compute[75745]: DEBUG nova.compute.manager [req-9e49f72f-749a-4efa-b4eb-de16c7fd177c req-6f4802f9-c830-45e3-b03c-8e8d04fe0dea service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-deleted-754453de-6c68-4cdd-acc4-2307e4b6d3d2 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:59 user nova-compute[75745]: DEBUG nova.compute.manager [req-9e49f72f-749a-4efa-b4eb-de16c7fd177c req-6f4802f9-c830-45e3-b03c-8e8d04fe0dea service nova] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Received event network-vif-deleted-9d9f0b3d-a677-4db0-a8be-b19006908125 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:08:59 user nova-compute[75745]: INFO nova.compute.manager [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] [instance: 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e] Took 2.74 seconds to detach 3 volumes for instance.
Dec 01 17:08:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:08:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:00 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Deleted allocations for instance 1372f3b7-6608-43a9-b1a5-fd7dfbaf303e
Dec 01 17:09:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4fe96a81-267d-4eb7-b909-839cbbf6d3a9 tempest-TaggedBootDevicesTest-744386326 tempest-TaggedBootDevicesTest-744386326-project-member] Lock "1372f3b7-6608-43a9-b1a5-fd7dfbaf303e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.810s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:00 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0e256c89-0301-431a-ae27-dfd7c2af19f2 is timed out.
Dec 01 17:09:00 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Successfully detached device vdb from instance 0e256c89-0301-431a-ae27-dfd7c2af19f2 from the live domain config.
Dec 01 17:09:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VPeoIbFv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:09:00 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:09:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[191eaac0-af9d-4ca2-b030-a8775d5a7906]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:09:00 user nova-compute[75745]: No targets found.
Dec 01 17:09:00 user nova-compute[75745]: iSNS:
Dec 01 17:09:00 user nova-compute[75745]: No targets found.
Dec 01 17:09:00 user nova-compute[75745]: STATIC:
Dec 01 17:09:00 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c
Dec 01 17:09:00 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:09:00 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:09:00 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111
Dec 01 17:09:00 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:09:00 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:09:00 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121
Dec 01 17:09:00 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:09:00 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:09:00 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e
Dec 01 17:09:00 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:09:00 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:09:00 user nova-compute[75745]: FIRMWARE:
Dec 01 17:09:00 user nova-compute[75745]: No targets found.
Dec 01 17:09:00 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:09:00 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:09:00 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9d8be5-ec9b-4f7b-82a0-e4fb0ea9ee02]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a21664-5614-4118-ae67-1e314d2d40db]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:09:00 user nova-compute[75745]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)
Dec 01 17:09:00 user nova-compute[75745]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)
Dec 01 17:09:00 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:09:00 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:09:00 user nova-compute[75745]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c (non-flash)
Dec 01 17:09:00 user nova-compute[75745]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)
Dec 01 17:09:00 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:09:00 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b81f70a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c'): ({'sdj'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Removing single pathed devices sdj {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[84250c07-93df-4c26-85b5-2cd62f8614f5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88e836d-b842-4bad-8504-36f165a20888]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Flushing IO for device /dev/sdj {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba5ebb0-ef88-492b-971e-48e7e036de27]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.056s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[303240a8-5ce5-45b4-afee-2db4f67a539e]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] SCSI volumes sdj have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[df97e403-bb18-491d-93d9-47b36ab164d3]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e86d95-0841-4cc8-a0a4-d1b27b827d14]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c, portal: 172.16.0.220,3260]
Dec 01 17:09:00 user nova-compute[75745]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c, portal: 172.16.0.220,3260] successful.
Dec 01 17:09:00 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45ea748-d36e-4f48-9af3-8d022a56290c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d3a31a-7dc2-4b59-a6fb-cdb9b75d4d9f]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] <== disconnect_volume: return (322ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:09:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:01 user nova-compute[75745]: INFO nova.compute.manager [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] [instance: 5c6c7551-7045-4129-9908-c0c6fbd93124] Took 2.81 seconds to detach 3 volumes for instance.
Dec 01 17:09:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:01 user nova-compute[75745]: DEBUG nova.objects.instance [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Lazy-loading 'flavor' on Instance uuid 0e256c89-0301-431a-ae27-dfd7c2af19f2 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:09:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-3f7b81ce-76fe-47ff-b3f5-3069d1e8fdde tempest-VolumesAssistedSnapshotsTest-446937937 tempest-VolumesAssistedSnapshotsTest-446937937-project-admin] Lock "0e256c89-0301-431a-ae27-dfd7c2af19f2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.803s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:01 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:09:01 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:09:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.277s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:01 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Deleted allocations for instance 5c6c7551-7045-4129-9908-c0c6fbd93124
Dec 01 17:09:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-deffbbbd-8f0a-4958-b704-a93f0e1578d6 tempest-TaggedBootDevicesTest_v242-310064596 tempest-TaggedBootDevicesTest_v242-310064596-project-member] Lock "5c6c7551-7045-4129-9908-c0c6fbd93124" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.415s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:03 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:03 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Acquiring lock "71504d5d-0999-4960-8782-b454cb407e9f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Lock "71504d5d-0999-4960-8782-b454cb407e9f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:12 user nova-compute[75745]: DEBUG nova.compute.manager [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:09:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:12 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:09:12 user nova-compute[75745]: INFO nova.compute.claims [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Claim successful on node user
Dec 01 17:09:13 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:09:13 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:09:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.316s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:13 user nova-compute[75745]: DEBUG nova.compute.manager [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:09:13 user nova-compute[75745]: DEBUG nova.compute.manager [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:09:13 user nova-compute[75745]: DEBUG nova.network.neutron [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:09:13 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:09:13 user nova-compute[75745]: DEBUG nova.compute.manager [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:09:13 user nova-compute[75745]: DEBUG nova.policy [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dc2b48b84ebb46ae9b300423b9e225be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a2dd2fc4fef47d584dd73c8bf3e42ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:09:13 user nova-compute[75745]: INFO nova.virt.block_device [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Booting with volume 47a3e21c-03d2-4df0-b96b-c78261e91b98 at /dev/vda
Dec 01 17:09:13 user nova-compute[75745]: DEBUG os_brick.utils [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:09:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:13 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[675238ca-c473-4aed-a37d-f6fc5f4f1b67]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:13 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d95fc6-e00c-4277-94bf-8c9346e09cbd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:13 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6218d32-e192-45fc-a715-fd797a87f1a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:13 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a70771-d6e9-4d60-92d6-df05880084bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:09:13 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:09:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:09:13 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:09:13 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd3120f-4507-435d-8de5-ead3014e2bf2]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:13 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:09:13 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:09:13 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:09:13 user nova-compute[75745]: DEBUG os_brick.utils [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:09:13 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Updating existing volume attachment record: 6d78b3fa-59ea-4971-8461-94f09a61d7de {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:09:13 user nova-compute[75745]: DEBUG nova.network.neutron [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Successfully created port: d3079bd2-25ea-432b-a601-9bb7502fe9c8 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:09:14 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-402a7045-4962-490e-b90b-21fd9cd5f68c tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Waiting for libvirt event about the detach of device tap8b8877f6-91 with device alias net1 from instance 02715ae1-5200-4df5-8430-2f19a610d2bb is timed out.
Dec 01 17:09:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-402a7045-4962-490e-b90b-21fd9cd5f68c tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d5:67:2f"/><model type="virtio"/><mtu size="1442"/><target dev="tap8b8877f6-91"/></interface> {{(pid=75745) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-402a7045-4962-490e-b90b-21fd9cd5f68c tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d5:67:2f"/><model type="virtio"/><mtu size="1442"/><target dev="tap8b8877f6-91"/></interface>not found in domain: <domain type='kvm' id='7'>
Dec 01 17:09:14 user nova-compute[75745]:   <name>instance-00000007</name>
Dec 01 17:09:14 user nova-compute[75745]:   <uuid>02715ae1-5200-4df5-8430-2f19a610d2bb</uuid>
Dec 01 17:09:14 user nova-compute[75745]:   <metadata>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:09:14 user nova-compute[75745]:   <nova:package version="0.0.0"/>
Dec 01 17:09:14 user nova-compute[75745]:   <nova:name>tempest-device-tagging-server-307822093</nova:name>
Dec 01 17:09:14 user nova-compute[75745]:   <nova:creationTime>2023-12-01 17:08:08</nova:creationTime>
Dec 01 17:09:14 user nova-compute[75745]:   <nova:flavor name="m1.tiny">
Dec 01 17:09:14 user nova-compute[75745]:     <nova:memory>512</nova:memory>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:disk>1</nova:disk>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:swap>0</nova:swap>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:vcpus>1</nova:vcpus>
Dec 01 17:09:14 user nova-compute[75745]:   </nova:flavor>
Dec 01 17:09:14 user nova-compute[75745]:   <nova:owner>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:user uuid="77cc6ad71fa84904acd8d24eec648c94">tempest-TaggedAttachmentsTest-161209440-project-member</nova:user>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:project uuid="d5275e723c904fa183974b49d4530824">tempest-TaggedAttachmentsTest-161209440</nova:project>
Dec 01 17:09:14 user nova-compute[75745]:   </nova:owner>
Dec 01 17:09:14 user nova-compute[75745]:   <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:09:14 user nova-compute[75745]:   <nova:ports>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:port uuid="f2e5d5e1-b6be-444f-b8b6-c8f26cef560b">
Dec 01 17:09:14 user nova-compute[75745]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 01 17:09:14 user nova-compute[75745]:     </nova:port>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:port uuid="8b8877f6-9183-46cb-964f-089f6b197d1e">
Dec 01 17:09:14 user nova-compute[75745]:       <nova:ip type="fixed" address="10.10.10.23" ipVersion="4"/>
Dec 01 17:09:14 user nova-compute[75745]:     </nova:port>
Dec 01 17:09:14 user nova-compute[75745]:   </nova:ports>
Dec 01 17:09:14 user nova-compute[75745]: </nova:instance>
Dec 01 17:09:14 user nova-compute[75745]:   </metadata>
Dec 01 17:09:14 user nova-compute[75745]:   <memory unit='KiB'>524288</memory>
Dec 01 17:09:14 user nova-compute[75745]:   <currentMemory unit='KiB'>524288</currentMemory>
Dec 01 17:09:14 user nova-compute[75745]:   <vcpu placement='static'>1</vcpu>
Dec 01 17:09:14 user nova-compute[75745]:   <resource>
Dec 01 17:09:14 user nova-compute[75745]:     <partition>/machine</partition>
Dec 01 17:09:14 user nova-compute[75745]:   </resource>
Dec 01 17:09:14 user nova-compute[75745]:   <sysinfo type='smbios'>
Dec 01 17:09:14 user nova-compute[75745]:     <system>
Dec 01 17:09:14 user nova-compute[75745]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Dec 01 17:09:14 user nova-compute[75745]:       <entry name='product'>OpenStack Nova</entry>
Dec 01 17:09:14 user nova-compute[75745]:       <entry name='version'>0.0.0</entry>
Dec 01 17:09:14 user nova-compute[75745]:       <entry name='serial'>02715ae1-5200-4df5-8430-2f19a610d2bb</entry>
Dec 01 17:09:14 user nova-compute[75745]:       <entry name='uuid'>02715ae1-5200-4df5-8430-2f19a610d2bb</entry>
Dec 01 17:09:14 user nova-compute[75745]:       <entry name='family'>Virtual Machine</entry>
Dec 01 17:09:14 user nova-compute[75745]:     </system>
Dec 01 17:09:14 user nova-compute[75745]:   </sysinfo>
Dec 01 17:09:14 user nova-compute[75745]:   <os>
Dec 01 17:09:14 user nova-compute[75745]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Dec 01 17:09:14 user nova-compute[75745]:     <boot dev='hd'/>
Dec 01 17:09:14 user nova-compute[75745]:     <smbios mode='sysinfo'/>
Dec 01 17:09:14 user nova-compute[75745]:   </os>
Dec 01 17:09:14 user nova-compute[75745]:   <features>
Dec 01 17:09:14 user nova-compute[75745]:     <acpi/>
Dec 01 17:09:14 user nova-compute[75745]:     <apic/>
Dec 01 17:09:14 user nova-compute[75745]:     <vmcoreinfo state='on'/>
Dec 01 17:09:14 user nova-compute[75745]:   </features>
Dec 01 17:09:14 user nova-compute[75745]:   <cpu mode='custom' match='exact' check='full'>
Dec 01 17:09:14 user nova-compute[75745]:     <model fallback='forbid'>Nehalem</model>
Dec 01 17:09:14 user nova-compute[75745]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Dec 01 17:09:14 user nova-compute[75745]:     <feature policy='require' name='vme'/>
Dec 01 17:09:14 user nova-compute[75745]:     <feature policy='require' name='x2apic'/>
Dec 01 17:09:14 user nova-compute[75745]:     <feature policy='require' name='hypervisor'/>
Dec 01 17:09:14 user nova-compute[75745]:   </cpu>
Dec 01 17:09:14 user nova-compute[75745]:   <clock offset='utc'>
Dec 01 17:09:14 user nova-compute[75745]:     <timer name='pit' tickpolicy='delay'/>
Dec 01 17:09:14 user nova-compute[75745]:     <timer name='rtc' tickpolicy='catchup'/>
Dec 01 17:09:14 user nova-compute[75745]:     <timer name='hpet' present='no'/>
Dec 01 17:09:14 user nova-compute[75745]:   </clock>
Dec 01 17:09:14 user nova-compute[75745]:   <on_poweroff>destroy</on_poweroff>
Dec 01 17:09:14 user nova-compute[75745]:   <on_reboot>restart</on_reboot>
Dec 01 17:09:14 user nova-compute[75745]:   <on_crash>destroy</on_crash>
Dec 01 17:09:14 user nova-compute[75745]:   <devices>
Dec 01 17:09:14 user nova-compute[75745]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 01 17:09:14 user nova-compute[75745]:     <disk type='file' device='disk'>
Dec 01 17:09:14 user nova-compute[75745]:       <driver name='qemu' type='qcow2' cache='none'/>
Dec 01 17:09:14 user nova-compute[75745]:       <source file='/opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk' index='2'/>
Dec 01 17:09:14 user nova-compute[75745]:       <backingStore type='file' index='3'>
Dec 01 17:09:14 user nova-compute[75745]:         <format type='raw'/>
Dec 01 17:09:14 user nova-compute[75745]:         <source file='/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf'/>
Dec 01 17:09:14 user nova-compute[75745]:         <backingStore/>
Dec 01 17:09:14 user nova-compute[75745]:       </backingStore>
Dec 01 17:09:14 user nova-compute[75745]:       <target dev='vda' bus='virtio'/>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='virtio-disk0'/>
Dec 01 17:09:14 user nova-compute[75745]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Dec 01 17:09:14 user nova-compute[75745]:     </disk>
Dec 01 17:09:14 user nova-compute[75745]:     <disk type='file' device='cdrom'>
Dec 01 17:09:14 user nova-compute[75745]:       <driver name='qemu' type='raw' cache='none'/>
Dec 01 17:09:14 user nova-compute[75745]:       <source file='/opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk.config' index='1'/>
Dec 01 17:09:14 user nova-compute[75745]:       <backingStore/>
Dec 01 17:09:14 user nova-compute[75745]:       <target dev='hda' bus='ide'/>
Dec 01 17:09:14 user nova-compute[75745]:       <readonly/>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='ide0-0-0'/>
Dec 01 17:09:14 user nova-compute[75745]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Dec 01 17:09:14 user nova-compute[75745]:     </disk>
Dec 01 17:09:14 user nova-compute[75745]:     <controller type='usb' index='0' model='none'>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='usb'/>
Dec 01 17:09:14 user nova-compute[75745]:     </controller>
Dec 01 17:09:14 user nova-compute[75745]:     <controller type='pci' index='0' model='pci-root'>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='pci.0'/>
Dec 01 17:09:14 user nova-compute[75745]:     </controller>
Dec 01 17:09:14 user nova-compute[75745]:     <controller type='ide' index='0'>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='ide'/>
Dec 01 17:09:14 user nova-compute[75745]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Dec 01 17:09:14 user nova-compute[75745]:     </controller>
Dec 01 17:09:14 user nova-compute[75745]:     <interface type='ethernet'>
Dec 01 17:09:14 user nova-compute[75745]:       <mac address='fa:16:3e:ff:a2:43'/>
Dec 01 17:09:14 user nova-compute[75745]:       <target dev='tapf2e5d5e1-b6'/>
Dec 01 17:09:14 user nova-compute[75745]:       <model type='virtio'/>
Dec 01 17:09:14 user nova-compute[75745]:       <mtu size='1442'/>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='net0'/>
Dec 01 17:09:14 user nova-compute[75745]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Dec 01 17:09:14 user nova-compute[75745]:     </interface>
Dec 01 17:09:14 user nova-compute[75745]:     <serial type='pty'>
Dec 01 17:09:14 user nova-compute[75745]:       <source path='/dev/pts/6'/>
Dec 01 17:09:14 user nova-compute[75745]:       <log file='/opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/console.log' append='off'/>
Dec 01 17:09:14 user nova-compute[75745]:       <target type='isa-serial' port='0'>
Dec 01 17:09:14 user nova-compute[75745]:         <model name='isa-serial'/>
Dec 01 17:09:14 user nova-compute[75745]:       </target>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='serial0'/>
Dec 01 17:09:14 user nova-compute[75745]:     </serial>
Dec 01 17:09:14 user nova-compute[75745]:     <console type='pty' tty='/dev/pts/6'>
Dec 01 17:09:14 user nova-compute[75745]:       <source path='/dev/pts/6'/>
Dec 01 17:09:14 user nova-compute[75745]:       <log file='/opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/console.log' append='off'/>
Dec 01 17:09:14 user nova-compute[75745]:       <target type='serial' port='0'/>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='serial0'/>
Dec 01 17:09:14 user nova-compute[75745]:     </console>
Dec 01 17:09:14 user nova-compute[75745]:     <input type='mouse' bus='ps2'>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='input0'/>
Dec 01 17:09:14 user nova-compute[75745]:     </input>
Dec 01 17:09:14 user nova-compute[75745]:     <input type='keyboard' bus='ps2'>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='input1'/>
Dec 01 17:09:14 user nova-compute[75745]:     </input>
Dec 01 17:09:14 user nova-compute[75745]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Dec 01 17:09:14 user nova-compute[75745]:       <listen type='address' address='0.0.0.0'/>
Dec 01 17:09:14 user nova-compute[75745]:     </graphics>
Dec 01 17:09:14 user nova-compute[75745]:     <audio id='1' type='none'/>
Dec 01 17:09:14 user nova-compute[75745]:     <video>
Dec 01 17:09:14 user nova-compute[75745]:       <model type='virtio' heads='1' primary='yes'/>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='video0'/>
Dec 01 17:09:14 user nova-compute[75745]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Dec 01 17:09:14 user nova-compute[75745]:     </video>
Dec 01 17:09:14 user nova-compute[75745]:     <memballoon model='virtio'>
Dec 01 17:09:14 user nova-compute[75745]:       <stats period='10'/>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='balloon0'/>
Dec 01 17:09:14 user nova-compute[75745]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Dec 01 17:09:14 user nova-compute[75745]:     </memballoon>
Dec 01 17:09:14 user nova-compute[75745]:     <rng model='virtio'>
Dec 01 17:09:14 user nova-compute[75745]:       <backend model='random'>/dev/urandom</backend>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='rng0'/>
Dec 01 17:09:14 user nova-compute[75745]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Dec 01 17:09:14 user nova-compute[75745]:     </rng>
Dec 01 17:09:14 user nova-compute[75745]:   </devices>
Dec 01 17:09:14 user nova-compute[75745]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Dec 01 17:09:14 user nova-compute[75745]:     <label>libvirt-02715ae1-5200-4df5-8430-2f19a610d2bb</label>
Dec 01 17:09:14 user nova-compute[75745]:     <imagelabel>libvirt-02715ae1-5200-4df5-8430-2f19a610d2bb</imagelabel>
Dec 01 17:09:14 user nova-compute[75745]:   </seclabel>
Dec 01 17:09:14 user nova-compute[75745]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Dec 01 17:09:14 user nova-compute[75745]:     <label>+64055:+108</label>
Dec 01 17:09:14 user nova-compute[75745]:     <imagelabel>+64055:+108</imagelabel>
Dec 01 17:09:14 user nova-compute[75745]:   </seclabel>
Dec 01 17:09:14 user nova-compute[75745]: </domain>
Dec 01 17:09:14 user nova-compute[75745]:  {{(pid=75745) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Dec 01 17:09:14 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-402a7045-4962-490e-b90b-21fd9cd5f68c tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Successfully detached device tap8b8877f6-91 from instance 02715ae1-5200-4df5-8430-2f19a610d2bb from the live domain config.
Dec 01 17:09:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-402a7045-4962-490e-b90b-21fd9cd5f68c tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-307822093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-307822093',id=7,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcs8sgcxWpvAhCDukezlQYcNLHeLOr5mWfJj0puItGCkRZJXOGQ6MpM5uepe4ipPhQinPlSmQOH6fLeiZ2h4cJWUaoqQV3toeXUomzqHJu8XbHvxkd2bF7E/efoK+eL7A==',key_name='tempest-keypair-903294596',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:06:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5275e723c904fa183974b49d4530824',ramdisk_id='',reservation_id='r-1wsmmw87',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-161209440',owner_user_name='tempest-TaggedAttachmentsTest-161209440-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:06:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77cc6ad71fa84904acd8d24eec648c94',uuid=02715ae1-5200-4df5-8430-2f19a610d2bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b8877f6-9183-46cb-964f-089f6b197d1e", "address": "fa:16:3e:d5:67:2f", "network": {"id": "26980f90-5a9d-43ef-b565-452f33c31c2d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2066230581", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d5275e723c904fa183974b49d4530824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8877f6-91", "ovs_interfaceid": "8b8877f6-9183-46cb-964f-089f6b197d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-402a7045-4962-490e-b90b-21fd9cd5f68c tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Converting VIF {"id": "8b8877f6-9183-46cb-964f-089f6b197d1e", "address": "fa:16:3e:d5:67:2f", "network": {"id": "26980f90-5a9d-43ef-b565-452f33c31c2d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2066230581", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d5275e723c904fa183974b49d4530824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8877f6-91", "ovs_interfaceid": "8b8877f6-9183-46cb-964f-089f6b197d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-402a7045-4962-490e-b90b-21fd9cd5f68c tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:67:2f,bridge_name='br-int',has_traffic_filtering=True,id=8b8877f6-9183-46cb-964f-089f6b197d1e,network=Network(26980f90-5a9d-43ef-b565-452f33c31c2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8877f6-91') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG os_vif [None req-402a7045-4962-490e-b90b-21fd9cd5f68c tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:67:2f,bridge_name='br-int',has_traffic_filtering=True,id=8b8877f6-9183-46cb-964f-089f6b197d1e,network=Network(26980f90-5a9d-43ef-b565-452f33c31c2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8877f6-91') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b8877f6-91, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5e68270a-df6d-4e6b-8af9-37d1a76c7f99) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:14 user nova-compute[75745]: INFO os_vif [None req-402a7045-4962-490e-b90b-21fd9cd5f68c tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:67:2f,bridge_name='br-int',has_traffic_filtering=True,id=8b8877f6-9183-46cb-964f-089f6b197d1e,network=Network(26980f90-5a9d-43ef-b565-452f33c31c2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8877f6-91')
Dec 01 17:09:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-402a7045-4962-490e-b90b-21fd9cd5f68c tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:09:14 user nova-compute[75745]:   <nova:package version="0.0.0"/>
Dec 01 17:09:14 user nova-compute[75745]:   <nova:name>tempest-device-tagging-server-307822093</nova:name>
Dec 01 17:09:14 user nova-compute[75745]:   <nova:creationTime>2023-12-01 17:09:14</nova:creationTime>
Dec 01 17:09:14 user nova-compute[75745]:   <nova:flavor name="m1.tiny">
Dec 01 17:09:14 user nova-compute[75745]:     <nova:memory>512</nova:memory>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:disk>1</nova:disk>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:swap>0</nova:swap>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:vcpus>1</nova:vcpus>
Dec 01 17:09:14 user nova-compute[75745]:   </nova:flavor>
Dec 01 17:09:14 user nova-compute[75745]:   <nova:owner>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:user uuid="77cc6ad71fa84904acd8d24eec648c94">tempest-TaggedAttachmentsTest-161209440-project-member</nova:user>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:project uuid="d5275e723c904fa183974b49d4530824">tempest-TaggedAttachmentsTest-161209440</nova:project>
Dec 01 17:09:14 user nova-compute[75745]:   </nova:owner>
Dec 01 17:09:14 user nova-compute[75745]:   <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:09:14 user nova-compute[75745]:   <nova:ports>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:port uuid="f2e5d5e1-b6be-444f-b8b6-c8f26cef560b">
Dec 01 17:09:14 user nova-compute[75745]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 01 17:09:14 user nova-compute[75745]:     </nova:port>
Dec 01 17:09:14 user nova-compute[75745]:   </nova:ports>
Dec 01 17:09:14 user nova-compute[75745]: </nova:instance>
Dec 01 17:09:14 user nova-compute[75745]:  {{(pid=75745) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG nova.network.neutron [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Successfully updated port: d3079bd2-25ea-432b-a601-9bb7502fe9c8 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Acquiring lock "refresh_cache-71504d5d-0999-4960-8782-b454cb407e9f" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Acquired lock "refresh_cache-71504d5d-0999-4960-8782-b454cb407e9f" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG nova.network.neutron [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG nova.network.neutron [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG nova.compute.manager [req-33371b33-8761-463c-8da7-1660c73a5ee8 req-0d877ff9-6174-4d8f-8fa3-13adb6e0e8dd service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Received event network-changed-d3079bd2-25ea-432b-a601-9bb7502fe9c8 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG nova.compute.manager [req-33371b33-8761-463c-8da7-1660c73a5ee8 req-0d877ff9-6174-4d8f-8fa3-13adb6e0e8dd service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Refreshing instance network info cache due to event network-changed-d3079bd2-25ea-432b-a601-9bb7502fe9c8. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-33371b33-8761-463c-8da7-1660c73a5ee8 req-0d877ff9-6174-4d8f-8fa3-13adb6e0e8dd service nova] Acquiring lock "refresh_cache-71504d5d-0999-4960-8782-b454cb407e9f" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG nova.compute.manager [req-e02f7bab-c2c2-4226-95bd-8ce65894aa10 req-270b82da-b334-4402-9724-92ff1073fd8b service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Received event network-vif-deleted-8b8877f6-9183-46cb-964f-089f6b197d1e {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:09:14 user nova-compute[75745]: INFO nova.compute.manager [req-e02f7bab-c2c2-4226-95bd-8ce65894aa10 req-270b82da-b334-4402-9724-92ff1073fd8b service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Neutron deleted interface 8b8877f6-9183-46cb-964f-089f6b197d1e; detaching it from the instance and deleting it from the info cache
Dec 01 17:09:14 user nova-compute[75745]: DEBUG nova.network.neutron [req-e02f7bab-c2c2-4226-95bd-8ce65894aa10 req-270b82da-b334-4402-9724-92ff1073fd8b service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Updating instance_info_cache with network_info: [{"id": "f2e5d5e1-b6be-444f-b8b6-c8f26cef560b", "address": "fa:16:3e:ff:a2:43", "network": {"id": "32e8e577-9bad-40af-b8e3-cb700c5f2ddf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-262107762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5275e723c904fa183974b49d4530824", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e5d5e1-b6", "ovs_interfaceid": "f2e5d5e1-b6be-444f-b8b6-c8f26cef560b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-402a7045-4962-490e-b90b-21fd9cd5f68c tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Acquiring lock "refresh_cache-02715ae1-5200-4df5-8430-2f19a610d2bb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-402a7045-4962-490e-b90b-21fd9cd5f68c tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Acquired lock "refresh_cache-02715ae1-5200-4df5-8430-2f19a610d2bb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG nova.network.neutron [None req-402a7045-4962-490e-b90b-21fd9cd5f68c tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG nova.objects.instance [req-e02f7bab-c2c2-4226-95bd-8ce65894aa10 req-270b82da-b334-4402-9724-92ff1073fd8b service nova] Lazy-loading 'system_metadata' on Instance uuid 02715ae1-5200-4df5-8430-2f19a610d2bb {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG nova.objects.instance [req-e02f7bab-c2c2-4226-95bd-8ce65894aa10 req-270b82da-b334-4402-9724-92ff1073fd8b service nova] Lazy-loading 'flavor' on Instance uuid 02715ae1-5200-4df5-8430-2f19a610d2bb {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG nova.objects.base [req-e02f7bab-c2c2-4226-95bd-8ce65894aa10 req-270b82da-b334-4402-9724-92ff1073fd8b service nova] Object Instance<02715ae1-5200-4df5-8430-2f19a610d2bb> lazy-loaded attributes: system_metadata,flavor {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [req-e02f7bab-c2c2-4226-95bd-8ce65894aa10 req-270b82da-b334-4402-9724-92ff1073fd8b service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-307822093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-307822093',id=7,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcs8sgcxWpvAhCDukezlQYcNLHeLOr5mWfJj0puItGCkRZJXOGQ6MpM5uepe4ipPhQinPlSmQOH6fLeiZ2h4cJWUaoqQV3toeXUomzqHJu8XbHvxkd2bF7E/efoK+eL7A==',key_name='tempest-keypair-903294596',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:06:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5275e723c904fa183974b49d4530824',ramdisk_id='',reservation_id='r-1wsmmw87',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-161209440',owner_user_name='tempest-TaggedAttachmentsTest-161209440-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:06:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77cc6ad71fa84904acd8d24eec648c94',uuid=02715ae1-5200-4df5-8430-2f19a610d2bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b8877f6-9183-46cb-964f-089f6b197d1e", "address": "fa:16:3e:d5:67:2f", "network": {"id": "26980f90-5a9d-43ef-b565-452f33c31c2d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2066230581", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d5275e723c904fa183974b49d4530824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8877f6-91", "ovs_interfaceid": "8b8877f6-9183-46cb-964f-089f6b197d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG nova.network.os_vif_util [req-e02f7bab-c2c2-4226-95bd-8ce65894aa10 req-270b82da-b334-4402-9724-92ff1073fd8b service nova] Converting VIF {"id": "8b8877f6-9183-46cb-964f-089f6b197d1e", "address": "fa:16:3e:d5:67:2f", "network": {"id": "26980f90-5a9d-43ef-b565-452f33c31c2d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2066230581", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d5275e723c904fa183974b49d4530824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8877f6-91", "ovs_interfaceid": "8b8877f6-9183-46cb-964f-089f6b197d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG nova.network.os_vif_util [req-e02f7bab-c2c2-4226-95bd-8ce65894aa10 req-270b82da-b334-4402-9724-92ff1073fd8b service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:67:2f,bridge_name='br-int',has_traffic_filtering=True,id=8b8877f6-9183-46cb-964f-089f6b197d1e,network=Network(26980f90-5a9d-43ef-b565-452f33c31c2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8877f6-91') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [req-e02f7bab-c2c2-4226-95bd-8ce65894aa10 req-270b82da-b334-4402-9724-92ff1073fd8b service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d5:67:2f"/><model type="virtio"/><mtu size="1442"/><target dev="tap8b8877f6-91"/></interface> {{(pid=75745) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG nova.network.neutron [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Updating instance_info_cache with network_info: [{"id": "d3079bd2-25ea-432b-a601-9bb7502fe9c8", "address": "fa:16:3e:3a:86:18", "network": {"id": "b05bdd5e-502b-4f25-bef1-0b17b23a0765", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1245857440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a2dd2fc4fef47d584dd73c8bf3e42ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3079bd2-25", "ovs_interfaceid": "d3079bd2-25ea-432b-a601-9bb7502fe9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [req-e02f7bab-c2c2-4226-95bd-8ce65894aa10 req-270b82da-b334-4402-9724-92ff1073fd8b service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d5:67:2f"/><model type="virtio"/><mtu size="1442"/><target dev="tap8b8877f6-91"/></interface>not found in domain: <domain type='kvm' id='7'>
Dec 01 17:09:14 user nova-compute[75745]:   <name>instance-00000007</name>
Dec 01 17:09:14 user nova-compute[75745]:   <uuid>02715ae1-5200-4df5-8430-2f19a610d2bb</uuid>
Dec 01 17:09:14 user nova-compute[75745]:   <metadata>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:09:14 user nova-compute[75745]:   <nova:package version="0.0.0"/>
Dec 01 17:09:14 user nova-compute[75745]:   <nova:name>tempest-device-tagging-server-307822093</nova:name>
Dec 01 17:09:14 user nova-compute[75745]:   <nova:creationTime>2023-12-01 17:09:14</nova:creationTime>
Dec 01 17:09:14 user nova-compute[75745]:   <nova:flavor name="m1.tiny">
Dec 01 17:09:14 user nova-compute[75745]:     <nova:memory>512</nova:memory>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:disk>1</nova:disk>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:swap>0</nova:swap>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:vcpus>1</nova:vcpus>
Dec 01 17:09:14 user nova-compute[75745]:   </nova:flavor>
Dec 01 17:09:14 user nova-compute[75745]:   <nova:owner>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:user uuid="77cc6ad71fa84904acd8d24eec648c94">tempest-TaggedAttachmentsTest-161209440-project-member</nova:user>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:project uuid="d5275e723c904fa183974b49d4530824">tempest-TaggedAttachmentsTest-161209440</nova:project>
Dec 01 17:09:14 user nova-compute[75745]:   </nova:owner>
Dec 01 17:09:14 user nova-compute[75745]:   <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:09:14 user nova-compute[75745]:   <nova:ports>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:port uuid="f2e5d5e1-b6be-444f-b8b6-c8f26cef560b">
Dec 01 17:09:14 user nova-compute[75745]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 01 17:09:14 user nova-compute[75745]:     </nova:port>
Dec 01 17:09:14 user nova-compute[75745]:   </nova:ports>
Dec 01 17:09:14 user nova-compute[75745]: </nova:instance>
Dec 01 17:09:14 user nova-compute[75745]:   </metadata>
Dec 01 17:09:14 user nova-compute[75745]:   <memory unit='KiB'>524288</memory>
Dec 01 17:09:14 user nova-compute[75745]:   <currentMemory unit='KiB'>524288</currentMemory>
Dec 01 17:09:14 user nova-compute[75745]:   <vcpu placement='static'>1</vcpu>
Dec 01 17:09:14 user nova-compute[75745]:   <resource>
Dec 01 17:09:14 user nova-compute[75745]:     <partition>/machine</partition>
Dec 01 17:09:14 user nova-compute[75745]:   </resource>
Dec 01 17:09:14 user nova-compute[75745]:   <sysinfo type='smbios'>
Dec 01 17:09:14 user nova-compute[75745]:     <system>
Dec 01 17:09:14 user nova-compute[75745]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Dec 01 17:09:14 user nova-compute[75745]:       <entry name='product'>OpenStack Nova</entry>
Dec 01 17:09:14 user nova-compute[75745]:       <entry name='version'>0.0.0</entry>
Dec 01 17:09:14 user nova-compute[75745]:       <entry name='serial'>02715ae1-5200-4df5-8430-2f19a610d2bb</entry>
Dec 01 17:09:14 user nova-compute[75745]:       <entry name='uuid'>02715ae1-5200-4df5-8430-2f19a610d2bb</entry>
Dec 01 17:09:14 user nova-compute[75745]:       <entry name='family'>Virtual Machine</entry>
Dec 01 17:09:14 user nova-compute[75745]:     </system>
Dec 01 17:09:14 user nova-compute[75745]:   </sysinfo>
Dec 01 17:09:14 user nova-compute[75745]:   <os>
Dec 01 17:09:14 user nova-compute[75745]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Dec 01 17:09:14 user nova-compute[75745]:     <boot dev='hd'/>
Dec 01 17:09:14 user nova-compute[75745]:     <smbios mode='sysinfo'/>
Dec 01 17:09:14 user nova-compute[75745]:   </os>
Dec 01 17:09:14 user nova-compute[75745]:   <features>
Dec 01 17:09:14 user nova-compute[75745]:     <acpi/>
Dec 01 17:09:14 user nova-compute[75745]:     <apic/>
Dec 01 17:09:14 user nova-compute[75745]:     <vmcoreinfo state='on'/>
Dec 01 17:09:14 user nova-compute[75745]:   </features>
Dec 01 17:09:14 user nova-compute[75745]:   <cpu mode='custom' match='exact' check='full'>
Dec 01 17:09:14 user nova-compute[75745]:     <model fallback='forbid'>Nehalem</model>
Dec 01 17:09:14 user nova-compute[75745]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Dec 01 17:09:14 user nova-compute[75745]:     <feature policy='require' name='vme'/>
Dec 01 17:09:14 user nova-compute[75745]:     <feature policy='require' name='x2apic'/>
Dec 01 17:09:14 user nova-compute[75745]:     <feature policy='require' name='hypervisor'/>
Dec 01 17:09:14 user nova-compute[75745]:   </cpu>
Dec 01 17:09:14 user nova-compute[75745]:   <clock offset='utc'>
Dec 01 17:09:14 user nova-compute[75745]:     <timer name='pit' tickpolicy='delay'/>
Dec 01 17:09:14 user nova-compute[75745]:     <timer name='rtc' tickpolicy='catchup'/>
Dec 01 17:09:14 user nova-compute[75745]:     <timer name='hpet' present='no'/>
Dec 01 17:09:14 user nova-compute[75745]:   </clock>
Dec 01 17:09:14 user nova-compute[75745]:   <on_poweroff>destroy</on_poweroff>
Dec 01 17:09:14 user nova-compute[75745]:   <on_reboot>restart</on_reboot>
Dec 01 17:09:14 user nova-compute[75745]:   <on_crash>destroy</on_crash>
Dec 01 17:09:14 user nova-compute[75745]:   <devices>
Dec 01 17:09:14 user nova-compute[75745]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 01 17:09:14 user nova-compute[75745]:     <disk type='file' device='disk'>
Dec 01 17:09:14 user nova-compute[75745]:       <driver name='qemu' type='qcow2' cache='none'/>
Dec 01 17:09:14 user nova-compute[75745]:       <source file='/opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk' index='2'/>
Dec 01 17:09:14 user nova-compute[75745]:       <backingStore type='file' index='3'>
Dec 01 17:09:14 user nova-compute[75745]:         <format type='raw'/>
Dec 01 17:09:14 user nova-compute[75745]:         <source file='/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf'/>
Dec 01 17:09:14 user nova-compute[75745]:         <backingStore/>
Dec 01 17:09:14 user nova-compute[75745]:       </backingStore>
Dec 01 17:09:14 user nova-compute[75745]:       <target dev='vda' bus='virtio'/>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='virtio-disk0'/>
Dec 01 17:09:14 user nova-compute[75745]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Dec 01 17:09:14 user nova-compute[75745]:     </disk>
Dec 01 17:09:14 user nova-compute[75745]:     <disk type='file' device='cdrom'>
Dec 01 17:09:14 user nova-compute[75745]:       <driver name='qemu' type='raw' cache='none'/>
Dec 01 17:09:14 user nova-compute[75745]:       <source file='/opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk.config' index='1'/>
Dec 01 17:09:14 user nova-compute[75745]:       <backingStore/>
Dec 01 17:09:14 user nova-compute[75745]:       <target dev='hda' bus='ide'/>
Dec 01 17:09:14 user nova-compute[75745]:       <readonly/>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='ide0-0-0'/>
Dec 01 17:09:14 user nova-compute[75745]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Dec 01 17:09:14 user nova-compute[75745]:     </disk>
Dec 01 17:09:14 user nova-compute[75745]:     <controller type='usb' index='0' model='none'>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='usb'/>
Dec 01 17:09:14 user nova-compute[75745]:     </controller>
Dec 01 17:09:14 user nova-compute[75745]:     <controller type='pci' index='0' model='pci-root'>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='pci.0'/>
Dec 01 17:09:14 user nova-compute[75745]:     </controller>
Dec 01 17:09:14 user nova-compute[75745]:     <controller type='ide' index='0'>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='ide'/>
Dec 01 17:09:14 user nova-compute[75745]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Dec 01 17:09:14 user nova-compute[75745]:     </controller>
Dec 01 17:09:14 user nova-compute[75745]:     <interface type='ethernet'>
Dec 01 17:09:14 user nova-compute[75745]:       <mac address='fa:16:3e:ff:a2:43'/>
Dec 01 17:09:14 user nova-compute[75745]:       <target dev='tapf2e5d5e1-b6'/>
Dec 01 17:09:14 user nova-compute[75745]:       <model type='virtio'/>
Dec 01 17:09:14 user nova-compute[75745]:       <mtu size='1442'/>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='net0'/>
Dec 01 17:09:14 user nova-compute[75745]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Dec 01 17:09:14 user nova-compute[75745]:     </interface>
Dec 01 17:09:14 user nova-compute[75745]:     <serial type='pty'>
Dec 01 17:09:14 user nova-compute[75745]:       <source path='/dev/pts/6'/>
Dec 01 17:09:14 user nova-compute[75745]:       <log file='/opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/console.log' append='off'/>
Dec 01 17:09:14 user nova-compute[75745]:       <target type='isa-serial' port='0'>
Dec 01 17:09:14 user nova-compute[75745]:         <model name='isa-serial'/>
Dec 01 17:09:14 user nova-compute[75745]:       </target>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='serial0'/>
Dec 01 17:09:14 user nova-compute[75745]:     </serial>
Dec 01 17:09:14 user nova-compute[75745]:     <console type='pty' tty='/dev/pts/6'>
Dec 01 17:09:14 user nova-compute[75745]:       <source path='/dev/pts/6'/>
Dec 01 17:09:14 user nova-compute[75745]:       <log file='/opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/console.log' append='off'/>
Dec 01 17:09:14 user nova-compute[75745]:       <target type='serial' port='0'/>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='serial0'/>
Dec 01 17:09:14 user nova-compute[75745]:     </console>
Dec 01 17:09:14 user nova-compute[75745]:     <input type='mouse' bus='ps2'>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='input0'/>
Dec 01 17:09:14 user nova-compute[75745]:     </input>
Dec 01 17:09:14 user nova-compute[75745]:     <input type='keyboard' bus='ps2'>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='input1'/>
Dec 01 17:09:14 user nova-compute[75745]:     </input>
Dec 01 17:09:14 user nova-compute[75745]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Dec 01 17:09:14 user nova-compute[75745]:       <listen type='address' address='0.0.0.0'/>
Dec 01 17:09:14 user nova-compute[75745]:     </graphics>
Dec 01 17:09:14 user nova-compute[75745]:     <audio id='1' type='none'/>
Dec 01 17:09:14 user nova-compute[75745]:     <video>
Dec 01 17:09:14 user nova-compute[75745]:       <model type='virtio' heads='1' primary='yes'/>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='video0'/>
Dec 01 17:09:14 user nova-compute[75745]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Dec 01 17:09:14 user nova-compute[75745]:     </video>
Dec 01 17:09:14 user nova-compute[75745]:     <memballoon model='virtio'>
Dec 01 17:09:14 user nova-compute[75745]:       <stats period='10'/>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='balloon0'/>
Dec 01 17:09:14 user nova-compute[75745]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Dec 01 17:09:14 user nova-compute[75745]:     </memballoon>
Dec 01 17:09:14 user nova-compute[75745]:     <rng model='virtio'>
Dec 01 17:09:14 user nova-compute[75745]:       <backend model='random'>/dev/urandom</backend>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='rng0'/>
Dec 01 17:09:14 user nova-compute[75745]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Dec 01 17:09:14 user nova-compute[75745]:     </rng>
Dec 01 17:09:14 user nova-compute[75745]:   </devices>
Dec 01 17:09:14 user nova-compute[75745]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Dec 01 17:09:14 user nova-compute[75745]:     <label>libvirt-02715ae1-5200-4df5-8430-2f19a610d2bb</label>
Dec 01 17:09:14 user nova-compute[75745]:     <imagelabel>libvirt-02715ae1-5200-4df5-8430-2f19a610d2bb</imagelabel>
Dec 01 17:09:14 user nova-compute[75745]:   </seclabel>
Dec 01 17:09:14 user nova-compute[75745]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Dec 01 17:09:14 user nova-compute[75745]:     <label>+64055:+108</label>
Dec 01 17:09:14 user nova-compute[75745]:     <imagelabel>+64055:+108</imagelabel>
Dec 01 17:09:14 user nova-compute[75745]:   </seclabel>
Dec 01 17:09:14 user nova-compute[75745]: </domain>
Dec 01 17:09:14 user nova-compute[75745]:  {{(pid=75745) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [req-e02f7bab-c2c2-4226-95bd-8ce65894aa10 req-270b82da-b334-4402-9724-92ff1073fd8b service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d5:67:2f"/><model type="virtio"/><mtu size="1442"/><target dev="tap8b8877f6-91"/></interface> {{(pid=75745) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [req-e02f7bab-c2c2-4226-95bd-8ce65894aa10 req-270b82da-b334-4402-9724-92ff1073fd8b service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d5:67:2f"/><model type="virtio"/><mtu size="1442"/><target dev="tap8b8877f6-91"/></interface>not found in domain: <domain type='kvm' id='7'>
Dec 01 17:09:14 user nova-compute[75745]:   <name>instance-00000007</name>
Dec 01 17:09:14 user nova-compute[75745]:   <uuid>02715ae1-5200-4df5-8430-2f19a610d2bb</uuid>
Dec 01 17:09:14 user nova-compute[75745]:   <metadata>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:09:14 user nova-compute[75745]:   <nova:package version="0.0.0"/>
Dec 01 17:09:14 user nova-compute[75745]:   <nova:name>tempest-device-tagging-server-307822093</nova:name>
Dec 01 17:09:14 user nova-compute[75745]:   <nova:creationTime>2023-12-01 17:09:14</nova:creationTime>
Dec 01 17:09:14 user nova-compute[75745]:   <nova:flavor name="m1.tiny">
Dec 01 17:09:14 user nova-compute[75745]:     <nova:memory>512</nova:memory>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:disk>1</nova:disk>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:swap>0</nova:swap>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:vcpus>1</nova:vcpus>
Dec 01 17:09:14 user nova-compute[75745]:   </nova:flavor>
Dec 01 17:09:14 user nova-compute[75745]:   <nova:owner>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:user uuid="77cc6ad71fa84904acd8d24eec648c94">tempest-TaggedAttachmentsTest-161209440-project-member</nova:user>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:project uuid="d5275e723c904fa183974b49d4530824">tempest-TaggedAttachmentsTest-161209440</nova:project>
Dec 01 17:09:14 user nova-compute[75745]:   </nova:owner>
Dec 01 17:09:14 user nova-compute[75745]:   <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:09:14 user nova-compute[75745]:   <nova:ports>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:port uuid="f2e5d5e1-b6be-444f-b8b6-c8f26cef560b">
Dec 01 17:09:14 user nova-compute[75745]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 01 17:09:14 user nova-compute[75745]:     </nova:port>
Dec 01 17:09:14 user nova-compute[75745]:   </nova:ports>
Dec 01 17:09:14 user nova-compute[75745]: </nova:instance>
Dec 01 17:09:14 user nova-compute[75745]:   </metadata>
Dec 01 17:09:14 user nova-compute[75745]:   <memory unit='KiB'>524288</memory>
Dec 01 17:09:14 user nova-compute[75745]:   <currentMemory unit='KiB'>524288</currentMemory>
Dec 01 17:09:14 user nova-compute[75745]:   <vcpu placement='static'>1</vcpu>
Dec 01 17:09:14 user nova-compute[75745]:   <resource>
Dec 01 17:09:14 user nova-compute[75745]:     <partition>/machine</partition>
Dec 01 17:09:14 user nova-compute[75745]:   </resource>
Dec 01 17:09:14 user nova-compute[75745]:   <sysinfo type='smbios'>
Dec 01 17:09:14 user nova-compute[75745]:     <system>
Dec 01 17:09:14 user nova-compute[75745]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Dec 01 17:09:14 user nova-compute[75745]:       <entry name='product'>OpenStack Nova</entry>
Dec 01 17:09:14 user nova-compute[75745]:       <entry name='version'>0.0.0</entry>
Dec 01 17:09:14 user nova-compute[75745]:       <entry name='serial'>02715ae1-5200-4df5-8430-2f19a610d2bb</entry>
Dec 01 17:09:14 user nova-compute[75745]:       <entry name='uuid'>02715ae1-5200-4df5-8430-2f19a610d2bb</entry>
Dec 01 17:09:14 user nova-compute[75745]:       <entry name='family'>Virtual Machine</entry>
Dec 01 17:09:14 user nova-compute[75745]:     </system>
Dec 01 17:09:14 user nova-compute[75745]:   </sysinfo>
Dec 01 17:09:14 user nova-compute[75745]:   <os>
Dec 01 17:09:14 user nova-compute[75745]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Dec 01 17:09:14 user nova-compute[75745]:     <boot dev='hd'/>
Dec 01 17:09:14 user nova-compute[75745]:     <smbios mode='sysinfo'/>
Dec 01 17:09:14 user nova-compute[75745]:   </os>
Dec 01 17:09:14 user nova-compute[75745]:   <features>
Dec 01 17:09:14 user nova-compute[75745]:     <acpi/>
Dec 01 17:09:14 user nova-compute[75745]:     <apic/>
Dec 01 17:09:14 user nova-compute[75745]:     <vmcoreinfo state='on'/>
Dec 01 17:09:14 user nova-compute[75745]:   </features>
Dec 01 17:09:14 user nova-compute[75745]:   <cpu mode='custom' match='exact' check='full'>
Dec 01 17:09:14 user nova-compute[75745]:     <model fallback='forbid'>Nehalem</model>
Dec 01 17:09:14 user nova-compute[75745]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Dec 01 17:09:14 user nova-compute[75745]:     <feature policy='require' name='vme'/>
Dec 01 17:09:14 user nova-compute[75745]:     <feature policy='require' name='x2apic'/>
Dec 01 17:09:14 user nova-compute[75745]:     <feature policy='require' name='hypervisor'/>
Dec 01 17:09:14 user nova-compute[75745]:   </cpu>
Dec 01 17:09:14 user nova-compute[75745]:   <clock offset='utc'>
Dec 01 17:09:14 user nova-compute[75745]:     <timer name='pit' tickpolicy='delay'/>
Dec 01 17:09:14 user nova-compute[75745]:     <timer name='rtc' tickpolicy='catchup'/>
Dec 01 17:09:14 user nova-compute[75745]:     <timer name='hpet' present='no'/>
Dec 01 17:09:14 user nova-compute[75745]:   </clock>
Dec 01 17:09:14 user nova-compute[75745]:   <on_poweroff>destroy</on_poweroff>
Dec 01 17:09:14 user nova-compute[75745]:   <on_reboot>restart</on_reboot>
Dec 01 17:09:14 user nova-compute[75745]:   <on_crash>destroy</on_crash>
Dec 01 17:09:14 user nova-compute[75745]:   <devices>
Dec 01 17:09:14 user nova-compute[75745]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 01 17:09:14 user nova-compute[75745]:     <disk type='file' device='disk'>
Dec 01 17:09:14 user nova-compute[75745]:       <driver name='qemu' type='qcow2' cache='none'/>
Dec 01 17:09:14 user nova-compute[75745]:       <source file='/opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk' index='2'/>
Dec 01 17:09:14 user nova-compute[75745]:       <backingStore type='file' index='3'>
Dec 01 17:09:14 user nova-compute[75745]:         <format type='raw'/>
Dec 01 17:09:14 user nova-compute[75745]:         <source file='/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf'/>
Dec 01 17:09:14 user nova-compute[75745]:         <backingStore/>
Dec 01 17:09:14 user nova-compute[75745]:       </backingStore>
Dec 01 17:09:14 user nova-compute[75745]:       <target dev='vda' bus='virtio'/>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='virtio-disk0'/>
Dec 01 17:09:14 user nova-compute[75745]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Dec 01 17:09:14 user nova-compute[75745]:     </disk>
Dec 01 17:09:14 user nova-compute[75745]:     <disk type='file' device='cdrom'>
Dec 01 17:09:14 user nova-compute[75745]:       <driver name='qemu' type='raw' cache='none'/>
Dec 01 17:09:14 user nova-compute[75745]:       <source file='/opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk.config' index='1'/>
Dec 01 17:09:14 user nova-compute[75745]:       <backingStore/>
Dec 01 17:09:14 user nova-compute[75745]:       <target dev='hda' bus='ide'/>
Dec 01 17:09:14 user nova-compute[75745]:       <readonly/>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='ide0-0-0'/>
Dec 01 17:09:14 user nova-compute[75745]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Dec 01 17:09:14 user nova-compute[75745]:     </disk>
Dec 01 17:09:14 user nova-compute[75745]:     <controller type='usb' index='0' model='none'>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='usb'/>
Dec 01 17:09:14 user nova-compute[75745]:     </controller>
Dec 01 17:09:14 user nova-compute[75745]:     <controller type='pci' index='0' model='pci-root'>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='pci.0'/>
Dec 01 17:09:14 user nova-compute[75745]:     </controller>
Dec 01 17:09:14 user nova-compute[75745]:     <controller type='ide' index='0'>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='ide'/>
Dec 01 17:09:14 user nova-compute[75745]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Dec 01 17:09:14 user nova-compute[75745]:     </controller>
Dec 01 17:09:14 user nova-compute[75745]:     <interface type='ethernet'>
Dec 01 17:09:14 user nova-compute[75745]:       <mac address='fa:16:3e:ff:a2:43'/>
Dec 01 17:09:14 user nova-compute[75745]:       <target dev='tapf2e5d5e1-b6'/>
Dec 01 17:09:14 user nova-compute[75745]:       <model type='virtio'/>
Dec 01 17:09:14 user nova-compute[75745]:       <mtu size='1442'/>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='net0'/>
Dec 01 17:09:14 user nova-compute[75745]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Dec 01 17:09:14 user nova-compute[75745]:     </interface>
Dec 01 17:09:14 user nova-compute[75745]:     <serial type='pty'>
Dec 01 17:09:14 user nova-compute[75745]:       <source path='/dev/pts/6'/>
Dec 01 17:09:14 user nova-compute[75745]:       <log file='/opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/console.log' append='off'/>
Dec 01 17:09:14 user nova-compute[75745]:       <target type='isa-serial' port='0'>
Dec 01 17:09:14 user nova-compute[75745]:         <model name='isa-serial'/>
Dec 01 17:09:14 user nova-compute[75745]:       </target>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='serial0'/>
Dec 01 17:09:14 user nova-compute[75745]:     </serial>
Dec 01 17:09:14 user nova-compute[75745]:     <console type='pty' tty='/dev/pts/6'>
Dec 01 17:09:14 user nova-compute[75745]:       <source path='/dev/pts/6'/>
Dec 01 17:09:14 user nova-compute[75745]:       <log file='/opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/console.log' append='off'/>
Dec 01 17:09:14 user nova-compute[75745]:       <target type='serial' port='0'/>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='serial0'/>
Dec 01 17:09:14 user nova-compute[75745]:     </console>
Dec 01 17:09:14 user nova-compute[75745]:     <input type='mouse' bus='ps2'>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='input0'/>
Dec 01 17:09:14 user nova-compute[75745]:     </input>
Dec 01 17:09:14 user nova-compute[75745]:     <input type='keyboard' bus='ps2'>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='input1'/>
Dec 01 17:09:14 user nova-compute[75745]:     </input>
Dec 01 17:09:14 user nova-compute[75745]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Dec 01 17:09:14 user nova-compute[75745]:       <listen type='address' address='0.0.0.0'/>
Dec 01 17:09:14 user nova-compute[75745]:     </graphics>
Dec 01 17:09:14 user nova-compute[75745]:     <audio id='1' type='none'/>
Dec 01 17:09:14 user nova-compute[75745]:     <video>
Dec 01 17:09:14 user nova-compute[75745]:       <model type='virtio' heads='1' primary='yes'/>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='video0'/>
Dec 01 17:09:14 user nova-compute[75745]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Dec 01 17:09:14 user nova-compute[75745]:     </video>
Dec 01 17:09:14 user nova-compute[75745]:     <memballoon model='virtio'>
Dec 01 17:09:14 user nova-compute[75745]:       <stats period='10'/>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='balloon0'/>
Dec 01 17:09:14 user nova-compute[75745]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Dec 01 17:09:14 user nova-compute[75745]:     </memballoon>
Dec 01 17:09:14 user nova-compute[75745]:     <rng model='virtio'>
Dec 01 17:09:14 user nova-compute[75745]:       <backend model='random'>/dev/urandom</backend>
Dec 01 17:09:14 user nova-compute[75745]:       <alias name='rng0'/>
Dec 01 17:09:14 user nova-compute[75745]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Dec 01 17:09:14 user nova-compute[75745]:     </rng>
Dec 01 17:09:14 user nova-compute[75745]:   </devices>
Dec 01 17:09:14 user nova-compute[75745]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Dec 01 17:09:14 user nova-compute[75745]:     <label>libvirt-02715ae1-5200-4df5-8430-2f19a610d2bb</label>
Dec 01 17:09:14 user nova-compute[75745]:     <imagelabel>libvirt-02715ae1-5200-4df5-8430-2f19a610d2bb</imagelabel>
Dec 01 17:09:14 user nova-compute[75745]:   </seclabel>
Dec 01 17:09:14 user nova-compute[75745]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Dec 01 17:09:14 user nova-compute[75745]:     <label>+64055:+108</label>
Dec 01 17:09:14 user nova-compute[75745]:     <imagelabel>+64055:+108</imagelabel>
Dec 01 17:09:14 user nova-compute[75745]:   </seclabel>
Dec 01 17:09:14 user nova-compute[75745]: </domain>
Dec 01 17:09:14 user nova-compute[75745]:  {{(pid=75745) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Dec 01 17:09:14 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [req-e02f7bab-c2c2-4226-95bd-8ce65894aa10 req-270b82da-b334-4402-9724-92ff1073fd8b service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Detaching interface fa:16:3e:d5:67:2f failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap8b8877f6-91' not found.
Dec 01 17:09:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [req-e02f7bab-c2c2-4226-95bd-8ce65894aa10 req-270b82da-b334-4402-9724-92ff1073fd8b service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-307822093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-307822093',id=7,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcs8sgcxWpvAhCDukezlQYcNLHeLOr5mWfJj0puItGCkRZJXOGQ6MpM5uepe4ipPhQinPlSmQOH6fLeiZ2h4cJWUaoqQV3toeXUomzqHJu8XbHvxkd2bF7E/efoK+eL7A==',key_name='tempest-keypair-903294596',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:06:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5275e723c904fa183974b49d4530824',ramdisk_id='',reservation_id='r-1wsmmw87',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-161209440',owner_user_name='tempest-TaggedAttachmentsTest-161209440-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:06:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77cc6ad71fa84904acd8d24eec648c94',uuid=02715ae1-5200-4df5-8430-2f19a610d2bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b8877f6-9183-46cb-964f-089f6b197d1e", "address": "fa:16:3e:d5:67:2f", "network": {"id": "26980f90-5a9d-43ef-b565-452f33c31c2d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2066230581", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d5275e723c904fa183974b49d4530824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8877f6-91", "ovs_interfaceid": "8b8877f6-9183-46cb-964f-089f6b197d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG nova.network.os_vif_util [req-e02f7bab-c2c2-4226-95bd-8ce65894aa10 req-270b82da-b334-4402-9724-92ff1073fd8b service nova] Converting VIF {"id": "8b8877f6-9183-46cb-964f-089f6b197d1e", "address": "fa:16:3e:d5:67:2f", "network": {"id": "26980f90-5a9d-43ef-b565-452f33c31c2d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2066230581", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d5275e723c904fa183974b49d4530824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8877f6-91", "ovs_interfaceid": "8b8877f6-9183-46cb-964f-089f6b197d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG nova.network.os_vif_util [req-e02f7bab-c2c2-4226-95bd-8ce65894aa10 req-270b82da-b334-4402-9724-92ff1073fd8b service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:67:2f,bridge_name='br-int',has_traffic_filtering=True,id=8b8877f6-9183-46cb-964f-089f6b197d1e,network=Network(26980f90-5a9d-43ef-b565-452f33c31c2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8877f6-91') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG os_vif [req-e02f7bab-c2c2-4226-95bd-8ce65894aa10 req-270b82da-b334-4402-9724-92ff1073fd8b service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:67:2f,bridge_name='br-int',has_traffic_filtering=True,id=8b8877f6-9183-46cb-964f-089f6b197d1e,network=Network(26980f90-5a9d-43ef-b565-452f33c31c2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8877f6-91') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Releasing lock "refresh_cache-71504d5d-0999-4960-8782-b454cb407e9f" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG nova.compute.manager [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Instance network_info: |[{"id": "d3079bd2-25ea-432b-a601-9bb7502fe9c8", "address": "fa:16:3e:3a:86:18", "network": {"id": "b05bdd5e-502b-4f25-bef1-0b17b23a0765", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1245857440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a2dd2fc4fef47d584dd73c8bf3e42ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3079bd2-25", "ovs_interfaceid": "d3079bd2-25ea-432b-a601-9bb7502fe9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b8877f6-91, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-33371b33-8761-463c-8da7-1660c73a5ee8 req-0d877ff9-6174-4d8f-8fa3-13adb6e0e8dd service nova] Acquired lock "refresh_cache-71504d5d-0999-4960-8782-b454cb407e9f" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:09:14 user nova-compute[75745]: DEBUG nova.network.neutron [req-33371b33-8761-463c-8da7-1660c73a5ee8 req-0d877ff9-6174-4d8f-8fa3-13adb6e0e8dd service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Refreshing network info cache for port d3079bd2-25ea-432b-a601-9bb7502fe9c8 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:09:14 user nova-compute[75745]: INFO os_vif [req-e02f7bab-c2c2-4226-95bd-8ce65894aa10 req-270b82da-b334-4402-9724-92ff1073fd8b service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:67:2f,bridge_name='br-int',has_traffic_filtering=True,id=8b8877f6-9183-46cb-964f-089f6b197d1e,network=Network(26980f90-5a9d-43ef-b565-452f33c31c2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8877f6-91')
Dec 01 17:09:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [req-e02f7bab-c2c2-4226-95bd-8ce65894aa10 req-270b82da-b334-4402-9724-92ff1073fd8b service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:09:14 user nova-compute[75745]:   <nova:package version="0.0.0"/>
Dec 01 17:09:14 user nova-compute[75745]:   <nova:name>tempest-device-tagging-server-307822093</nova:name>
Dec 01 17:09:14 user nova-compute[75745]:   <nova:creationTime>2023-12-01 17:09:14</nova:creationTime>
Dec 01 17:09:14 user nova-compute[75745]:   <nova:flavor name="m1.tiny">
Dec 01 17:09:14 user nova-compute[75745]:     <nova:memory>512</nova:memory>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:disk>1</nova:disk>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:swap>0</nova:swap>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:vcpus>1</nova:vcpus>
Dec 01 17:09:14 user nova-compute[75745]:   </nova:flavor>
Dec 01 17:09:14 user nova-compute[75745]:   <nova:owner>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:user uuid="77cc6ad71fa84904acd8d24eec648c94">tempest-TaggedAttachmentsTest-161209440-project-member</nova:user>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:project uuid="d5275e723c904fa183974b49d4530824">tempest-TaggedAttachmentsTest-161209440</nova:project>
Dec 01 17:09:14 user nova-compute[75745]:   </nova:owner>
Dec 01 17:09:14 user nova-compute[75745]:   <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:09:14 user nova-compute[75745]:   <nova:ports>
Dec 01 17:09:14 user nova-compute[75745]:     <nova:port uuid="f2e5d5e1-b6be-444f-b8b6-c8f26cef560b">
Dec 01 17:09:14 user nova-compute[75745]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 01 17:09:14 user nova-compute[75745]:     </nova:port>
Dec 01 17:09:14 user nova-compute[75745]:   </nova:ports>
Dec 01 17:09:14 user nova-compute[75745]: </nova:instance>
Dec 01 17:09:14 user nova-compute[75745]:  {{(pid=75745) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Dec 01 17:09:15 user nova-compute[75745]: DEBUG nova.network.neutron [None req-402a7045-4962-490e-b90b-21fd9cd5f68c tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Updating instance_info_cache with network_info: [{"id": "f2e5d5e1-b6be-444f-b8b6-c8f26cef560b", "address": "fa:16:3e:ff:a2:43", "network": {"id": "32e8e577-9bad-40af-b8e3-cb700c5f2ddf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-262107762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5275e723c904fa183974b49d4530824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e5d5e1-b6", "ovs_interfaceid": "f2e5d5e1-b6be-444f-b8b6-c8f26cef560b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:09:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-402a7045-4962-490e-b90b-21fd9cd5f68c tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Releasing lock "refresh_cache-02715ae1-5200-4df5-8430-2f19a610d2bb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:09:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-402a7045-4962-490e-b90b-21fd9cd5f68c tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lock "interface-02715ae1-5200-4df5-8430-2f19a610d2bb-8b8877f6-9183-46cb-964f-089f6b197d1e" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.651s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:15 user nova-compute[75745]: DEBUG nova.network.neutron [req-33371b33-8761-463c-8da7-1660c73a5ee8 req-0d877ff9-6174-4d8f-8fa3-13adb6e0e8dd service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Updated VIF entry in instance network info cache for port d3079bd2-25ea-432b-a601-9bb7502fe9c8. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:09:15 user nova-compute[75745]: DEBUG nova.network.neutron [req-33371b33-8761-463c-8da7-1660c73a5ee8 req-0d877ff9-6174-4d8f-8fa3-13adb6e0e8dd service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Updating instance_info_cache with network_info: [{"id": "d3079bd2-25ea-432b-a601-9bb7502fe9c8", "address": "fa:16:3e:3a:86:18", "network": {"id": "b05bdd5e-502b-4f25-bef1-0b17b23a0765", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1245857440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a2dd2fc4fef47d584dd73c8bf3e42ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3079bd2-25", "ovs_interfaceid": "d3079bd2-25ea-432b-a601-9bb7502fe9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:09:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-33371b33-8761-463c-8da7-1660c73a5ee8 req-0d877ff9-6174-4d8f-8fa3-13adb6e0e8dd service nova] Releasing lock "refresh_cache-71504d5d-0999-4960-8782-b454cb407e9f" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:09:18 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d9bfb9f9-95a4-49f5-b781-5e78c83c54d1 is timed out.
Dec 01 17:09:18 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Successfully detached device vdb from instance d9bfb9f9-95a4-49f5-b781-5e78c83c54d1 from the live domain config.
Dec 01 17:09:18 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:09:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XgKELjUI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': 'b000c1c2-a9f3-4629-b034-ef182141787e'}, None), 'kwargs': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:09:18 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:09:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:09:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:09:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:18 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d2793d-b7c9-432d-b76e-4cde59bbc184]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:09:18 user nova-compute[75745]: No targets found.
Dec 01 17:09:18 user nova-compute[75745]: iSNS:
Dec 01 17:09:18 user nova-compute[75745]: No targets found.
Dec 01 17:09:18 user nova-compute[75745]: STATIC:
Dec 01 17:09:18 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111
Dec 01 17:09:18 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:09:18 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:09:18 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121
Dec 01 17:09:18 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:09:18 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:09:18 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e
Dec 01 17:09:18 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:09:18 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:09:18 user nova-compute[75745]: FIRMWARE:
Dec 01 17:09:18 user nova-compute[75745]: No targets found.
Dec 01 17:09:18 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:09:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:09:18 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:09:18 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:09:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:09:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:18 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab21a815-f015-4af5-8a0c-60e9acdf8e07]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:18 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2e99b2-7184-49c8-89b5-593487fc023e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:09:18 user nova-compute[75745]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)
Dec 01 17:09:18 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:09:18 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:09:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:09:18 user nova-compute[75745]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e (non-flash)
Dec 01 17:09:18 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:09:18 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:09:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b81f7250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e'): ({'sdd'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:09:18 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Removing single pathed devices sdd {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:09:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:18 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e28658d-f7ee-485d-a0a1-2dbb51e1b136]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:18 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c4f484-37bb-4450-b8ed-a86f631c1515]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:18 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Flushing IO for device /dev/sdd {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:09:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:18 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54ccef6-ca39-47f7-bf69-5dce9da7b847]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:18 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:09:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:18 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed68b82-f593-430c-bce4-63bfb3d59a0b]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:18 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:09:18 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] SCSI volumes sdd have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:09:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:09:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:19 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[75afb605-d2c1-4a3d-b9f9-97c9187428af]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:19 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e77fd59-b279-4168-a73b-12cf123ef560]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e, portal: 172.16.0.220,3260]
Dec 01 17:09:19 user nova-compute[75745]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e, portal: 172.16.0.220,3260] successful.
Dec 01 17:09:19 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b000c1c2-a9f3-4629-b034-ef182141787e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:19 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd8913a-763d-4686-9836-c628572db01c]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:09:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] <== disconnect_volume: return (279ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:09:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:09:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:19 user nova-compute[75745]: DEBUG nova.objects.instance [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Lazy-loading 'flavor' on Instance uuid d9bfb9f9-95a4-49f5-b781-5e78c83c54d1 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:09:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c61bce95-28b1-440b-aa86-8ed922f68ba8 tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Lock "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.710s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG nova.compute.manager [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:09:22 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Creating image(s)
Dec 01 17:09:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Did not create local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Ensure instance console log exists: /opt/stack/data/nova/instances/71504d5d-0999-4960-8782-b454cb407e9f/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Start _get_guest_xml network_info=[{"id": "d3079bd2-25ea-432b-a601-9bb7502fe9c8", "address": "fa:16:3e:3a:86:18", "network": {"id": "b05bdd5e-502b-4f25-bef1-0b17b23a0765", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1245857440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a2dd2fc4fef47d584dd73c8bf3e42ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3079bd2-25", "ovs_interfaceid": "d3079bd2-25ea-432b-a601-9bb7502fe9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': '6d78b3fa-59ea-4971-8461-94f09a61d7de', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vitPIayJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '71504d5d-0999-4960-8782-b454cb407e9f', 'attached_at': '', 'detached_at': '', 'volume_id': '47a3e21c-03d2-4df0-b96b-c78261e91b98', 'serial': '47a3e21c-03d2-4df0-b96b-c78261e91b98'}, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:09:22 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:09:22 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:09:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vitPIayJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:09:22 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:09:22 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:09:22 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:09:22 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:09:22 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:09:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13e9609-904c-4d03-861e-927500ab2359]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:09:22 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e7c89a-72a1-4d8b-a19b-2712ee4b6991]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98] added
Dec 01 17:09:22 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d60824-806b-41cd-be48-29b847874d8a]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[616d7379-1fa8-4ea1-8658-f70385261067]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vitPIayJ {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vitPIayJ" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:23 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a232fe92-e59b-4c99-9f8c-f0a83fd1d32e]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vitPIayJ'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:23 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6fda27-426f-4580-be64-527439009732]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:23 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c18ad8d-1de7-428e-aeb1-e931a0fd8208]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:09:23 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:09:23 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:09:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:09:23 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:09:23 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:09:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:23 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a9740f-5087-4365-a292-04b9878053db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98, portal: 172.16.0.220,3260]
Dec 01 17:09:23 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98, portal: 172.16.0.220,3260] successful.
Dec 01 17:09:23 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:23 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[851d3bb0-967c-42e6-96b5-67a4591eff8f]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:23 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[174747ce-ccf2-4b13-b46d-aec35ac8b6f4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:09:23 user nova-compute[75745]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)
Dec 01 17:09:23 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:09:23 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:09:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:09:23 user nova-compute[75745]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)
Dec 01 17:09:23 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:09:23 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:09:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:09:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:09:23 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:09:23 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:09:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:23 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8b6ee0-25d8-4a92-92fb-b43d7f591faf]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:23 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: None {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:09:24 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:09:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vitPIayJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:09:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:09:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23664633264353231', 'path': '/dev/sdb'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:09:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664633264353231', 'path': '/dev/sdb'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:09:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:09:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:09:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:09:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:09:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:09:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1079491771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1079491771',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0vMcRe2hslMIizadcBGZgc30uKaeuXlHDf+WN8kFazoQVdMmpxW2R8vlqGKQfRbVS0qJwaTmeur8bI1mP+n7SfrtPRhzkJ9JoTM17YCGvpITsXmYzQv3QY/h+FSAFt5g==',key_name='tempest-keypair-785211803',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a2dd2fc4fef47d584dd73c8bf3e42ae',ramdisk_id='',reservation_id='r-3kwsa42n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-861427896',owner_user_name='tempest-ServerActionsV293TestJSON-861427896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:09:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc2b48b84ebb46ae9b300423b9e225be',uuid=71504d5d-0999-4960-8782-b454cb407e9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3079bd2-25ea-432b-a601-9bb7502fe9c8", "address": "fa:16:3e:3a:86:18", "network": {"id": "b05bdd5e-502b-4f25-bef1-0b17b23a0765", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1245857440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a2dd2fc4fef47d584dd73c8bf3e42ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3079bd2-25", "ovs_interfaceid": "d3079bd2-25ea-432b-a601-9bb7502fe9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:09:24 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Converting VIF {"id": "d3079bd2-25ea-432b-a601-9bb7502fe9c8", "address": "fa:16:3e:3a:86:18", "network": {"id": "b05bdd5e-502b-4f25-bef1-0b17b23a0765", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1245857440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a2dd2fc4fef47d584dd73c8bf3e42ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3079bd2-25", "ovs_interfaceid": "d3079bd2-25ea-432b-a601-9bb7502fe9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:09:24 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:86:18,bridge_name='br-int',has_traffic_filtering=True,id=d3079bd2-25ea-432b-a601-9bb7502fe9c8,network=Network(b05bdd5e-502b-4f25-bef1-0b17b23a0765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3079bd2-25') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:09:24 user nova-compute[75745]: DEBUG nova.objects.instance [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Lazy-loading 'pci_devices' on Instance uuid 71504d5d-0999-4960-8782-b454cb407e9f {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:09:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:09:24 user nova-compute[75745]:   <uuid>71504d5d-0999-4960-8782-b454cb407e9f</uuid>
Dec 01 17:09:24 user nova-compute[75745]:   <name>instance-0000000d</name>
Dec 01 17:09:24 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:09:24 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:09:24 user nova-compute[75745]:   <metadata>
Dec 01 17:09:24 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:09:24 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:09:24 user nova-compute[75745]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1079491771</nova:name>
Dec 01 17:09:24 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:09:22</nova:creationTime>
Dec 01 17:09:24 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:09:24 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:09:24 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:09:24 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:09:24 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:09:24 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:09:24 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:09:24 user nova-compute[75745]:       <nova:owner>
Dec 01 17:09:24 user nova-compute[75745]:         <nova:user uuid="dc2b48b84ebb46ae9b300423b9e225be">tempest-ServerActionsV293TestJSON-861427896-project-member</nova:user>
Dec 01 17:09:24 user nova-compute[75745]:         <nova:project uuid="1a2dd2fc4fef47d584dd73c8bf3e42ae">tempest-ServerActionsV293TestJSON-861427896</nova:project>
Dec 01 17:09:24 user nova-compute[75745]:       </nova:owner>
Dec 01 17:09:24 user nova-compute[75745]:       <nova:ports>
Dec 01 17:09:24 user nova-compute[75745]:         <nova:port uuid="d3079bd2-25ea-432b-a601-9bb7502fe9c8">
Dec 01 17:09:24 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 01 17:09:24 user nova-compute[75745]:         </nova:port>
Dec 01 17:09:24 user nova-compute[75745]:       </nova:ports>
Dec 01 17:09:24 user nova-compute[75745]:     </nova:instance>
Dec 01 17:09:24 user nova-compute[75745]:   </metadata>
Dec 01 17:09:24 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:09:24 user nova-compute[75745]:     <system>
Dec 01 17:09:24 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:09:24 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:09:24 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:09:24 user nova-compute[75745]:       <entry name="serial">71504d5d-0999-4960-8782-b454cb407e9f</entry>
Dec 01 17:09:24 user nova-compute[75745]:       <entry name="uuid">71504d5d-0999-4960-8782-b454cb407e9f</entry>
Dec 01 17:09:24 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:09:24 user nova-compute[75745]:     </system>
Dec 01 17:09:24 user nova-compute[75745]:   </sysinfo>
Dec 01 17:09:24 user nova-compute[75745]:   <os>
Dec 01 17:09:24 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:09:24 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:09:24 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:09:24 user nova-compute[75745]:   </os>
Dec 01 17:09:24 user nova-compute[75745]:   <features>
Dec 01 17:09:24 user nova-compute[75745]:     <acpi/>
Dec 01 17:09:24 user nova-compute[75745]:     <apic/>
Dec 01 17:09:24 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:09:24 user nova-compute[75745]:   </features>
Dec 01 17:09:24 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:09:24 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:09:24 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:09:24 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:09:24 user nova-compute[75745]:   </clock>
Dec 01 17:09:24 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:09:24 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:09:24 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:09:24 user nova-compute[75745]:   </cpu>
Dec 01 17:09:24 user nova-compute[75745]:   <devices>
Dec 01 17:09:24 user nova-compute[75745]:     <disk type="block" device="disk">
Dec 01 17:09:24 user nova-compute[75745]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:09:24 user nova-compute[75745]:       <source dev="/dev/sdb"/>
Dec 01 17:09:24 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:09:24 user nova-compute[75745]:       <serial>47a3e21c-03d2-4df0-b96b-c78261e91b98</serial>
Dec 01 17:09:24 user nova-compute[75745]:     </disk>
Dec 01 17:09:24 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:09:24 user nova-compute[75745]:       <mac address="fa:16:3e:3a:86:18"/>
Dec 01 17:09:24 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:09:24 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:09:24 user nova-compute[75745]:       <target dev="tapd3079bd2-25"/>
Dec 01 17:09:24 user nova-compute[75745]:     </interface>
Dec 01 17:09:24 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:09:24 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/71504d5d-0999-4960-8782-b454cb407e9f/console.log" append="off"/>
Dec 01 17:09:24 user nova-compute[75745]:     </serial>
Dec 01 17:09:24 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:09:24 user nova-compute[75745]:     <video>
Dec 01 17:09:24 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:09:24 user nova-compute[75745]:     </video>
Dec 01 17:09:24 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:09:24 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:09:24 user nova-compute[75745]:     </rng>
Dec 01 17:09:24 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:09:24 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:09:24 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:09:24 user nova-compute[75745]:     </memballoon>
Dec 01 17:09:24 user nova-compute[75745]:   </devices>
Dec 01 17:09:24 user nova-compute[75745]: </domain>
Dec 01 17:09:24 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:09:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:09:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1079491771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1079491771',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0vMcRe2hslMIizadcBGZgc30uKaeuXlHDf+WN8kFazoQVdMmpxW2R8vlqGKQfRbVS0qJwaTmeur8bI1mP+n7SfrtPRhzkJ9JoTM17YCGvpITsXmYzQv3QY/h+FSAFt5g==',key_name='tempest-keypair-785211803',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a2dd2fc4fef47d584dd73c8bf3e42ae',ramdisk_id='',reservation_id='r-3kwsa42n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-861427896',owner_user_name='tempest-ServerActionsV293TestJSON-861427896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:09:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc2b48b84ebb46ae9b300423b9e225be',uuid=71504d5d-0999-4960-8782-b454cb407e9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3079bd2-25ea-432b-a601-9bb7502fe9c8", "address": "fa:16:3e:3a:86:18", "network": {"id": "b05bdd5e-502b-4f25-bef1-0b17b23a0765", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1245857440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a2dd2fc4fef47d584dd73c8bf3e42ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3079bd2-25", "ovs_interfaceid": "d3079bd2-25ea-432b-a601-9bb7502fe9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:09:24 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Converting VIF {"id": "d3079bd2-25ea-432b-a601-9bb7502fe9c8", "address": "fa:16:3e:3a:86:18", "network": {"id": "b05bdd5e-502b-4f25-bef1-0b17b23a0765", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1245857440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a2dd2fc4fef47d584dd73c8bf3e42ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3079bd2-25", "ovs_interfaceid": "d3079bd2-25ea-432b-a601-9bb7502fe9c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:09:24 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:86:18,bridge_name='br-int',has_traffic_filtering=True,id=d3079bd2-25ea-432b-a601-9bb7502fe9c8,network=Network(b05bdd5e-502b-4f25-bef1-0b17b23a0765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3079bd2-25') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:09:24 user nova-compute[75745]: DEBUG os_vif [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:86:18,bridge_name='br-int',has_traffic_filtering=True,id=d3079bd2-25ea-432b-a601-9bb7502fe9c8,network=Network(b05bdd5e-502b-4f25-bef1-0b17b23a0765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3079bd2-25') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:09:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:09:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:09:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9cb02040-5eca-5ada-9b3a-3003180e6454', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:09:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:09:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3079bd2-25, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:09:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd3079bd2-25, col_values=(('qos', UUID('f5d8ed5b-dd77-40a2-9d42-59952209e78d')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:09:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd3079bd2-25, col_values=(('external_ids', {'iface-id': 'd3079bd2-25ea-432b-a601-9bb7502fe9c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:86:18', 'vm-uuid': '71504d5d-0999-4960-8782-b454cb407e9f'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:09:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:09:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:24 user nova-compute[75745]: INFO os_vif [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:86:18,bridge_name='br-int',has_traffic_filtering=True,id=d3079bd2-25ea-432b-a601-9bb7502fe9c8,network=Network(b05bdd5e-502b-4f25-bef1-0b17b23a0765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3079bd2-25')
Dec 01 17:09:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:09:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] No VIF found with MAC fa:16:3e:3a:86:18, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:09:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:25 user nova-compute[75745]: DEBUG nova.compute.manager [req-f6037913-e156-4248-b357-d2fb320bca17 req-6645d1ed-7b79-4c13-8df0-c82f63138a84 service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Received event network-vif-plugged-d3079bd2-25ea-432b-a601-9bb7502fe9c8 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:09:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-f6037913-e156-4248-b357-d2fb320bca17 req-6645d1ed-7b79-4c13-8df0-c82f63138a84 service nova] Acquiring lock "71504d5d-0999-4960-8782-b454cb407e9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-f6037913-e156-4248-b357-d2fb320bca17 req-6645d1ed-7b79-4c13-8df0-c82f63138a84 service nova] Lock "71504d5d-0999-4960-8782-b454cb407e9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-f6037913-e156-4248-b357-d2fb320bca17 req-6645d1ed-7b79-4c13-8df0-c82f63138a84 service nova] Lock "71504d5d-0999-4960-8782-b454cb407e9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:25 user nova-compute[75745]: DEBUG nova.compute.manager [req-f6037913-e156-4248-b357-d2fb320bca17 req-6645d1ed-7b79-4c13-8df0-c82f63138a84 service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] No waiting events found dispatching network-vif-plugged-d3079bd2-25ea-432b-a601-9bb7502fe9c8 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:09:25 user nova-compute[75745]: WARNING nova.compute.manager [req-f6037913-e156-4248-b357-d2fb320bca17 req-6645d1ed-7b79-4c13-8df0-c82f63138a84 service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Received unexpected event network-vif-plugged-d3079bd2-25ea-432b-a601-9bb7502fe9c8 for instance with vm_state building and task_state spawning.
Dec 01 17:09:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:27 user nova-compute[75745]: DEBUG nova.compute.manager [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:09:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:09:27 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Instance spawned successfully.
Dec 01 17:09:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:09:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:09:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:09:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:09:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:09:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:09:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:09:27 user nova-compute[75745]: INFO nova.compute.manager [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Took 5.09 seconds to spawn the instance on the hypervisor.
Dec 01 17:09:27 user nova-compute[75745]: DEBUG nova.compute.manager [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:09:27 user nova-compute[75745]: DEBUG nova.compute.manager [req-ce371784-bcf4-4193-8c9a-0c9a01625031 req-bb24030a-8529-45fb-b911-0c939ed4710a service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Received event network-vif-plugged-d3079bd2-25ea-432b-a601-9bb7502fe9c8 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:09:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ce371784-bcf4-4193-8c9a-0c9a01625031 req-bb24030a-8529-45fb-b911-0c939ed4710a service nova] Acquiring lock "71504d5d-0999-4960-8782-b454cb407e9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ce371784-bcf4-4193-8c9a-0c9a01625031 req-bb24030a-8529-45fb-b911-0c939ed4710a service nova] Lock "71504d5d-0999-4960-8782-b454cb407e9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ce371784-bcf4-4193-8c9a-0c9a01625031 req-bb24030a-8529-45fb-b911-0c939ed4710a service nova] Lock "71504d5d-0999-4960-8782-b454cb407e9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:27 user nova-compute[75745]: DEBUG nova.compute.manager [req-ce371784-bcf4-4193-8c9a-0c9a01625031 req-bb24030a-8529-45fb-b911-0c939ed4710a service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] No waiting events found dispatching network-vif-plugged-d3079bd2-25ea-432b-a601-9bb7502fe9c8 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:09:27 user nova-compute[75745]: WARNING nova.compute.manager [req-ce371784-bcf4-4193-8c9a-0c9a01625031 req-bb24030a-8529-45fb-b911-0c939ed4710a service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Received unexpected event network-vif-plugged-d3079bd2-25ea-432b-a601-9bb7502fe9c8 for instance with vm_state building and task_state spawning.
Dec 01 17:09:28 user nova-compute[75745]: INFO nova.compute.manager [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Took 15.13 seconds to build instance.
Dec 01 17:09:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b1915e3d-af70-4c41-b499-45a01a8003e7 tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Lock "71504d5d-0999-4960-8782-b454cb407e9f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.227s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fd5efcd2-cf51-4410-86b3-cee6fcd5ff41 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Acquiring lock "0e256c89-0301-431a-ae27-dfd7c2af19f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fd5efcd2-cf51-4410-86b3-cee6fcd5ff41 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Lock "0e256c89-0301-431a-ae27-dfd7c2af19f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fd5efcd2-cf51-4410-86b3-cee6fcd5ff41 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Acquiring lock "0e256c89-0301-431a-ae27-dfd7c2af19f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fd5efcd2-cf51-4410-86b3-cee6fcd5ff41 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Lock "0e256c89-0301-431a-ae27-dfd7c2af19f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fd5efcd2-cf51-4410-86b3-cee6fcd5ff41 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Lock "0e256c89-0301-431a-ae27-dfd7c2af19f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:34 user nova-compute[75745]: INFO nova.compute.manager [None req-fd5efcd2-cf51-4410-86b3-cee6fcd5ff41 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Terminating instance
Dec 01 17:09:34 user nova-compute[75745]: DEBUG nova.compute.manager [None req-fd5efcd2-cf51-4410-86b3-cee6fcd5ff41 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:09:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-75109254-79fb-46d2-b03e-f9ba61688f12 req-dfb0944f-bd71-4966-b8d1-5a0cb78c746d service nova] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Received event network-vif-unplugged-2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:09:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-75109254-79fb-46d2-b03e-f9ba61688f12 req-dfb0944f-bd71-4966-b8d1-5a0cb78c746d service nova] Acquiring lock "0e256c89-0301-431a-ae27-dfd7c2af19f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-75109254-79fb-46d2-b03e-f9ba61688f12 req-dfb0944f-bd71-4966-b8d1-5a0cb78c746d service nova] Lock "0e256c89-0301-431a-ae27-dfd7c2af19f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-75109254-79fb-46d2-b03e-f9ba61688f12 req-dfb0944f-bd71-4966-b8d1-5a0cb78c746d service nova] Lock "0e256c89-0301-431a-ae27-dfd7c2af19f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-75109254-79fb-46d2-b03e-f9ba61688f12 req-dfb0944f-bd71-4966-b8d1-5a0cb78c746d service nova] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] No waiting events found dispatching network-vif-unplugged-2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:09:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-75109254-79fb-46d2-b03e-f9ba61688f12 req-dfb0944f-bd71-4966-b8d1-5a0cb78c746d service nova] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Received event network-vif-unplugged-2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:09:35 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Instance destroyed successfully.
Dec 01 17:09:35 user nova-compute[75745]: DEBUG nova.objects.instance [None req-fd5efcd2-cf51-4410-86b3-cee6fcd5ff41 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Lazy-loading 'resources' on Instance uuid 0e256c89-0301-431a-ae27-dfd7c2af19f2 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:09:35 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-fd5efcd2-cf51-4410-86b3-cee6fcd5ff41 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:06:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-796321199',display_name='tempest-VolumesAssistedSnapshotsTest-server-796321199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-796321199',id=8,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1aYetgDvzSaTYJHtVcSiLSi1G5KPaJEZd7B7gpxzbW4kzRhzVmy3AthrA4kZjytlEb+QCiAOIjWgZZF51Qw0A6nGMWrOW66g1LFo+JkL3nCEs8W5CJQEKwGYuSm8JL1g==',key_name='tempest-keypair-81983607',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:06:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c36b3e1f1ae4122abfac021cefc809a',ramdisk_id='',reservation_id='r-20a5cgwp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-180603530',owner_user_name='tempest-VolumesAssistedSnapshotsTest-180603530-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:06:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12e2e99da25148c69846d9afced1f307',uuid=0e256c89-0301-431a-ae27-dfd7c2af19f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1", "address": "fa:16:3e:66:77:e0", "network": {"id": "c0dde7ef-077a-49d3-996e-9cd7f48984ce", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-105760332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c36b3e1f1ae4122abfac021cefc809a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bbb1dd6-ad", "ovs_interfaceid": "2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:09:35 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-fd5efcd2-cf51-4410-86b3-cee6fcd5ff41 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Converting VIF {"id": "2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1", "address": "fa:16:3e:66:77:e0", "network": {"id": "c0dde7ef-077a-49d3-996e-9cd7f48984ce", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-105760332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c36b3e1f1ae4122abfac021cefc809a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bbb1dd6-ad", "ovs_interfaceid": "2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:09:35 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-fd5efcd2-cf51-4410-86b3-cee6fcd5ff41 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:77:e0,bridge_name='br-int',has_traffic_filtering=True,id=2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1,network=Network(c0dde7ef-077a-49d3-996e-9cd7f48984ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bbb1dd6-ad') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:09:35 user nova-compute[75745]: DEBUG os_vif [None req-fd5efcd2-cf51-4410-86b3-cee6fcd5ff41 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:77:e0,bridge_name='br-int',has_traffic_filtering=True,id=2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1,network=Network(c0dde7ef-077a-49d3-996e-9cd7f48984ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bbb1dd6-ad') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:09:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2bbb1dd6-ad, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:09:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:09:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d131df9c-cda4-4a35-aa3e-f3ae27b6ebcd) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:09:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:09:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:35 user nova-compute[75745]: INFO os_vif [None req-fd5efcd2-cf51-4410-86b3-cee6fcd5ff41 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:77:e0,bridge_name='br-int',has_traffic_filtering=True,id=2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1,network=Network(c0dde7ef-077a-49d3-996e-9cd7f48984ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bbb1dd6-ad')
Dec 01 17:09:35 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-fd5efcd2-cf51-4410-86b3-cee6fcd5ff41 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Deleting instance files /opt/stack/data/nova/instances/0e256c89-0301-431a-ae27-dfd7c2af19f2_del
Dec 01 17:09:35 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-fd5efcd2-cf51-4410-86b3-cee6fcd5ff41 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Deletion of /opt/stack/data/nova/instances/0e256c89-0301-431a-ae27-dfd7c2af19f2_del complete
Dec 01 17:09:35 user nova-compute[75745]: INFO nova.compute.manager [None req-fd5efcd2-cf51-4410-86b3-cee6fcd5ff41 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Took 0.91 seconds to destroy the instance on the hypervisor.
Dec 01 17:09:35 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-fd5efcd2-cf51-4410-86b3-cee6fcd5ff41 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:09:35 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:09:35 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:09:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Acquiring lock "2abc6436-bf45-497a-acd2-47d43d5e158c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:35 user nova-compute[75745]: DEBUG nova.objects.instance [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lazy-loading 'flavor' on Instance uuid 2abc6436-bf45-497a-acd2-47d43d5e158c {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:09:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Acquiring lock "2abc6436-bf45-497a-acd2-47d43d5e158c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:35 user nova-compute[75745]: INFO nova.compute.manager [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Attaching volume fcd8549e-610f-4ede-841e-88c1b93df25e to /dev/vdb
Dec 01 17:09:35 user nova-compute[75745]: DEBUG os_brick.utils [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:09:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:35 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[974a1650-9c1a-4a02-9f45-a17ef87efb6d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:35 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[651dfbd3-abd8-423b-b6d9-13dac082a75d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc61fb9-0bb6-4e89-8f0f-3a50f829657c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2ea2ca-e52d-4c27-85ff-ca358c035d81]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:09:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:09:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:09:36 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:09:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a050a7-6995-484c-b367-727bb3b2bd32]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:09:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:09:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:09:36 user nova-compute[75745]: DEBUG os_brick.utils [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:09:36 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Updating existing volume attachment record: e678d6bd-eb21-40ed-a44c-99e0c3728526 {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:09:36 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:09:36 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Took 1.02 seconds to deallocate network for instance.
Dec 01 17:09:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fd5efcd2-cf51-4410-86b3-cee6fcd5ff41 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fd5efcd2-cf51-4410-86b3-cee6fcd5ff41 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:36 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-fd5efcd2-cf51-4410-86b3-cee6fcd5ff41 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:09:36 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-fd5efcd2-cf51-4410-86b3-cee6fcd5ff41 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:09:36 user nova-compute[75745]: DEBUG nova.compute.manager [req-4a63baa7-c79a-447e-aab1-821d0893ea3e req-230e362c-1a07-4b65-a2c0-0a41a8937875 service nova] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Received event network-vif-plugged-2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:09:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-4a63baa7-c79a-447e-aab1-821d0893ea3e req-230e362c-1a07-4b65-a2c0-0a41a8937875 service nova] Acquiring lock "0e256c89-0301-431a-ae27-dfd7c2af19f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-4a63baa7-c79a-447e-aab1-821d0893ea3e req-230e362c-1a07-4b65-a2c0-0a41a8937875 service nova] Lock "0e256c89-0301-431a-ae27-dfd7c2af19f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-4a63baa7-c79a-447e-aab1-821d0893ea3e req-230e362c-1a07-4b65-a2c0-0a41a8937875 service nova] Lock "0e256c89-0301-431a-ae27-dfd7c2af19f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:36 user nova-compute[75745]: DEBUG nova.compute.manager [req-4a63baa7-c79a-447e-aab1-821d0893ea3e req-230e362c-1a07-4b65-a2c0-0a41a8937875 service nova] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] No waiting events found dispatching network-vif-plugged-2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:09:36 user nova-compute[75745]: WARNING nova.compute.manager [req-4a63baa7-c79a-447e-aab1-821d0893ea3e req-230e362c-1a07-4b65-a2c0-0a41a8937875 service nova] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Received unexpected event network-vif-plugged-2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1 for instance with vm_state deleted and task_state None.
Dec 01 17:09:36 user nova-compute[75745]: DEBUG nova.compute.manager [req-4a63baa7-c79a-447e-aab1-821d0893ea3e req-230e362c-1a07-4b65-a2c0-0a41a8937875 service nova] [instance: 0e256c89-0301-431a-ae27-dfd7c2af19f2] Received event network-vif-deleted-2bbb1dd6-adb0-4a91-8f58-8ef47bee17c1 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:09:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fd5efcd2-cf51-4410-86b3-cee6fcd5ff41 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:36 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-fd5efcd2-cf51-4410-86b3-cee6fcd5ff41 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Deleted allocations for instance 0e256c89-0301-431a-ae27-dfd7c2af19f2
Dec 01 17:09:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fd5efcd2-cf51-4410-86b3-cee6fcd5ff41 tempest-VolumesAssistedSnapshotsTest-180603530 tempest-VolumesAssistedSnapshotsTest-180603530-project-member] Lock "0e256c89-0301-431a-ae27-dfd7c2af19f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.477s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:36 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:09:36 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:09:37 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:09:37 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:09:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:37 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:09:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:38 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:09:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bfb9f9-95a4-49f5-b781-5e78c83c54d1/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bfb9f9-95a4-49f5-b781-5e78c83c54d1/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bfb9f9-95a4-49f5-b781-5e78c83c54d1/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9bfb9f9-95a4-49f5-b781-5e78c83c54d1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:09:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc78dcf1-f005-415c-ac27-798cab8f52fb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc78dcf1-f005-415c-ac27-798cab8f52fb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc78dcf1-f005-415c-ac27-798cab8f52fb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc78dcf1-f005-415c-ac27-798cab8f52fb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:09:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3a04948-936e-47c8-8a5f-e7bdee5b69db/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3a04948-936e-47c8-8a5f-e7bdee5b69db/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3a04948-936e-47c8-8a5f-e7bdee5b69db/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3a04948-936e-47c8-8a5f-e7bdee5b69db/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:40 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:09:40 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:09:40 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=8146MB free_disk=25.52608871459961GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:09:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:41 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance dc78dcf1-f005-415c-ac27-798cab8f52fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:09:41 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 4ac6f586-cc5b-4a3f-b374-4b2006a48427 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:09:41 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 2abc6436-bf45-497a-acd2-47d43d5e158c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:09:41 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance d9bfb9f9-95a4-49f5-b781-5e78c83c54d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:09:41 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 02715ae1-5200-4df5-8430-2f19a610d2bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:09:41 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance b3a04948-936e-47c8-8a5f-e7bdee5b69db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:09:41 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 71504d5d-0999-4960-8782-b454cb407e9f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:09:41 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:09:41 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:09:41 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:09:41 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:09:41 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:09:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.464s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:42 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:09:42 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:09:42 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:09:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-2abc6436-bf45-497a-acd2-47d43d5e158c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:09:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-2abc6436-bf45-497a-acd2-47d43d5e158c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:09:42 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:09:42 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Updating instance_info_cache with network_info: [{"id": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "address": "fa:16:3e:66:74:ba", "network": {"id": "3d78774f-ff2b-4705-b359-7a1fb7fc272f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-234182378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1efefd35d14e03a3eebfff2ac0d335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5897fde5-fe", "ovs_interfaceid": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:09:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-2abc6436-bf45-497a-acd2-47d43d5e158c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:09:42 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:09:42 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:09:42 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:09:42 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:09:42 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:09:42 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:09:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-41bd0cf6-865c-4a36-9004-98dbaec6f178 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Acquiring lock "02715ae1-5200-4df5-8430-2f19a610d2bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-41bd0cf6-865c-4a36-9004-98dbaec6f178 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lock "02715ae1-5200-4df5-8430-2f19a610d2bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-41bd0cf6-865c-4a36-9004-98dbaec6f178 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Acquiring lock "02715ae1-5200-4df5-8430-2f19a610d2bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-41bd0cf6-865c-4a36-9004-98dbaec6f178 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lock "02715ae1-5200-4df5-8430-2f19a610d2bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-41bd0cf6-865c-4a36-9004-98dbaec6f178 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lock "02715ae1-5200-4df5-8430-2f19a610d2bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:44 user nova-compute[75745]: INFO nova.compute.manager [None req-41bd0cf6-865c-4a36-9004-98dbaec6f178 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Terminating instance
Dec 01 17:09:44 user nova-compute[75745]: DEBUG nova.compute.manager [None req-41bd0cf6-865c-4a36-9004-98dbaec6f178 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:09:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:45 user nova-compute[75745]: DEBUG nova.compute.manager [req-cb274e93-9dde-44bd-8eb6-840b8f7d738e req-cb9ad364-a9b0-4a62-bcc6-e9059b8a04f2 service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Received event network-vif-unplugged-f2e5d5e1-b6be-444f-b8b6-c8f26cef560b {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:09:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-cb274e93-9dde-44bd-8eb6-840b8f7d738e req-cb9ad364-a9b0-4a62-bcc6-e9059b8a04f2 service nova] Acquiring lock "02715ae1-5200-4df5-8430-2f19a610d2bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-cb274e93-9dde-44bd-8eb6-840b8f7d738e req-cb9ad364-a9b0-4a62-bcc6-e9059b8a04f2 service nova] Lock "02715ae1-5200-4df5-8430-2f19a610d2bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-cb274e93-9dde-44bd-8eb6-840b8f7d738e req-cb9ad364-a9b0-4a62-bcc6-e9059b8a04f2 service nova] Lock "02715ae1-5200-4df5-8430-2f19a610d2bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:45 user nova-compute[75745]: DEBUG nova.compute.manager [req-cb274e93-9dde-44bd-8eb6-840b8f7d738e req-cb9ad364-a9b0-4a62-bcc6-e9059b8a04f2 service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] No waiting events found dispatching network-vif-unplugged-f2e5d5e1-b6be-444f-b8b6-c8f26cef560b {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:09:45 user nova-compute[75745]: DEBUG nova.compute.manager [req-cb274e93-9dde-44bd-8eb6-840b8f7d738e req-cb9ad364-a9b0-4a62-bcc6-e9059b8a04f2 service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Received event network-vif-unplugged-f2e5d5e1-b6be-444f-b8b6-c8f26cef560b for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:09:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:45 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Instance destroyed successfully.
Dec 01 17:09:45 user nova-compute[75745]: DEBUG nova.objects.instance [None req-41bd0cf6-865c-4a36-9004-98dbaec6f178 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lazy-loading 'resources' on Instance uuid 02715ae1-5200-4df5-8430-2f19a610d2bb {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:09:45 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-41bd0cf6-865c-4a36-9004-98dbaec6f178 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T17:06:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-307822093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-307822093',id=7,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcs8sgcxWpvAhCDukezlQYcNLHeLOr5mWfJj0puItGCkRZJXOGQ6MpM5uepe4ipPhQinPlSmQOH6fLeiZ2h4cJWUaoqQV3toeXUomzqHJu8XbHvxkd2bF7E/efoK+eL7A==',key_name='tempest-keypair-903294596',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:06:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5275e723c904fa183974b49d4530824',ramdisk_id='',reservation_id='r-1wsmmw87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-161209440',owner_user_name='tempest-TaggedAttachmentsTest-161209440-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:06:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77cc6ad71fa84904acd8d24eec648c94',uuid=02715ae1-5200-4df5-8430-2f19a610d2bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2e5d5e1-b6be-444f-b8b6-c8f26cef560b", "address": "fa:16:3e:ff:a2:43", "network": {"id": "32e8e577-9bad-40af-b8e3-cb700c5f2ddf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-262107762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5275e723c904fa183974b49d4530824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e5d5e1-b6", "ovs_interfaceid": "f2e5d5e1-b6be-444f-b8b6-c8f26cef560b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:09:45 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-41bd0cf6-865c-4a36-9004-98dbaec6f178 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Converting VIF {"id": "f2e5d5e1-b6be-444f-b8b6-c8f26cef560b", "address": "fa:16:3e:ff:a2:43", "network": {"id": "32e8e577-9bad-40af-b8e3-cb700c5f2ddf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-262107762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5275e723c904fa183974b49d4530824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e5d5e1-b6", "ovs_interfaceid": "f2e5d5e1-b6be-444f-b8b6-c8f26cef560b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:09:45 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-41bd0cf6-865c-4a36-9004-98dbaec6f178 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:a2:43,bridge_name='br-int',has_traffic_filtering=True,id=f2e5d5e1-b6be-444f-b8b6-c8f26cef560b,network=Network(32e8e577-9bad-40af-b8e3-cb700c5f2ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2e5d5e1-b6') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:09:45 user nova-compute[75745]: DEBUG os_vif [None req-41bd0cf6-865c-4a36-9004-98dbaec6f178 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:a2:43,bridge_name='br-int',has_traffic_filtering=True,id=f2e5d5e1-b6be-444f-b8b6-c8f26cef560b,network=Network(32e8e577-9bad-40af-b8e3-cb700c5f2ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2e5d5e1-b6') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:09:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2e5d5e1-b6, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:09:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:09:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=35256f2b-fccb-496f-b060-cb98625dd28c) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:09:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:09:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:45 user nova-compute[75745]: INFO os_vif [None req-41bd0cf6-865c-4a36-9004-98dbaec6f178 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:a2:43,bridge_name='br-int',has_traffic_filtering=True,id=f2e5d5e1-b6be-444f-b8b6-c8f26cef560b,network=Network(32e8e577-9bad-40af-b8e3-cb700c5f2ddf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2e5d5e1-b6')
Dec 01 17:09:45 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-41bd0cf6-865c-4a36-9004-98dbaec6f178 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Deleting instance files /opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb_del
Dec 01 17:09:45 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-41bd0cf6-865c-4a36-9004-98dbaec6f178 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Deletion of /opt/stack/data/nova/instances/02715ae1-5200-4df5-8430-2f19a610d2bb_del complete
Dec 01 17:09:45 user nova-compute[75745]: INFO nova.compute.manager [None req-41bd0cf6-865c-4a36-9004-98dbaec6f178 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Took 1.12 seconds to destroy the instance on the hypervisor.
Dec 01 17:09:45 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-41bd0cf6-865c-4a36-9004-98dbaec6f178 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:09:45 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:09:45 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:09:46 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:09:46 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Took 1.06 seconds to deallocate network for instance.
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-41bd0cf6-865c-4a36-9004-98dbaec6f178 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-41bd0cf6-865c-4a36-9004-98dbaec6f178 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FkMgtsJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:09:47 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:09:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:09:47 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:09:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:09:47 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[47dfc63f-9a57-4a75-9fd8-d697a05f72c4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:09:47 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd4d245-42dc-4584-9a0c-c88143413c22]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e] added
Dec 01 17:09:47 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[45742747-5f41-4070-8a4c-eac025360a80]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG nova.compute.manager [req-2a861f80-cf1f-4bc1-9fce-173b344af434 req-136d9be3-d9f3-471d-9a48-f6704651e177 service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Received event network-vif-plugged-f2e5d5e1-b6be-444f-b8b6-c8f26cef560b {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2a861f80-cf1f-4bc1-9fce-173b344af434 req-136d9be3-d9f3-471d-9a48-f6704651e177 service nova] Acquiring lock "02715ae1-5200-4df5-8430-2f19a610d2bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2a861f80-cf1f-4bc1-9fce-173b344af434 req-136d9be3-d9f3-471d-9a48-f6704651e177 service nova] Lock "02715ae1-5200-4df5-8430-2f19a610d2bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2a861f80-cf1f-4bc1-9fce-173b344af434 req-136d9be3-d9f3-471d-9a48-f6704651e177 service nova] Lock "02715ae1-5200-4df5-8430-2f19a610d2bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG nova.compute.manager [req-2a861f80-cf1f-4bc1-9fce-173b344af434 req-136d9be3-d9f3-471d-9a48-f6704651e177 service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] No waiting events found dispatching network-vif-plugged-f2e5d5e1-b6be-444f-b8b6-c8f26cef560b {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:09:47 user nova-compute[75745]: WARNING nova.compute.manager [req-2a861f80-cf1f-4bc1-9fce-173b344af434 req-136d9be3-d9f3-471d-9a48-f6704651e177 service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Received unexpected event network-vif-plugged-f2e5d5e1-b6be-444f-b8b6-c8f26cef560b for instance with vm_state deleted and task_state None.
Dec 01 17:09:47 user nova-compute[75745]: DEBUG nova.compute.manager [req-2a861f80-cf1f-4bc1-9fce-173b344af434 req-136d9be3-d9f3-471d-9a48-f6704651e177 service nova] [instance: 02715ae1-5200-4df5-8430-2f19a610d2bb] Received event network-vif-deleted-f2e5d5e1-b6be-444f-b8b6-c8f26cef560b {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-41bd0cf6-865c-4a36-9004-98dbaec6f178 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-41bd0cf6-865c-4a36-9004-98dbaec6f178 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.096s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[394df6cf-195b-479e-989f-5064617b9f60]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FkMgtsJH {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-41bd0cf6-865c-4a36-9004-98dbaec6f178 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FkMgtsJH" returned: 0 in 0.037s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ce2bac-7636-4d82-8e2d-6175ab9332c5]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FkMgtsJH'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG nova.objects.instance [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lazy-loading 'flavor' on Instance uuid 4ac6f586-cc5b-4a3f-b374-4b2006a48427 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[299888c2-db78-4ea6-8bd3-95335370de82]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:47 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-41bd0cf6-865c-4a36-9004-98dbaec6f178 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Deleted allocations for instance 02715ae1-5200-4df5-8430-2f19a610d2bb
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "refresh_cache-4ac6f586-cc5b-4a3f-b374-4b2006a48427" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquired lock "refresh_cache-4ac6f586-cc5b-4a3f-b374-4b2006a48427" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG nova.network.neutron [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG nova.objects.instance [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lazy-loading 'info_cache' on Instance uuid 4ac6f586-cc5b-4a3f-b374-4b2006a48427 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee047fc6-5dbe-415f-b0cf-ade5a97c7333]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:09:47 user nova-compute[75745]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)
Dec 01 17:09:47 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:09:47 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:09:47 user nova-compute[75745]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)
Dec 01 17:09:47 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:09:47 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG nova.objects.base [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Object Instance<4ac6f586-cc5b-4a3f-b374-4b2006a48427> lazy-loaded attributes: flavor,info_cache {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4440bfc8-15ec-41cc-8552-40f3fdd5648a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e, portal: 172.16.0.220,3260]
Dec 01 17:09:47 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e, portal: 172.16.0.220,3260] successful.
Dec 01 17:09:47 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-41bd0cf6-865c-4a36-9004-98dbaec6f178 tempest-TaggedAttachmentsTest-161209440 tempest-TaggedAttachmentsTest-161209440-project-member] Lock "02715ae1-5200-4df5-8430-2f19a610d2bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.859s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[95df6a41-0aa4-4d17-ae5b-4e15569d26f9]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cceb9c5-d9f5-447b-bb36-716a8856e34f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:09:47 user nova-compute[75745]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)
Dec 01 17:09:47 user nova-compute[75745]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e (non-flash)
Dec 01 17:09:47 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:09:47 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:09:47 user nova-compute[75745]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)
Dec 01 17:09:47 user nova-compute[75745]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e (non-flash)
Dec 01 17:09:47 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:09:47 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.461s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b40abcc-11bd-4cf0-bbbc-afb38bfbf92f]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:47 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: None {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG nova.network.neutron [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Updating instance_info_cache with network_info: [{"id": "b4990a3b-371a-44eb-98d8-685dc63590da", "address": "fa:16:3e:d3:4e:b4", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4990a3b-37", "ovs_interfaceid": "b4990a3b-371a-44eb-98d8-685dc63590da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Releasing lock "refresh_cache-4ac6f586-cc5b-4a3f-b374-4b2006a48427" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:09:48 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Instance destroyed successfully.
Dec 01 17:09:48 user nova-compute[75745]: DEBUG nova.objects.instance [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lazy-loading 'resources' on Instance uuid 4ac6f586-cc5b-4a3f-b374-4b2006a48427 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG nova.objects.base [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Object Instance<4ac6f586-cc5b-4a3f-b374-4b2006a48427> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:05:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2091565177',display_name='tempest-AttachVolumeTestJSON-server-2091565177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2091565177',id=3,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3XjkUwzRZSzJkFVK8CajxZrqSjgRTlHxxeyK14q4pHPTuyqvoLAZM+Yf8NfQQKwzsK8V31lsj4YBhMGkfSH1VtWc/GskdhpcUVvoTFK+eiPPk/qO2e2As1y2z8e2iGKw==',key_name='tempest-keypair-811365711',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:06:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7c4e507763844b67b588fa2509ec3aff',ramdisk_id='',reservation_id='r-38xwk32b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-712829532',owner_user_name='tempest-AttachVolumeTestJSON-712829532-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:07:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e92e1fa18cc4bdaa17afd2b2db97259',uuid=4ac6f586-cc5b-4a3f-b374-4b2006a48427,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b4990a3b-371a-44eb-98d8-685dc63590da", "address": "fa:16:3e:d3:4e:b4", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4990a3b-37", "ovs_interfaceid": "b4990a3b-371a-44eb-98d8-685dc63590da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Converting VIF {"id": "b4990a3b-371a-44eb-98d8-685dc63590da", "address": "fa:16:3e:d3:4e:b4", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4990a3b-37", "ovs_interfaceid": "b4990a3b-371a-44eb-98d8-685dc63590da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:4e:b4,bridge_name='br-int',has_traffic_filtering=True,id=b4990a3b-371a-44eb-98d8-685dc63590da,network=Network(b2b1c054-5370-4c64-9fb7-b98791c8f5ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4990a3b-37') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG os_vif [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:4e:b4,bridge_name='br-int',has_traffic_filtering=True,id=b4990a3b-371a-44eb-98d8-685dc63590da,network=Network(b2b1c054-5370-4c64-9fb7-b98791c8f5ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4990a3b-37') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4990a3b-37, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e80615b7-d9e0-45b8-b476-2f5923317ef6) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:48 user nova-compute[75745]: INFO os_vif [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:4e:b4,bridge_name='br-int',has_traffic_filtering=True,id=b4990a3b-371a-44eb-98d8-685dc63590da,network=Network(b2b1c054-5370-4c64-9fb7-b98791c8f5ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4990a3b-37')
Dec 01 17:09:48 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SQOjKMiW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:09:48 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:09:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FkMgtsJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.501s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] <== connect_volume: return (1502ms) {'type': 'block', 'scsi_wwn': '23763323730383837', 'path': '/dev/sdc'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763323730383837', 'path': '/dev/sdc'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.109s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG nova.objects.instance [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lazy-loading 'flavor' on Instance uuid 2abc6436-bf45-497a-acd2-47d43d5e158c {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-17120e19-c2d1-42c4-8427-11df2a58843e tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Acquiring lock "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-17120e19-c2d1-42c4-8427-11df2a58843e tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Lock "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-17120e19-c2d1-42c4-8427-11df2a58843e tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Acquiring lock "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-17120e19-c2d1-42c4-8427-11df2a58843e tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Lock "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-17120e19-c2d1-42c4-8427-11df2a58843e tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Lock "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:48 user nova-compute[75745]: INFO nova.compute.manager [None req-17120e19-c2d1-42c4-8427-11df2a58843e tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Terminating instance
Dec 01 17:09:48 user nova-compute[75745]: DEBUG nova.compute.manager [None req-17120e19-c2d1-42c4-8427-11df2a58843e tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57bb12f-bb5f-4956-ab4d-24a4e9821f3c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:09:48 user nova-compute[75745]: No targets found.
Dec 01 17:09:48 user nova-compute[75745]: iSNS:
Dec 01 17:09:48 user nova-compute[75745]: No targets found.
Dec 01 17:09:48 user nova-compute[75745]: STATIC:
Dec 01 17:09:48 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98
Dec 01 17:09:48 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:09:48 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:09:48 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e
Dec 01 17:09:48 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:09:48 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:09:48 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111
Dec 01 17:09:48 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:09:48 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:09:48 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121
Dec 01 17:09:48 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:09:48 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:09:48 user nova-compute[75745]: FIRMWARE:
Dec 01 17:09:48 user nova-compute[75745]: No targets found.
Dec 01 17:09:48 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:09:48 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:09:48 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 17:09:48 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:09:48 user nova-compute[75745]:   <source dev="/dev/sdc"/>
Dec 01 17:09:48 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:09:48 user nova-compute[75745]:   <serial>fcd8549e-610f-4ede-841e-88c1b93df25e</serial>
Dec 01 17:09:48 user nova-compute[75745]: </disk>
Dec 01 17:09:48 user nova-compute[75745]:  {{(pid=75745) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7de3334-c4f8-4012-85af-46188a8aca3d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1889a068-8ba6-4872-af80-8874e707eafc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:09:48 user nova-compute[75745]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)
Dec 01 17:09:48 user nova-compute[75745]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e (non-flash)
Dec 01 17:09:48 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:09:48 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:09:48 user nova-compute[75745]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)
Dec 01 17:09:48 user nova-compute[75745]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e (non-flash)
Dec 01 17:09:48 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:09:48 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24d811cc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121'): ({'sdh'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Removing single pathed devices sdh {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba6a706-45b4-4cc4-8fd1-2c3b421fbad1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2640ee-4745-4079-8cb2-f9250fead85f]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Flushing IO for device /dev/sdh {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b47314b-63fc-4d5a-b7d5-04a2c8efb9b9]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.063s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d5295a-9bec-4921-a9e2-98d122e512ce]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] SCSI volumes sdh have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[36829705-d6b2-4e1d-b43e-6b5dee76ae99]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e74a025-584c-42a4-a7e9-77da39dc1c96]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121, portal: 172.16.0.220,3260]
Dec 01 17:09:49 user nova-compute[75745]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121, portal: 172.16.0.220,3260] successful.
Dec 01 17:09:49 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fab49ad-3c41-47f5-8681-7880a6594dc2]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.413s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] <== disconnect_volume: return (522ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Start _get_guest_xml network_info=[{"id": "b4990a3b-371a-44eb-98d8-685dc63590da", "address": "fa:16:3e:d3:4e:b4", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4990a3b-37", "ovs_interfaceid": "b4990a3b-371a-44eb-98d8-685dc63590da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': 'fb1fb991-b371-4845-a70e-f7b50885a92f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SQOjKMiW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '4ac6f586-cc5b-4a3f-b374-4b2006a48427', 'attached_at': '', 'detached_at': '', 'volume_id': '609a2122-bfa0-40d7-b912-c4d799157121', 'serial': '609a2122-bfa0-40d7-b912-c4d799157121'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG nova.objects.instance [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lazy-loading 'numa_topology' on Instance uuid 4ac6f586-cc5b-4a3f-b374-4b2006a48427 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG nova.objects.base [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Object Instance<4ac6f586-cc5b-4a3f-b374-4b2006a48427> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:09:49 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:09:49 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:09:49 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG nova.objects.instance [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4ac6f586-cc5b-4a3f-b374-4b2006a48427 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG nova.objects.base [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Object Instance<4ac6f586-cc5b-4a3f-b374-4b2006a48427> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SQOjKMiW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:09:49 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:09:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:09:49 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:09:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:09:49 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:09:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-08fad3d9-330a-48ea-85a2-ccca039509ea tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "b3a04948-936e-47c8-8a5f-e7bdee5b69db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-08fad3d9-330a-48ea-85a2-ccca039509ea tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "b3a04948-936e-47c8-8a5f-e7bdee5b69db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-08fad3d9-330a-48ea-85a2-ccca039509ea tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "b3a04948-936e-47c8-8a5f-e7bdee5b69db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-08fad3d9-330a-48ea-85a2-ccca039509ea tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "b3a04948-936e-47c8-8a5f-e7bdee5b69db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-08fad3d9-330a-48ea-85a2-ccca039509ea tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "b3a04948-936e-47c8-8a5f-e7bdee5b69db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:49 user nova-compute[75745]: INFO nova.compute.manager [None req-08fad3d9-330a-48ea-85a2-ccca039509ea tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Terminating instance
Dec 01 17:09:49 user nova-compute[75745]: DEBUG nova.compute.manager [None req-08fad3d9-330a-48ea-85a2-ccca039509ea tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[99244269-5666-4d8b-a57b-8c4545b8992d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:09:49 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] No VIF found with MAC fa:16:3e:66:74:ba, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c689c8-74ba-412d-9e54-5b2264b814e6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121] added
Dec 01 17:09:49 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b966c6-d364-467d-a273-5afc1876d8dc]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG nova.compute.manager [req-1747a522-4005-49b8-b7ec-a2dc318aa378 req-cf05acdf-ed93-4d4b-b8ad-e43e31e8a087 service nova] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Received event network-changed-1457b6ab-6243-4c0d-a336-441dcdad820d {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG nova.compute.manager [req-1747a522-4005-49b8-b7ec-a2dc318aa378 req-cf05acdf-ed93-4d4b-b8ad-e43e31e8a087 service nova] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Refreshing instance network info cache due to event network-changed-1457b6ab-6243-4c0d-a336-441dcdad820d. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1747a522-4005-49b8-b7ec-a2dc318aa378 req-cf05acdf-ed93-4d4b-b8ad-e43e31e8a087 service nova] Acquiring lock "refresh_cache-b3a04948-936e-47c8-8a5f-e7bdee5b69db" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1747a522-4005-49b8-b7ec-a2dc318aa378 req-cf05acdf-ed93-4d4b-b8ad-e43e31e8a087 service nova] Acquired lock "refresh_cache-b3a04948-936e-47c8-8a5f-e7bdee5b69db" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG nova.network.neutron [req-1747a522-4005-49b8-b7ec-a2dc318aa378 req-cf05acdf-ed93-4d4b-b8ad-e43e31e8a087 service nova] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Refreshing network info cache for port 1457b6ab-6243-4c0d-a336-441dcdad820d {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61427a6-7f9d-4301-b192-8b890bacca14]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SQOjKMiW {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SQOjKMiW" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fa58ff-95d1-4136-a778-77e8050dde48]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SQOjKMiW'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8974f90e-c76a-4d56-af50-4bc860752efd]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6c5f6f-3ddc-4df0-bef3-fe2b1d65131e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)
Dec 01 17:09:49 user nova-compute[75745]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e (non-flash)
Dec 01 17:09:49 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:09:49 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)
Dec 01 17:09:49 user nova-compute[75745]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e (non-flash)
Dec 01 17:09:49 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:09:49 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cce306-1504-4f1a-814e-3f61b9b4d40a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121, portal: 172.16.0.220,3260]
Dec 01 17:09:49 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121, portal: 172.16.0.220,3260] successful.
Dec 01 17:09:49 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-22fc09fc-afc6-4f5f-abe2-ef382a503091 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.742s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[59129723-1e41-4442-bd6a-7b52cd328c6e]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[706f87c0-96a3-4510-b1ae-b8f4d9ba287a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)
Dec 01 17:09:49 user nova-compute[75745]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e (non-flash)
Dec 01 17:09:49 user nova-compute[75745]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:09:49 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:09:49 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)
Dec 01 17:09:49 user nova-compute[75745]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e (non-flash)
Dec 01 17:09:49 user nova-compute[75745]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:09:49 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:09:49 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.410s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.037s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba260ef-2757-4b99-aa09-4bce8c784dba]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SQOjKMiW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG nova.compute.manager [req-9af4ffdc-dab7-4e64-82ca-44fd6d44a982 req-3bb78b56-5502-4db4-8808-eeb34941985d service nova] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Received event network-vif-unplugged-1457b6ab-6243-4c0d-a336-441dcdad820d {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-9af4ffdc-dab7-4e64-82ca-44fd6d44a982 req-3bb78b56-5502-4db4-8808-eeb34941985d service nova] Acquiring lock "b3a04948-936e-47c8-8a5f-e7bdee5b69db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-9af4ffdc-dab7-4e64-82ca-44fd6d44a982 req-3bb78b56-5502-4db4-8808-eeb34941985d service nova] Lock "b3a04948-936e-47c8-8a5f-e7bdee5b69db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-9af4ffdc-dab7-4e64-82ca-44fd6d44a982 req-3bb78b56-5502-4db4-8808-eeb34941985d service nova] Lock "b3a04948-936e-47c8-8a5f-e7bdee5b69db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG nova.compute.manager [req-9af4ffdc-dab7-4e64-82ca-44fd6d44a982 req-3bb78b56-5502-4db4-8808-eeb34941985d service nova] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] No waiting events found dispatching network-vif-unplugged-1457b6ab-6243-4c0d-a336-441dcdad820d {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG nova.compute.manager [req-9af4ffdc-dab7-4e64-82ca-44fd6d44a982 req-3bb78b56-5502-4db4-8808-eeb34941985d service nova] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Received event network-vif-unplugged-1457b6ab-6243-4c0d-a336-441dcdad820d for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:50 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Instance destroyed successfully.
Dec 01 17:09:50 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Instance destroyed successfully.
Dec 01 17:09:50 user nova-compute[75745]: DEBUG nova.objects.instance [None req-08fad3d9-330a-48ea-85a2-ccca039509ea tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lazy-loading 'resources' on Instance uuid b3a04948-936e-47c8-8a5f-e7bdee5b69db {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG nova.objects.instance [None req-17120e19-c2d1-42c4-8427-11df2a58843e tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Lazy-loading 'resources' on Instance uuid d9bfb9f9-95a4-49f5-b781-5e78c83c54d1 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-08fad3d9-330a-48ea-85a2-ccca039509ea tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:07:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1529912563',display_name='tempest-AttachVolumeNegativeTest-server-1529912563',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1529912563',id=12,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBx22Saygtup37i3j0imcyjOsIQHFQhGiFBCD3HVPoBVa8SzI4Lab3PiPMPlLyi9YmTvglelP7KF1NiCosafP/sbMzee9X+93eBqEvSoDmWZ0uH5CpJOwsvGi/Y6JtlBMA==',key_name='tempest-keypair-1098087906',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:08:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1730419061445f98680b8c81753a4f3',ramdisk_id='',reservation_id='r-090fxoxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1227943771',owner_user_name='tempest-AttachVolumeNegativeTest-1227943771-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:08:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76845c98f91449df9196e19187b1b786',uuid=b3a04948-936e-47c8-8a5f-e7bdee5b69db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1457b6ab-6243-4c0d-a336-441dcdad820d", "address": "fa:16:3e:8e:6f:d2", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1457b6ab-62", "ovs_interfaceid": "1457b6ab-6243-4c0d-a336-441dcdad820d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-08fad3d9-330a-48ea-85a2-ccca039509ea tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Converting VIF {"id": "1457b6ab-6243-4c0d-a336-441dcdad820d", "address": "fa:16:3e:8e:6f:d2", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1457b6ab-62", "ovs_interfaceid": "1457b6ab-6243-4c0d-a336-441dcdad820d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-08fad3d9-330a-48ea-85a2-ccca039509ea tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:6f:d2,bridge_name='br-int',has_traffic_filtering=True,id=1457b6ab-6243-4c0d-a336-441dcdad820d,network=Network(8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1457b6ab-62') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG os_vif [None req-08fad3d9-330a-48ea-85a2-ccca039509ea tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:6f:d2,bridge_name='br-int',has_traffic_filtering=True,id=1457b6ab-6243-4c0d-a336-441dcdad820d,network=Network(8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1457b6ab-62') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-17120e19-c2d1-42c4-8427-11df2a58843e tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:06:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1463371879',display_name='tempest-TestVolumeSwap-server-1463371879',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1463371879',id=6,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1GwHWdccv1HjSqp8crhX8CmASt2p7nFMJxD95YF07UWETFHUJ7fCKkes3CaYvpie3VLliCMpk2oJ1UZPGbCqvuwR1onUCJddIF/So0py+OVcvH6VCT63fdWq7LLgITSA==',key_name='tempest-keypair-1848842371',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:06:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a2aaa61f4c24fd5adaca1c9b5445ed8',ramdisk_id='',reservation_id='r-qudp85em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1688920360',owner_user_name='tempest-TestVolumeSwap-1688920360-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:06:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='472f83420af04b39a943b74e012c908d',uuid=d9bfb9f9-95a4-49f5-b781-5e78c83c54d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f322a2f-deae-4c15-8b43-c21c779ed76a", "address": "fa:16:3e:d0:61:8e", "network": {"id": "2cbf6c6e-fe98-488e-b0d7-fe25e97af92d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1025939428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2aaa61f4c24fd5adaca1c9b5445ed8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f322a2f-de", "ovs_interfaceid": "9f322a2f-deae-4c15-8b43-c21c779ed76a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-17120e19-c2d1-42c4-8427-11df2a58843e tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Converting VIF {"id": "9f322a2f-deae-4c15-8b43-c21c779ed76a", "address": "fa:16:3e:d0:61:8e", "network": {"id": "2cbf6c6e-fe98-488e-b0d7-fe25e97af92d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1025939428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2aaa61f4c24fd5adaca1c9b5445ed8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f322a2f-de", "ovs_interfaceid": "9f322a2f-deae-4c15-8b43-c21c779ed76a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-17120e19-c2d1-42c4-8427-11df2a58843e tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:61:8e,bridge_name='br-int',has_traffic_filtering=True,id=9f322a2f-deae-4c15-8b43-c21c779ed76a,network=Network(2cbf6c6e-fe98-488e-b0d7-fe25e97af92d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f322a2f-de') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG os_vif [None req-17120e19-c2d1-42c4-8427-11df2a58843e tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:61:8e,bridge_name='br-int',has_traffic_filtering=True,id=9f322a2f-deae-4c15-8b43-c21c779ed76a,network=Network(2cbf6c6e-fe98-488e-b0d7-fe25e97af92d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f322a2f-de') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1457b6ab-62, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f322a2f-de, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b5375309-ab3b-4f8b-ada0-4632d161938b) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2212808f-0f27-48ec-b359-f631f50437cf) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG nova.network.neutron [req-1747a522-4005-49b8-b7ec-a2dc318aa378 req-cf05acdf-ed93-4d4b-b8ad-e43e31e8a087 service nova] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Updated VIF entry in instance network info cache for port 1457b6ab-6243-4c0d-a336-441dcdad820d. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG nova.network.neutron [req-1747a522-4005-49b8-b7ec-a2dc318aa378 req-cf05acdf-ed93-4d4b-b8ad-e43e31e8a087 service nova] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Updating instance_info_cache with network_info: [{"id": "1457b6ab-6243-4c0d-a336-441dcdad820d", "address": "fa:16:3e:8e:6f:d2", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1457b6ab-62", "ovs_interfaceid": "1457b6ab-6243-4c0d-a336-441dcdad820d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:50 user nova-compute[75745]: INFO os_vif [None req-08fad3d9-330a-48ea-85a2-ccca039509ea tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:6f:d2,bridge_name='br-int',has_traffic_filtering=True,id=1457b6ab-6243-4c0d-a336-441dcdad820d,network=Network(8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1457b6ab-62')
Dec 01 17:09:50 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-08fad3d9-330a-48ea-85a2-ccca039509ea tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Deleting instance files /opt/stack/data/nova/instances/b3a04948-936e-47c8-8a5f-e7bdee5b69db_del
Dec 01 17:09:50 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-08fad3d9-330a-48ea-85a2-ccca039509ea tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Deletion of /opt/stack/data/nova/instances/b3a04948-936e-47c8-8a5f-e7bdee5b69db_del complete
Dec 01 17:09:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:09:50 user nova-compute[75745]: INFO os_vif [None req-17120e19-c2d1-42c4-8427-11df2a58843e tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:61:8e,bridge_name='br-int',has_traffic_filtering=True,id=9f322a2f-deae-4c15-8b43-c21c779ed76a,network=Network(2cbf6c6e-fe98-488e-b0d7-fe25e97af92d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f322a2f-de')
Dec 01 17:09:50 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-17120e19-c2d1-42c4-8427-11df2a58843e tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Deleting instance files /opt/stack/data/nova/instances/d9bfb9f9-95a4-49f5-b781-5e78c83c54d1_del
Dec 01 17:09:50 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-17120e19-c2d1-42c4-8427-11df2a58843e tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Deletion of /opt/stack/data/nova/instances/d9bfb9f9-95a4-49f5-b781-5e78c83c54d1_del complete
Dec 01 17:09:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1747a522-4005-49b8-b7ec-a2dc318aa378 req-cf05acdf-ed93-4d4b-b8ad-e43e31e8a087 service nova] Releasing lock "refresh_cache-b3a04948-936e-47c8-8a5f-e7bdee5b69db" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG nova.compute.manager [req-1747a522-4005-49b8-b7ec-a2dc318aa378 req-cf05acdf-ed93-4d4b-b8ad-e43e31e8a087 service nova] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Received event network-vif-unplugged-9f322a2f-deae-4c15-8b43-c21c779ed76a {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1747a522-4005-49b8-b7ec-a2dc318aa378 req-cf05acdf-ed93-4d4b-b8ad-e43e31e8a087 service nova] Acquiring lock "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1747a522-4005-49b8-b7ec-a2dc318aa378 req-cf05acdf-ed93-4d4b-b8ad-e43e31e8a087 service nova] Lock "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1747a522-4005-49b8-b7ec-a2dc318aa378 req-cf05acdf-ed93-4d4b-b8ad-e43e31e8a087 service nova] Lock "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG nova.compute.manager [req-1747a522-4005-49b8-b7ec-a2dc318aa378 req-cf05acdf-ed93-4d4b-b8ad-e43e31e8a087 service nova] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] No waiting events found dispatching network-vif-unplugged-9f322a2f-deae-4c15-8b43-c21c779ed76a {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG nova.compute.manager [req-1747a522-4005-49b8-b7ec-a2dc318aa378 req-cf05acdf-ed93-4d4b-b8ad-e43e31e8a087 service nova] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Received event network-vif-unplugged-9f322a2f-deae-4c15-8b43-c21c779ed76a for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG nova.compute.manager [req-1747a522-4005-49b8-b7ec-a2dc318aa378 req-cf05acdf-ed93-4d4b-b8ad-e43e31e8a087 service nova] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Received event network-vif-plugged-9f322a2f-deae-4c15-8b43-c21c779ed76a {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1747a522-4005-49b8-b7ec-a2dc318aa378 req-cf05acdf-ed93-4d4b-b8ad-e43e31e8a087 service nova] Acquiring lock "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1747a522-4005-49b8-b7ec-a2dc318aa378 req-cf05acdf-ed93-4d4b-b8ad-e43e31e8a087 service nova] Lock "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1747a522-4005-49b8-b7ec-a2dc318aa378 req-cf05acdf-ed93-4d4b-b8ad-e43e31e8a087 service nova] Lock "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG nova.compute.manager [req-1747a522-4005-49b8-b7ec-a2dc318aa378 req-cf05acdf-ed93-4d4b-b8ad-e43e31e8a087 service nova] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] No waiting events found dispatching network-vif-plugged-9f322a2f-deae-4c15-8b43-c21c779ed76a {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:09:50 user nova-compute[75745]: WARNING nova.compute.manager [req-1747a522-4005-49b8-b7ec-a2dc318aa378 req-cf05acdf-ed93-4d4b-b8ad-e43e31e8a087 service nova] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Received unexpected event network-vif-plugged-9f322a2f-deae-4c15-8b43-c21c779ed76a for instance with vm_state active and task_state deleting.
Dec 01 17:09:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:50 user nova-compute[75745]: INFO nova.compute.manager [None req-08fad3d9-330a-48ea-85a2-ccca039509ea tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Took 1.02 seconds to destroy the instance on the hypervisor.
Dec 01 17:09:50 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-08fad3d9-330a-48ea-85a2-ccca039509ea tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:09:50 user nova-compute[75745]: INFO nova.compute.manager [None req-17120e19-c2d1-42c4-8427-11df2a58843e tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Took 1.63 seconds to destroy the instance on the hypervisor.
Dec 01 17:09:50 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-17120e19-c2d1-42c4-8427-11df2a58843e tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.469s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] <== connect_volume: return (1471ms) {'type': 'block', 'scsi_wwn': '23664333931656464', 'path': '/dev/sdd'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664333931656464', 'path': '/dev/sdd'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:05:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2091565177',display_name='tempest-AttachVolumeTestJSON-server-2091565177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2091565177',id=3,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3XjkUwzRZSzJkFVK8CajxZrqSjgRTlHxxeyK14q4pHPTuyqvoLAZM+Yf8NfQQKwzsK8V31lsj4YBhMGkfSH1VtWc/GskdhpcUVvoTFK+eiPPk/qO2e2As1y2z8e2iGKw==',key_name='tempest-keypair-811365711',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:06:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7c4e507763844b67b588fa2509ec3aff',ramdisk_id='',reservation_id='r-38xwk32b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-712829532',owner_user_name='tempest-AttachVolumeTestJSON-712829532-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:07:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e92e1fa18cc4bdaa17afd2b2db97259',uuid=4ac6f586-cc5b-4a3f-b374-4b2006a48427,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b4990a3b-371a-44eb-98d8-685dc63590da", "address": "fa:16:3e:d3:4e:b4", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4990a3b-37", "ovs_interfaceid": "b4990a3b-371a-44eb-98d8-685dc63590da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Converting VIF {"id": "b4990a3b-371a-44eb-98d8-685dc63590da", "address": "fa:16:3e:d3:4e:b4", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4990a3b-37", "ovs_interfaceid": "b4990a3b-371a-44eb-98d8-685dc63590da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:4e:b4,bridge_name='br-int',has_traffic_filtering=True,id=b4990a3b-371a-44eb-98d8-685dc63590da,network=Network(b2b1c054-5370-4c64-9fb7-b98791c8f5ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4990a3b-37') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG nova.objects.instance [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ac6f586-cc5b-4a3f-b374-4b2006a48427 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG nova.objects.base [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Object Instance<4ac6f586-cc5b-4a3f-b374-4b2006a48427> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:09:50 user nova-compute[75745]:   <uuid>4ac6f586-cc5b-4a3f-b374-4b2006a48427</uuid>
Dec 01 17:09:50 user nova-compute[75745]:   <name>instance-00000003</name>
Dec 01 17:09:50 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:09:50 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:09:50 user nova-compute[75745]:   <metadata>
Dec 01 17:09:50 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:09:50 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:09:50 user nova-compute[75745]:       <nova:name>tempest-AttachVolumeTestJSON-server-2091565177</nova:name>
Dec 01 17:09:50 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:09:49</nova:creationTime>
Dec 01 17:09:50 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:09:50 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:09:50 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:09:50 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:09:50 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:09:50 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:09:50 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:09:50 user nova-compute[75745]:       <nova:owner>
Dec 01 17:09:50 user nova-compute[75745]:         <nova:user uuid="7e92e1fa18cc4bdaa17afd2b2db97259">tempest-AttachVolumeTestJSON-712829532-project-member</nova:user>
Dec 01 17:09:50 user nova-compute[75745]:         <nova:project uuid="7c4e507763844b67b588fa2509ec3aff">tempest-AttachVolumeTestJSON-712829532</nova:project>
Dec 01 17:09:50 user nova-compute[75745]:       </nova:owner>
Dec 01 17:09:50 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:09:50 user nova-compute[75745]:       <nova:ports>
Dec 01 17:09:50 user nova-compute[75745]:         <nova:port uuid="b4990a3b-371a-44eb-98d8-685dc63590da">
Dec 01 17:09:50 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 01 17:09:50 user nova-compute[75745]:         </nova:port>
Dec 01 17:09:50 user nova-compute[75745]:       </nova:ports>
Dec 01 17:09:50 user nova-compute[75745]:     </nova:instance>
Dec 01 17:09:50 user nova-compute[75745]:   </metadata>
Dec 01 17:09:50 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:09:50 user nova-compute[75745]:     <system>
Dec 01 17:09:50 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:09:50 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:09:50 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:09:50 user nova-compute[75745]:       <entry name="serial">4ac6f586-cc5b-4a3f-b374-4b2006a48427</entry>
Dec 01 17:09:50 user nova-compute[75745]:       <entry name="uuid">4ac6f586-cc5b-4a3f-b374-4b2006a48427</entry>
Dec 01 17:09:50 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:09:50 user nova-compute[75745]:     </system>
Dec 01 17:09:50 user nova-compute[75745]:   </sysinfo>
Dec 01 17:09:50 user nova-compute[75745]:   <os>
Dec 01 17:09:50 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:09:50 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:09:50 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:09:50 user nova-compute[75745]:   </os>
Dec 01 17:09:50 user nova-compute[75745]:   <features>
Dec 01 17:09:50 user nova-compute[75745]:     <acpi/>
Dec 01 17:09:50 user nova-compute[75745]:     <apic/>
Dec 01 17:09:50 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:09:50 user nova-compute[75745]:   </features>
Dec 01 17:09:50 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:09:50 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:09:50 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:09:50 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:09:50 user nova-compute[75745]:   </clock>
Dec 01 17:09:50 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:09:50 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:09:50 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:09:50 user nova-compute[75745]:   </cpu>
Dec 01 17:09:50 user nova-compute[75745]:   <devices>
Dec 01 17:09:50 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:09:50 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:09:50 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk"/>
Dec 01 17:09:50 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:09:50 user nova-compute[75745]:     </disk>
Dec 01 17:09:50 user nova-compute[75745]:     <disk type="block" device="disk">
Dec 01 17:09:50 user nova-compute[75745]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:09:50 user nova-compute[75745]:       <source dev="/dev/sdd"/>
Dec 01 17:09:50 user nova-compute[75745]:       <target dev="vdb" bus="virtio"/>
Dec 01 17:09:50 user nova-compute[75745]:       <serial>609a2122-bfa0-40d7-b912-c4d799157121</serial>
Dec 01 17:09:50 user nova-compute[75745]:     </disk>
Dec 01 17:09:50 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:09:50 user nova-compute[75745]:       <mac address="fa:16:3e:d3:4e:b4"/>
Dec 01 17:09:50 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:09:50 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:09:50 user nova-compute[75745]:       <target dev="tapb4990a3b-37"/>
Dec 01 17:09:50 user nova-compute[75745]:     </interface>
Dec 01 17:09:50 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:09:50 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/console.log" append="off"/>
Dec 01 17:09:50 user nova-compute[75745]:     </serial>
Dec 01 17:09:50 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:09:50 user nova-compute[75745]:     <video>
Dec 01 17:09:50 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:09:50 user nova-compute[75745]:     </video>
Dec 01 17:09:50 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:09:50 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:09:50 user nova-compute[75745]:     </rng>
Dec 01 17:09:50 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:09:50 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:09:50 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:09:50 user nova-compute[75745]:     </memballoon>
Dec 01 17:09:50 user nova-compute[75745]:   </devices>
Dec 01 17:09:50 user nova-compute[75745]: </domain>
Dec 01 17:09:50 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:50 user nova-compute[75745]: INFO nova.compute.manager [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Rescuing
Dec 01 17:09:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Acquiring lock "refresh_cache-2abc6436-bf45-497a-acd2-47d43d5e158c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Acquired lock "refresh_cache-2abc6436-bf45-497a-acd2-47d43d5e158c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:09:50 user nova-compute[75745]: DEBUG nova.network.neutron [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG nova.objects.instance [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4ac6f586-cc5b-4a3f-b374-4b2006a48427 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG nova.objects.base [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Object Instance<4ac6f586-cc5b-4a3f-b374-4b2006a48427> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-4092735e-2f0c-4a6c-bd64-d43227dfd0f3 req-69278041-a27a-4501-9959-62cb7960f34e service nova] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Received event network-vif-deleted-9f322a2f-deae-4c15-8b43-c21c779ed76a {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:09:51 user nova-compute[75745]: INFO nova.compute.manager [req-4092735e-2f0c-4a6c-bd64-d43227dfd0f3 req-69278041-a27a-4501-9959-62cb7960f34e service nova] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Neutron deleted interface 9f322a2f-deae-4c15-8b43-c21c779ed76a; detaching it from the instance and deleting it from the info cache
Dec 01 17:09:51 user nova-compute[75745]: DEBUG nova.network.neutron [req-4092735e-2f0c-4a6c-bd64-d43227dfd0f3 req-69278041-a27a-4501-9959-62cb7960f34e service nova] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:09:51 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Took 1.20 seconds to deallocate network for instance.
Dec 01 17:09:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.239s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-4092735e-2f0c-4a6c-bd64-d43227dfd0f3 req-69278041-a27a-4501-9959-62cb7960f34e service nova] [instance: d9bfb9f9-95a4-49f5-b781-5e78c83c54d1] Detach interface failed, port_id=9f322a2f-deae-4c15-8b43-c21c779ed76a, reason: Instance d9bfb9f9-95a4-49f5-b781-5e78c83c54d1 could not be found. {{(pid=75745) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-17120e19-c2d1-42c4-8427-11df2a58843e tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-17120e19-c2d1-42c4-8427-11df2a58843e tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG nova.network.neutron [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Updating instance_info_cache with network_info: [{"id": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "address": "fa:16:3e:66:74:ba", "network": {"id": "3d78774f-ff2b-4705-b359-7a1fb7fc272f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-234182378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1efefd35d14e03a3eebfff2ac0d335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5897fde5-fe", "ovs_interfaceid": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Releasing lock "refresh_cache-2abc6436-bf45-497a-acd2-47d43d5e158c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Cannot resize image /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG nova.objects.instance [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lazy-loading 'migration_context' on Instance uuid 4ac6f586-cc5b-4a3f-b374-4b2006a48427 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG nova.objects.base [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Object Instance<4ac6f586-cc5b-4a3f-b374-4b2006a48427> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:05:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2091565177',display_name='tempest-AttachVolumeTestJSON-server-2091565177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2091565177',id=3,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3XjkUwzRZSzJkFVK8CajxZrqSjgRTlHxxeyK14q4pHPTuyqvoLAZM+Yf8NfQQKwzsK8V31lsj4YBhMGkfSH1VtWc/GskdhpcUVvoTFK+eiPPk/qO2e2As1y2z8e2iGKw==',key_name='tempest-keypair-811365711',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:06:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='7c4e507763844b67b588fa2509ec3aff',ramdisk_id='',reservation_id='r-38xwk32b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-712829532',owner_user_name='tempest-AttachVolumeTestJSON-712829532-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:07:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e92e1fa18cc4bdaa17afd2b2db97259',uuid=4ac6f586-cc5b-4a3f-b374-4b2006a48427,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b4990a3b-371a-44eb-98d8-685dc63590da", "address": "fa:16:3e:d3:4e:b4", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4990a3b-37", "ovs_interfaceid": "b4990a3b-371a-44eb-98d8-685dc63590da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Converting VIF {"id": "b4990a3b-371a-44eb-98d8-685dc63590da", "address": "fa:16:3e:d3:4e:b4", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4990a3b-37", "ovs_interfaceid": "b4990a3b-371a-44eb-98d8-685dc63590da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:4e:b4,bridge_name='br-int',has_traffic_filtering=True,id=b4990a3b-371a-44eb-98d8-685dc63590da,network=Network(b2b1c054-5370-4c64-9fb7-b98791c8f5ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4990a3b-37') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG os_vif [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:4e:b4,bridge_name='br-int',has_traffic_filtering=True,id=b4990a3b-371a-44eb-98d8-685dc63590da,network=Network(b2b1c054-5370-4c64-9fb7-b98791c8f5ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4990a3b-37') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '84adab1e-4b86-5406-9964-83fef1e265db', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4990a3b-37, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb4990a3b-37, col_values=(('qos', UUID('f29475b8-cc92-4a8c-985a-bd9aed826989')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb4990a3b-37, col_values=(('external_ids', {'iface-id': 'b4990a3b-371a-44eb-98d8-685dc63590da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:4e:b4', 'vm-uuid': '4ac6f586-cc5b-4a3f-b374-4b2006a48427'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:51 user nova-compute[75745]: INFO os_vif [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:4e:b4,bridge_name='br-int',has_traffic_filtering=True,id=b4990a3b-371a-44eb-98d8-685dc63590da,network=Network(b2b1c054-5370-4c64-9fb7-b98791c8f5ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4990a3b-37')
Dec 01 17:09:51 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-17120e19-c2d1-42c4-8427-11df2a58843e tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-85cb0cc4-0144-473a-a78a-f93026b829f9 req-59f2631b-ae23-4a99-96b2-18e622ca8bd6 service nova] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Received event network-vif-plugged-1457b6ab-6243-4c0d-a336-441dcdad820d {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-85cb0cc4-0144-473a-a78a-f93026b829f9 req-59f2631b-ae23-4a99-96b2-18e622ca8bd6 service nova] Acquiring lock "b3a04948-936e-47c8-8a5f-e7bdee5b69db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-85cb0cc4-0144-473a-a78a-f93026b829f9 req-59f2631b-ae23-4a99-96b2-18e622ca8bd6 service nova] Lock "b3a04948-936e-47c8-8a5f-e7bdee5b69db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-85cb0cc4-0144-473a-a78a-f93026b829f9 req-59f2631b-ae23-4a99-96b2-18e622ca8bd6 service nova] Lock "b3a04948-936e-47c8-8a5f-e7bdee5b69db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-85cb0cc4-0144-473a-a78a-f93026b829f9 req-59f2631b-ae23-4a99-96b2-18e622ca8bd6 service nova] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] No waiting events found dispatching network-vif-plugged-1457b6ab-6243-4c0d-a336-441dcdad820d {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:09:51 user nova-compute[75745]: WARNING nova.compute.manager [req-85cb0cc4-0144-473a-a78a-f93026b829f9 req-59f2631b-ae23-4a99-96b2-18e622ca8bd6 service nova] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Received unexpected event network-vif-plugged-1457b6ab-6243-4c0d-a336-441dcdad820d for instance with vm_state active and task_state deleting.
Dec 01 17:09:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-85cb0cc4-0144-473a-a78a-f93026b829f9 req-59f2631b-ae23-4a99-96b2-18e622ca8bd6 service nova] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Received event network-vif-plugged-1457b6ab-6243-4c0d-a336-441dcdad820d {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-85cb0cc4-0144-473a-a78a-f93026b829f9 req-59f2631b-ae23-4a99-96b2-18e622ca8bd6 service nova] Acquiring lock "b3a04948-936e-47c8-8a5f-e7bdee5b69db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-85cb0cc4-0144-473a-a78a-f93026b829f9 req-59f2631b-ae23-4a99-96b2-18e622ca8bd6 service nova] Lock "b3a04948-936e-47c8-8a5f-e7bdee5b69db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-85cb0cc4-0144-473a-a78a-f93026b829f9 req-59f2631b-ae23-4a99-96b2-18e622ca8bd6 service nova] Lock "b3a04948-936e-47c8-8a5f-e7bdee5b69db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-85cb0cc4-0144-473a-a78a-f93026b829f9 req-59f2631b-ae23-4a99-96b2-18e622ca8bd6 service nova] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] No waiting events found dispatching network-vif-plugged-1457b6ab-6243-4c0d-a336-441dcdad820d {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:09:51 user nova-compute[75745]: WARNING nova.compute.manager [req-85cb0cc4-0144-473a-a78a-f93026b829f9 req-59f2631b-ae23-4a99-96b2-18e622ca8bd6 service nova] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Received unexpected event network-vif-plugged-1457b6ab-6243-4c0d-a336-441dcdad820d for instance with vm_state active and task_state deleting.
Dec 01 17:09:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-85cb0cc4-0144-473a-a78a-f93026b829f9 req-59f2631b-ae23-4a99-96b2-18e622ca8bd6 service nova] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Received event network-vif-plugged-1457b6ab-6243-4c0d-a336-441dcdad820d {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-85cb0cc4-0144-473a-a78a-f93026b829f9 req-59f2631b-ae23-4a99-96b2-18e622ca8bd6 service nova] Acquiring lock "b3a04948-936e-47c8-8a5f-e7bdee5b69db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-85cb0cc4-0144-473a-a78a-f93026b829f9 req-59f2631b-ae23-4a99-96b2-18e622ca8bd6 service nova] Lock "b3a04948-936e-47c8-8a5f-e7bdee5b69db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-85cb0cc4-0144-473a-a78a-f93026b829f9 req-59f2631b-ae23-4a99-96b2-18e622ca8bd6 service nova] Lock "b3a04948-936e-47c8-8a5f-e7bdee5b69db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-85cb0cc4-0144-473a-a78a-f93026b829f9 req-59f2631b-ae23-4a99-96b2-18e622ca8bd6 service nova] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] No waiting events found dispatching network-vif-plugged-1457b6ab-6243-4c0d-a336-441dcdad820d {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:09:51 user nova-compute[75745]: WARNING nova.compute.manager [req-85cb0cc4-0144-473a-a78a-f93026b829f9 req-59f2631b-ae23-4a99-96b2-18e622ca8bd6 service nova] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Received unexpected event network-vif-plugged-1457b6ab-6243-4c0d-a336-441dcdad820d for instance with vm_state active and task_state deleting.
Dec 01 17:09:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-85cb0cc4-0144-473a-a78a-f93026b829f9 req-59f2631b-ae23-4a99-96b2-18e622ca8bd6 service nova] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Received event network-vif-unplugged-1457b6ab-6243-4c0d-a336-441dcdad820d {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-85cb0cc4-0144-473a-a78a-f93026b829f9 req-59f2631b-ae23-4a99-96b2-18e622ca8bd6 service nova] Acquiring lock "b3a04948-936e-47c8-8a5f-e7bdee5b69db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-85cb0cc4-0144-473a-a78a-f93026b829f9 req-59f2631b-ae23-4a99-96b2-18e622ca8bd6 service nova] Lock "b3a04948-936e-47c8-8a5f-e7bdee5b69db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-85cb0cc4-0144-473a-a78a-f93026b829f9 req-59f2631b-ae23-4a99-96b2-18e622ca8bd6 service nova] Lock "b3a04948-936e-47c8-8a5f-e7bdee5b69db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-85cb0cc4-0144-473a-a78a-f93026b829f9 req-59f2631b-ae23-4a99-96b2-18e622ca8bd6 service nova] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] No waiting events found dispatching network-vif-unplugged-1457b6ab-6243-4c0d-a336-441dcdad820d {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-85cb0cc4-0144-473a-a78a-f93026b829f9 req-59f2631b-ae23-4a99-96b2-18e622ca8bd6 service nova] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Received event network-vif-unplugged-1457b6ab-6243-4c0d-a336-441dcdad820d for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-85cb0cc4-0144-473a-a78a-f93026b829f9 req-59f2631b-ae23-4a99-96b2-18e622ca8bd6 service nova] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Received event network-vif-plugged-1457b6ab-6243-4c0d-a336-441dcdad820d {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-85cb0cc4-0144-473a-a78a-f93026b829f9 req-59f2631b-ae23-4a99-96b2-18e622ca8bd6 service nova] Acquiring lock "b3a04948-936e-47c8-8a5f-e7bdee5b69db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-85cb0cc4-0144-473a-a78a-f93026b829f9 req-59f2631b-ae23-4a99-96b2-18e622ca8bd6 service nova] Lock "b3a04948-936e-47c8-8a5f-e7bdee5b69db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-85cb0cc4-0144-473a-a78a-f93026b829f9 req-59f2631b-ae23-4a99-96b2-18e622ca8bd6 service nova] Lock "b3a04948-936e-47c8-8a5f-e7bdee5b69db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-85cb0cc4-0144-473a-a78a-f93026b829f9 req-59f2631b-ae23-4a99-96b2-18e622ca8bd6 service nova] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] No waiting events found dispatching network-vif-plugged-1457b6ab-6243-4c0d-a336-441dcdad820d {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:09:51 user nova-compute[75745]: WARNING nova.compute.manager [req-85cb0cc4-0144-473a-a78a-f93026b829f9 req-59f2631b-ae23-4a99-96b2-18e622ca8bd6 service nova] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Received unexpected event network-vif-plugged-1457b6ab-6243-4c0d-a336-441dcdad820d for instance with vm_state active and task_state deleting.
Dec 01 17:09:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-17120e19-c2d1-42c4-8427-11df2a58843e tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-17120e19-c2d1-42c4-8427-11df2a58843e tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:52 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-17120e19-c2d1-42c4-8427-11df2a58843e tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Deleted allocations for instance d9bfb9f9-95a4-49f5-b781-5e78c83c54d1
Dec 01 17:09:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-17120e19-c2d1-42c4-8427-11df2a58843e tempest-TestVolumeSwap-1688920360 tempest-TestVolumeSwap-1688920360-project-member] Lock "d9bfb9f9-95a4-49f5-b781-5e78c83c54d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.472s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:52 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:09:52 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Took 2.04 seconds to deallocate network for instance.
Dec 01 17:09:52 user nova-compute[75745]: DEBUG nova.compute.manager [req-106c20eb-0626-4f70-ad3a-da2d0e53570d req-ae4f48d2-b833-46f6-ab40-b98a1ab93e09 service nova] [instance: b3a04948-936e-47c8-8a5f-e7bdee5b69db] Received event network-vif-deleted-1457b6ab-6243-4c0d-a336-441dcdad820d {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:09:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-08fad3d9-330a-48ea-85a2-ccca039509ea tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-08fad3d9-330a-48ea-85a2-ccca039509ea tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:52 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-08fad3d9-330a-48ea-85a2-ccca039509ea tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:09:52 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-08fad3d9-330a-48ea-85a2-ccca039509ea tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:09:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-08fad3d9-330a-48ea-85a2-ccca039509ea tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:52 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-08fad3d9-330a-48ea-85a2-ccca039509ea tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Deleted allocations for instance b3a04948-936e-47c8-8a5f-e7bdee5b69db
Dec 01 17:09:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-08fad3d9-330a-48ea-85a2-ccca039509ea tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "b3a04948-936e-47c8-8a5f-e7bdee5b69db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.725s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:53 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Instance destroyed successfully.
Dec 01 17:09:53 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Attempting a stable device rescue
Dec 01 17:09:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75745) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 01 17:09:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Instance directory exists: not creating {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Dec 01 17:09:53 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Creating image(s)
Dec 01 17:09:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Acquiring lock "/opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "/opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "/opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:53 user nova-compute[75745]: DEBUG nova.objects.instance [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2abc6436-bf45-497a-acd2-47d43d5e158c {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:09:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Acquiring lock "adc667bbe95b665dffefc10f171a91c672a52d6a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "adc667bbe95b665dffefc10f171a91c672a52d6a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:53 user nova-compute[75745]: DEBUG nova.compute.manager [req-5764e940-1a57-483f-bb3b-29d45de589a4 req-6e92fdda-7ace-4020-8cdf-5a0833e05284 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Received event network-vif-unplugged-5897fde5-fea9-4ff3-98b8-db1020cf5127 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:09:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5764e940-1a57-483f-bb3b-29d45de589a4 req-6e92fdda-7ace-4020-8cdf-5a0833e05284 service nova] Acquiring lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5764e940-1a57-483f-bb3b-29d45de589a4 req-6e92fdda-7ace-4020-8cdf-5a0833e05284 service nova] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5764e940-1a57-483f-bb3b-29d45de589a4 req-6e92fdda-7ace-4020-8cdf-5a0833e05284 service nova] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:53 user nova-compute[75745]: DEBUG nova.compute.manager [req-5764e940-1a57-483f-bb3b-29d45de589a4 req-6e92fdda-7ace-4020-8cdf-5a0833e05284 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] No waiting events found dispatching network-vif-unplugged-5897fde5-fea9-4ff3-98b8-db1020cf5127 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:09:53 user nova-compute[75745]: WARNING nova.compute.manager [req-5764e940-1a57-483f-bb3b-29d45de589a4 req-6e92fdda-7ace-4020-8cdf-5a0833e05284 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Received unexpected event network-vif-unplugged-5897fde5-fea9-4ff3-98b8-db1020cf5127 for instance with vm_state active and task_state rescuing.
Dec 01 17:09:53 user nova-compute[75745]: DEBUG nova.compute.manager [req-5764e940-1a57-483f-bb3b-29d45de589a4 req-6e92fdda-7ace-4020-8cdf-5a0833e05284 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Received event network-vif-plugged-5897fde5-fea9-4ff3-98b8-db1020cf5127 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:09:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5764e940-1a57-483f-bb3b-29d45de589a4 req-6e92fdda-7ace-4020-8cdf-5a0833e05284 service nova] Acquiring lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5764e940-1a57-483f-bb3b-29d45de589a4 req-6e92fdda-7ace-4020-8cdf-5a0833e05284 service nova] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5764e940-1a57-483f-bb3b-29d45de589a4 req-6e92fdda-7ace-4020-8cdf-5a0833e05284 service nova] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:53 user nova-compute[75745]: DEBUG nova.compute.manager [req-5764e940-1a57-483f-bb3b-29d45de589a4 req-6e92fdda-7ace-4020-8cdf-5a0833e05284 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] No waiting events found dispatching network-vif-plugged-5897fde5-fea9-4ff3-98b8-db1020cf5127 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:09:53 user nova-compute[75745]: WARNING nova.compute.manager [req-5764e940-1a57-483f-bb3b-29d45de589a4 req-6e92fdda-7ace-4020-8cdf-5a0833e05284 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Received unexpected event network-vif-plugged-5897fde5-fea9-4ff3-98b8-db1020cf5127 for instance with vm_state active and task_state rescuing.
Dec 01 17:09:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adc667bbe95b665dffefc10f171a91c672a52d6a.part --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:55 user nova-compute[75745]: DEBUG nova.compute.manager [req-5998ab68-34ad-4698-ad3a-39f542b0a4ae req-ae0b7c49-8337-48cd-a441-88f9809266e4 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Received event network-vif-plugged-b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:09:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5998ab68-34ad-4698-ad3a-39f542b0a4ae req-ae0b7c49-8337-48cd-a441-88f9809266e4 service nova] Acquiring lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5998ab68-34ad-4698-ad3a-39f542b0a4ae req-ae0b7c49-8337-48cd-a441-88f9809266e4 service nova] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5998ab68-34ad-4698-ad3a-39f542b0a4ae req-ae0b7c49-8337-48cd-a441-88f9809266e4 service nova] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:55 user nova-compute[75745]: DEBUG nova.compute.manager [req-5998ab68-34ad-4698-ad3a-39f542b0a4ae req-ae0b7c49-8337-48cd-a441-88f9809266e4 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] No waiting events found dispatching network-vif-plugged-b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:09:55 user nova-compute[75745]: WARNING nova.compute.manager [req-5998ab68-34ad-4698-ad3a-39f542b0a4ae req-ae0b7c49-8337-48cd-a441-88f9809266e4 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Received unexpected event network-vif-plugged-b4990a3b-371a-44eb-98d8-685dc63590da for instance with vm_state stopped and task_state powering-on.
Dec 01 17:09:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adc667bbe95b665dffefc10f171a91c672a52d6a.part --force-share --output=json" returned: 0 in 0.207s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:55 user nova-compute[75745]: DEBUG nova.virt.images [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] 32a0d231-2c40-4479-be1a-7c60f43b3983 was qcow2, converting to raw {{(pid=75745) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 01 17:09:55 user nova-compute[75745]: DEBUG nova.privsep.utils [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75745) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 17:09:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/adc667bbe95b665dffefc10f171a91c672a52d6a.part /opt/stack/data/nova/instances/_base/adc667bbe95b665dffefc10f171a91c672a52d6a.converted {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/adc667bbe95b665dffefc10f171a91c672a52d6a.part /opt/stack/data/nova/instances/_base/adc667bbe95b665dffefc10f171a91c672a52d6a.converted" returned: 0 in 0.949s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adc667bbe95b665dffefc10f171a91c672a52d6a.converted --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adc667bbe95b665dffefc10f171a91c672a52d6a.converted --force-share --output=json" returned: 0 in 0.207s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "adc667bbe95b665dffefc10f171a91c672a52d6a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.931s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Acquiring lock "adc667bbe95b665dffefc10f171a91c672a52d6a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "adc667bbe95b665dffefc10f171a91c672a52d6a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adc667bbe95b665dffefc10f171a91c672a52d6a --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/adc667bbe95b665dffefc10f171a91c672a52d6a --force-share --output=json" returned: 0 in 0.188s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adc667bbe95b665dffefc10f171a91c672a52d6a,backing_fmt=raw /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk.rescue {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/adc667bbe95b665dffefc10f171a91c672a52d6a,backing_fmt=raw /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk.rescue" returned: 0 in 0.060s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "adc667bbe95b665dffefc10f171a91c672a52d6a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG nova.objects.instance [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lazy-loading 'migration_context' on Instance uuid 2abc6436-bf45-497a-acd2-47d43d5e158c {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG nova.objects.base [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Object Instance<2abc6436-bf45-497a-acd2-47d43d5e158c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Start _get_guest_xml network_info=[{"id": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "address": "fa:16:3e:66:74:ba", "network": {"id": "3d78774f-ff2b-4705-b359-7a1fb7fc272f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-234182378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-234182378-network", "vif_mac": "fa:16:3e:66:74:ba"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1efefd35d14e03a3eebfff2ac0d335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5897fde5-fe", "ovs_interfaceid": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '32a0d231-2c40-4479-be1a-7c60f43b3983', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': 'e678d6bd-eb21-40ed-a44c-99e0c3728526', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FkMgtsJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '2abc6436-bf45-497a-acd2-47d43d5e158c', 'attached_at': '', 'detached_at': '', 'volume_id': 'fcd8549e-610f-4ede-841e-88c1b93df25e', 'serial': 'fcd8549e-610f-4ede-841e-88c1b93df25e'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG nova.objects.instance [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lazy-loading 'resources' on Instance uuid 2abc6436-bf45-497a-acd2-47d43d5e158c {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG nova.objects.base [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Object Instance<2abc6436-bf45-497a-acd2-47d43d5e158c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG nova.objects.instance [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lazy-loading 'numa_topology' on Instance uuid 2abc6436-bf45-497a-acd2-47d43d5e158c {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG nova.objects.base [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Object Instance<2abc6436-bf45-497a-acd2-47d43d5e158c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:09:56 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:09:56 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:09:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG nova.objects.instance [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2abc6436-bf45-497a-acd2-47d43d5e158c {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG nova.objects.base [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Object Instance<2abc6436-bf45-497a-acd2-47d43d5e158c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FkMgtsJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:09:56 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:09:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:09:56 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:09:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:09:56 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:09:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-24d38f4d-4be3-4bde-b039-69c82b576885 req-badc7b65-e9ea-45e3-be22-6cdcc736e0f5 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Received event network-vif-plugged-b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-24d38f4d-4be3-4bde-b039-69c82b576885 req-badc7b65-e9ea-45e3-be22-6cdcc736e0f5 service nova] Acquiring lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-24d38f4d-4be3-4bde-b039-69c82b576885 req-badc7b65-e9ea-45e3-be22-6cdcc736e0f5 service nova] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-24d38f4d-4be3-4bde-b039-69c82b576885 req-badc7b65-e9ea-45e3-be22-6cdcc736e0f5 service nova] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-24d38f4d-4be3-4bde-b039-69c82b576885 req-badc7b65-e9ea-45e3-be22-6cdcc736e0f5 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] No waiting events found dispatching network-vif-plugged-b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:09:56 user nova-compute[75745]: WARNING nova.compute.manager [req-24d38f4d-4be3-4bde-b039-69c82b576885 req-badc7b65-e9ea-45e3-be22-6cdcc736e0f5 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Received unexpected event network-vif-plugged-b4990a3b-371a-44eb-98d8-685dc63590da for instance with vm_state stopped and task_state powering-on.
Dec 01 17:09:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f88da21-c9e7-48b6-8b10-1ea084220bf3]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = FkMgtsJH\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Dec 01 17:09:56 user nova-compute[75745]: node.name = iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e
Dec 01 17:09:56 user nova-compute[75745]: node.tpgt = -1
Dec 01 17:09:56 user nova-compute[75745]: node.startup = automatic
Dec 01 17:09:56 user nova-compute[75745]: node.leading_login = No
Dec 01 17:09:56 user nova-compute[75745]: iface.iscsi_ifacename = default
Dec 01 17:09:56 user nova-compute[75745]: iface.net_ifacename = <empty>
Dec 01 17:09:56 user nova-compute[75745]: iface.ipaddress = <empty>
Dec 01 17:09:56 user nova-compute[75745]: iface.prefix_len = 0
Dec 01 17:09:56 user nova-compute[75745]: iface.hwaddress = <empty>
Dec 01 17:09:56 user nova-compute[75745]: iface.transport_name = tcp
Dec 01 17:09:56 user nova-compute[75745]: iface.initiatorname = <empty>
Dec 01 17:09:56 user nova-compute[75745]: iface.state = <empty>
Dec 01 17:09:56 user nova-compute[75745]: iface.vlan_id = 0
Dec 01 17:09:56 user nova-compute[75745]: iface.vlan_priority = 0
Dec 01 17:09:56 user nova-compute[75745]: iface.vlan_state = <empty>
Dec 01 17:09:56 user nova-compute[75745]: iface.iface_num = 0
Dec 01 17:09:56 user nova-compute[75745]: iface.mtu = 0
Dec 01 17:09:56 user nova-compute[75745]: iface.port = 0
Dec 01 17:09:56 user nova-compute[75745]: iface.bootproto = <empty>
Dec 01 17:09:56 user nova-compute[75745]: iface.subnet_mask = <empty>
Dec 01 17:09:56 user nova-compute[75745]: iface.gateway = <empty>
Dec 01 17:09:56 user nova-compute[75745]: iface.dhcp_alt_client_id_state = <empty>
Dec 01 17:09:56 user nova-compute[75745]: iface.dhcp_alt_client_id = <empty>
Dec 01 17:09:56 user nova-compute[75745]: iface.dhcp_dns = <empty>
Dec 01 17:09:56 user nova-compute[75745]: iface.dhcp_learn_iqn = <empty>
Dec 01 17:09:56 user nova-compute[75745]: iface.dhcp_req_vendor_id_state = <empty>
Dec 01 17:09:56 user nova-compute[75745]: iface.dhcp_vendor_id_state = <empty>
Dec 01 17:09:56 user nova-compute[75745]: iface.dhcp_vendor_id = <empty>
Dec 01 17:09:56 user nova-compute[75745]: iface.dhcp_slp_da = <empty>
Dec 01 17:09:56 user nova-compute[75745]: iface.fragmentation = <empty>
Dec 01 17:09:56 user nova-compute[75745]: iface.gratuitous_arp = <empty>
Dec 01 17:09:56 user nova-compute[75745]: iface.incoming_forwarding = <empty>
Dec 01 17:09:56 user nova-compute[75745]: iface.tos_state = <empty>
Dec 01 17:09:56 user nova-compute[75745]: iface.tos = 0
Dec 01 17:09:56 user nova-compute[75745]: iface.ttl = 0
Dec 01 17:09:56 user nova-compute[75745]: iface.delayed_ack = <empty>
Dec 01 17:09:56 user nova-compute[75745]: iface.tcp_nagle = <empty>
Dec 01 17:09:56 user nova-compute[75745]: iface.tcp_wsf_state = <empty>
Dec 01 17:09:56 user nova-compute[75745]: iface.tcp_wsf = 0
Dec 01 17:09:56 user nova-compute[75745]: iface.tcp_timer_scale = 0
Dec 01 17:09:56 user nova-compute[75745]: iface.tcp_timestamp = <empty>
Dec 01 17:09:56 user nova-compute[75745]: iface.redirect = <empty>
Dec 01 17:09:56 user nova-compute[75745]: iface.def_task_mgmt_timeout = 0
Dec 01 17:09:56 user nova-compute[75745]: iface.header_digest = <empty>
Dec 01 17:09:56 user nova-compute[75745]: iface.data_digest = <empty>
Dec 01 17:09:56 user nova-compute[75745]: iface.immediate_data = <empty>
Dec 01 17:09:56 user nova-compute[75745]: iface.initial_r2t = <empty>
Dec 01 17:09:56 user nova-compute[75745]: iface.data_seq_inorder = <empty>
Dec 01 17:09:56 user nova-compute[75745]: iface.data_pdu_inorder = <empty>
Dec 01 17:09:56 user nova-compute[75745]: iface.erl = 0
Dec 01 17:09:56 user nova-compute[75745]: iface.max_receive_data_len = 0
Dec 01 17:09:56 user nova-compute[75745]: iface.first_burst_len = 0
Dec 01 17:09:56 user nova-compute[75745]: iface.max_outstanding_r2t = 0
Dec 01 17:09:56 user nova-compute[75745]: iface.max_burst_len = 0
Dec 01 17:09:56 user nova-compute[75745]: iface.chap_auth = <empty>
Dec 01 17:09:56 user nova-compute[75745]: iface.bidi_chap = <empty>
Dec 01 17:09:56 user nova-compute[75745]: iface.strict_login_compliance = <empty>
Dec 01 17:09:56 user nova-compute[75745]: iface.discovery_auth = <empty>
Dec 01 17:09:56 user nova-compute[75745]: iface.discovery_logout = <empty>
Dec 01 17:09:56 user nova-compute[75745]: node.discovery_address = <empty>
Dec 01 17:09:56 user nova-compute[75745]: node.discovery_port = 0
Dec 01 17:09:56 user nova-compute[75745]: node.discovery_type = static
Dec 01 17:09:56 user nova-compute[75745]: node.session.initial_cmdsn = 0
Dec 01 17:09:56 user nova-compute[75745]: node.session.initial_login_retry_max = 8
Dec 01 17:09:56 user nova-compute[75745]: node.session.xmit_thread_priority = -20
Dec 01 17:09:56 user nova-compute[75745]: node.session.cmds_max = 128
Dec 01 17:09:56 user nova-compute[75745]: node.session.queue_depth = 32
Dec 01 17:09:56 user nova-compute[75745]: node.session.nr_sessions = 1
Dec 01 17:09:56 user nova-compute[75745]: node.session.auth.authmethod = CHAP
Dec 01 17:09:56 user nova-compute[75745]: node.session.auth.username = FkMgtsJH
Dec 01 17:09:56 user nova-compute[75745]: node.session.auth.password = ***
Dec 01 17:09:56 user nova-compute[75745]: node.session.auth.username_in = <empty>
Dec 01 17:09:56 user nova-compute[75745]: node.session.auth.password_in = <empty>
Dec 01 17:09:56 user nova-compute[75745]: node.session.auth.chap_algs = MD5
Dec 01 17:09:56 user nova-compute[75745]: node.session.timeo.replacement_timeout = 120
Dec 01 17:09:56 user nova-compute[75745]: node.session.err_timeo.abort_timeout = 15
Dec 01 17:09:56 user nova-compute[75745]: node.session.err_timeo.lu_reset_timeout = 30
Dec 01 17:09:56 user nova-compute[75745]: node.session.err_timeo.tgt_reset_timeout = 30
Dec 01 17:09:56 user nova-compute[75745]: node.session.err_timeo.host_reset_timeout = 60
Dec 01 17:09:56 user nova-compute[75745]: node.session.iscsi.FastAbort = Yes
Dec 01 17:09:56 user nova-compute[75745]: node.session.iscsi.InitialR2T = No
Dec 01 17:09:56 user nova-compute[75745]: node.session.iscsi.ImmediateData = Yes
Dec 01 17:09:56 user nova-compute[75745]: node.session.iscsi.FirstBurstLength = 262144
Dec 01 17:09:56 user nova-compute[75745]: node.session.iscsi.MaxBurstLength = 16776192
Dec 01 17:09:56 user nova-compute[75745]: node.session.iscsi.DefaultTime2Retain = 0
Dec 01 17:09:56 user nova-compute[75745]: node.session.iscsi.DefaultTime2Wait = 2
Dec 01 17:09:56 user nova-compute[75745]: node.session.iscsi.MaxConnections = 1
Dec 01 17:09:56 user nova-compute[75745]: node.session.iscsi.MaxOutstandingR2T = 1
Dec 01 17:09:56 user nova-compute[75745]: node.session.iscsi.ERL = 0
Dec 01 17:09:56 user nova-compute[75745]: node.session.scan = manual
Dec 01 17:09:56 user nova-compute[75745]: node.session.reopen_max = 0
Dec 01 17:09:56 user nova-compute[75745]: node.conn[0].address = 172.16.0.220
Dec 01 17:09:56 user nova-compute[75745]: node.conn[0].port = 3260
Dec 01 17:09:56 user nova-compute[75745]: node.conn[0].startup = manual
Dec 01 17:09:56 user nova-compute[75745]: node.conn[0].tcp.window_size = 524288
Dec 01 17:09:56 user nova-compute[75745]: node.conn[0].tcp.type_of_service = 0
Dec 01 17:09:56 user nova-compute[75745]: node.conn[0].timeo.logout_timeout = 15
Dec 01 17:09:56 user nova-compute[75745]: node.conn[0].timeo.login_timeout = 15
Dec 01 17:09:56 user nova-compute[75745]: node.conn[0].timeo.auth_timeout = 45
Dec 01 17:09:56 user nova-compute[75745]: node.conn[0].timeo.noop_out_interval = 5
Dec 01 17:09:56 user nova-compute[75745]: node.conn[0].timeo.noop_out_timeout = 5
Dec 01 17:09:56 user nova-compute[75745]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Dec 01 17:09:56 user nova-compute[75745]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Dec 01 17:09:56 user nova-compute[75745]: node.conn[0].iscsi.HeaderDigest = None
Dec 01 17:09:56 user nova-compute[75745]: node.conn[0].iscsi.DataDigest = None
Dec 01 17:09:56 user nova-compute[75745]: node.conn[0].iscsi.IFMarker = No
Dec 01 17:09:56 user nova-compute[75745]: node.conn[0].iscsi.OFMarker = No
Dec 01 17:09:56 user nova-compute[75745]: # END RECORD
Dec 01 17:09:56 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da6c063-60fe-4888-be70-acffc8183cc3]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a08ee8-391f-4d11-bae6-e01b35fdc434]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FkMgtsJH {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG nova.compute.manager [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:09:56 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Instance rebooted successfully.
Dec 01 17:09:56 user nova-compute[75745]: DEBUG nova.compute.manager [None req-1fa7af0a-fb84-458d-a952-8d2dfbb5b1b0 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FkMgtsJH" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4117acd2-2f99-41ac-8233-5dd58b3724c0]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FkMgtsJH'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:57 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeeadd5d-904e-4ad9-9d05-ea7421508db6]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:09:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:57 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfbbcea-55e5-4aee-85d8-f39583be4183]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)
Dec 01 17:09:57 user nova-compute[75745]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e (non-flash)
Dec 01 17:09:57 user nova-compute[75745]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:09:57 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:09:57 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:09:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)
Dec 01 17:09:57 user nova-compute[75745]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e (non-flash)
Dec 01 17:09:57 user nova-compute[75745]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:09:57 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:09:57 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:09:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.171s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:09:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:09:57 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] HCTL ('34', '0', '0', 0) found on session 18 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:09:57 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:09:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:09:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:09:57 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[00bb4fac-4939-447b-9bf0-0362842a5e31]: (4, ('0 0 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:09:57 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Searching for a device in session 18 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:09:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FkMgtsJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:09:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.200s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:09:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] <== connect_volume: return (202ms) {'type': 'block', 'scsi_wwn': '23763323730383837', 'path': '/dev/sdc'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:09:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763323730383837', 'path': '/dev/sdc'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:09:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:05:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1767622081',display_name='tempest-ServerStableDeviceRescueTest-server-1767622081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1767622081',id=4,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDp6Xk0Jeq39zNj7o2b3I/4McvYNabWuSHGIAAfwXUIskcvOUTL7Ihwn85mCvmRB2rKQsuxT0meUWSqSSoPSMQuH6KX6uS91/fBFZ5QCBCit5t+fzh+i6OT0756vLnrQNQ==',key_name='tempest-keypair-274950354',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:06:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c1efefd35d14e03a3eebfff2ac0d335',ramdisk_id='',reservation_id='r-s1zydaxk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1685174732',owner_user_name='tempest-ServerStableDeviceRescueTest-1685174732-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:07:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='683fd305fb0b4c978a762e79e901fa36',uuid=2abc6436-bf45-497a-acd2-47d43d5e158c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "address": "fa:16:3e:66:74:ba", "network": {"id": "3d78774f-ff2b-4705-b359-7a1fb7fc272f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-234182378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-234182378-network", "vif_mac": "fa:16:3e:66:74:ba"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1efefd35d14e03a3eebfff2ac0d335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5897fde5-fe", "ovs_interfaceid": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:09:57 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Converting VIF {"id": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "address": "fa:16:3e:66:74:ba", "network": {"id": "3d78774f-ff2b-4705-b359-7a1fb7fc272f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-234182378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-234182378-network", "vif_mac": "fa:16:3e:66:74:ba"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1efefd35d14e03a3eebfff2ac0d335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5897fde5-fe", "ovs_interfaceid": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:09:57 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:74:ba,bridge_name='br-int',has_traffic_filtering=True,id=5897fde5-fea9-4ff3-98b8-db1020cf5127,network=Network(3d78774f-ff2b-4705-b359-7a1fb7fc272f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5897fde5-fe') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:09:57 user nova-compute[75745]: DEBUG nova.objects.instance [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lazy-loading 'pci_devices' on Instance uuid 2abc6436-bf45-497a-acd2-47d43d5e158c {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:09:57 user nova-compute[75745]: DEBUG nova.objects.base [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Object Instance<2abc6436-bf45-497a-acd2-47d43d5e158c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:09:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:09:57 user nova-compute[75745]:   <uuid>2abc6436-bf45-497a-acd2-47d43d5e158c</uuid>
Dec 01 17:09:57 user nova-compute[75745]:   <name>instance-00000004</name>
Dec 01 17:09:57 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:09:57 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:09:57 user nova-compute[75745]:   <metadata>
Dec 01 17:09:57 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:09:57 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:09:57 user nova-compute[75745]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1767622081</nova:name>
Dec 01 17:09:57 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:09:56</nova:creationTime>
Dec 01 17:09:57 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:09:57 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:09:57 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:09:57 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:09:57 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:09:57 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:09:57 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:09:57 user nova-compute[75745]:       <nova:owner>
Dec 01 17:09:57 user nova-compute[75745]:         <nova:user uuid="683fd305fb0b4c978a762e79e901fa36">tempest-ServerStableDeviceRescueTest-1685174732-project-member</nova:user>
Dec 01 17:09:57 user nova-compute[75745]:         <nova:project uuid="0c1efefd35d14e03a3eebfff2ac0d335">tempest-ServerStableDeviceRescueTest-1685174732</nova:project>
Dec 01 17:09:57 user nova-compute[75745]:       </nova:owner>
Dec 01 17:09:57 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:09:57 user nova-compute[75745]:       <nova:ports>
Dec 01 17:09:57 user nova-compute[75745]:         <nova:port uuid="5897fde5-fea9-4ff3-98b8-db1020cf5127">
Dec 01 17:09:57 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 01 17:09:57 user nova-compute[75745]:         </nova:port>
Dec 01 17:09:57 user nova-compute[75745]:       </nova:ports>
Dec 01 17:09:57 user nova-compute[75745]:     </nova:instance>
Dec 01 17:09:57 user nova-compute[75745]:   </metadata>
Dec 01 17:09:57 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:09:57 user nova-compute[75745]:     <system>
Dec 01 17:09:57 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:09:57 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:09:57 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:09:57 user nova-compute[75745]:       <entry name="serial">2abc6436-bf45-497a-acd2-47d43d5e158c</entry>
Dec 01 17:09:57 user nova-compute[75745]:       <entry name="uuid">2abc6436-bf45-497a-acd2-47d43d5e158c</entry>
Dec 01 17:09:57 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:09:57 user nova-compute[75745]:     </system>
Dec 01 17:09:57 user nova-compute[75745]:   </sysinfo>
Dec 01 17:09:57 user nova-compute[75745]:   <os>
Dec 01 17:09:57 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:09:57 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:09:57 user nova-compute[75745]:   </os>
Dec 01 17:09:57 user nova-compute[75745]:   <features>
Dec 01 17:09:57 user nova-compute[75745]:     <acpi/>
Dec 01 17:09:57 user nova-compute[75745]:     <apic/>
Dec 01 17:09:57 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:09:57 user nova-compute[75745]:   </features>
Dec 01 17:09:57 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:09:57 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:09:57 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:09:57 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:09:57 user nova-compute[75745]:   </clock>
Dec 01 17:09:57 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:09:57 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:09:57 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:09:57 user nova-compute[75745]:   </cpu>
Dec 01 17:09:57 user nova-compute[75745]:   <devices>
Dec 01 17:09:57 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:09:57 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:09:57 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk"/>
Dec 01 17:09:57 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:09:57 user nova-compute[75745]:     </disk>
Dec 01 17:09:57 user nova-compute[75745]:     <disk type="block" device="disk">
Dec 01 17:09:57 user nova-compute[75745]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:09:57 user nova-compute[75745]:       <source dev="/dev/sdc"/>
Dec 01 17:09:57 user nova-compute[75745]:       <target dev="vdb" bus="virtio"/>
Dec 01 17:09:57 user nova-compute[75745]:       <serial>fcd8549e-610f-4ede-841e-88c1b93df25e</serial>
Dec 01 17:09:57 user nova-compute[75745]:     </disk>
Dec 01 17:09:57 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:09:57 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:09:57 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk.rescue"/>
Dec 01 17:09:57 user nova-compute[75745]:       <target dev="vdc" bus="virtio"/>
Dec 01 17:09:57 user nova-compute[75745]:       <boot order="1"/>
Dec 01 17:09:57 user nova-compute[75745]:     </disk>
Dec 01 17:09:57 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:09:57 user nova-compute[75745]:       <mac address="fa:16:3e:66:74:ba"/>
Dec 01 17:09:57 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:09:57 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:09:57 user nova-compute[75745]:       <target dev="tap5897fde5-fe"/>
Dec 01 17:09:57 user nova-compute[75745]:     </interface>
Dec 01 17:09:57 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:09:57 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/console.log" append="off"/>
Dec 01 17:09:57 user nova-compute[75745]:     </serial>
Dec 01 17:09:57 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:09:57 user nova-compute[75745]:     <video>
Dec 01 17:09:57 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:09:57 user nova-compute[75745]:     </video>
Dec 01 17:09:57 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:09:57 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:09:57 user nova-compute[75745]:     </rng>
Dec 01 17:09:57 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:09:57 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:09:57 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:09:57 user nova-compute[75745]:     </memballoon>
Dec 01 17:09:57 user nova-compute[75745]:   </devices>
Dec 01 17:09:57 user nova-compute[75745]: </domain>
Dec 01 17:09:57 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:09:57 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Instance destroyed successfully.
Dec 01 17:09:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:09:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:09:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:09:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] No VIF found with MAC fa:16:3e:66:74:ba, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:09:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:59 user nova-compute[75745]: DEBUG nova.compute.manager [req-d97fb642-74a6-41a6-9cdb-ed47225ea508 req-eafadb44-db06-410b-be4f-d6db3df07f88 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Received event network-vif-plugged-5897fde5-fea9-4ff3-98b8-db1020cf5127 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:09:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d97fb642-74a6-41a6-9cdb-ed47225ea508 req-eafadb44-db06-410b-be4f-d6db3df07f88 service nova] Acquiring lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:09:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d97fb642-74a6-41a6-9cdb-ed47225ea508 req-eafadb44-db06-410b-be4f-d6db3df07f88 service nova] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:09:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d97fb642-74a6-41a6-9cdb-ed47225ea508 req-eafadb44-db06-410b-be4f-d6db3df07f88 service nova] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:09:59 user nova-compute[75745]: DEBUG nova.compute.manager [req-d97fb642-74a6-41a6-9cdb-ed47225ea508 req-eafadb44-db06-410b-be4f-d6db3df07f88 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] No waiting events found dispatching network-vif-plugged-5897fde5-fea9-4ff3-98b8-db1020cf5127 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:09:59 user nova-compute[75745]: WARNING nova.compute.manager [req-d97fb642-74a6-41a6-9cdb-ed47225ea508 req-eafadb44-db06-410b-be4f-d6db3df07f88 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Received unexpected event network-vif-plugged-5897fde5-fea9-4ff3-98b8-db1020cf5127 for instance with vm_state active and task_state rescuing.
Dec 01 17:09:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:09:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:01 user nova-compute[75745]: DEBUG nova.compute.manager [req-ee286593-150d-4e78-ab5d-201014cdfe35 req-1d1bd22c-ce2e-484d-99c2-23f7a6b9bbda service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Received event network-vif-plugged-5897fde5-fea9-4ff3-98b8-db1020cf5127 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:10:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ee286593-150d-4e78-ab5d-201014cdfe35 req-1d1bd22c-ce2e-484d-99c2-23f7a6b9bbda service nova] Acquiring lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:10:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ee286593-150d-4e78-ab5d-201014cdfe35 req-1d1bd22c-ce2e-484d-99c2-23f7a6b9bbda service nova] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:10:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ee286593-150d-4e78-ab5d-201014cdfe35 req-1d1bd22c-ce2e-484d-99c2-23f7a6b9bbda service nova] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:10:01 user nova-compute[75745]: DEBUG nova.compute.manager [req-ee286593-150d-4e78-ab5d-201014cdfe35 req-1d1bd22c-ce2e-484d-99c2-23f7a6b9bbda service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] No waiting events found dispatching network-vif-plugged-5897fde5-fea9-4ff3-98b8-db1020cf5127 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:10:01 user nova-compute[75745]: WARNING nova.compute.manager [req-ee286593-150d-4e78-ab5d-201014cdfe35 req-1d1bd22c-ce2e-484d-99c2-23f7a6b9bbda service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Received unexpected event network-vif-plugged-5897fde5-fea9-4ff3-98b8-db1020cf5127 for instance with vm_state active and task_state rescuing.
Dec 01 17:10:01 user nova-compute[75745]: DEBUG nova.compute.manager [None req-977fa79b-2b3a-478f-ae85-e3870f450be0 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:10:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:03 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:18 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Acquiring lock "98b29ba5-9993-4494-b196-f7eea077df7a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:10:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "98b29ba5-9993-4494-b196-f7eea077df7a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:10:24 user nova-compute[75745]: DEBUG nova.compute.manager [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:10:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:10:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:10:24 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:10:24 user nova-compute[75745]: INFO nova.compute.claims [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Claim successful on node user
Dec 01 17:10:24 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:10:24 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:10:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:10:24 user nova-compute[75745]: DEBUG nova.compute.manager [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:10:24 user nova-compute[75745]: DEBUG nova.compute.manager [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:10:24 user nova-compute[75745]: DEBUG nova.network.neutron [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:10:24 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:10:24 user nova-compute[75745]: DEBUG nova.compute.manager [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:10:25 user nova-compute[75745]: DEBUG nova.policy [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad1d09d017314c67b4616642f1108f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4f3ec75737429e8834e7d3576ffa69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:10:25 user nova-compute[75745]: DEBUG nova.compute.manager [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:10:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:10:25 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Creating image(s)
Dec 01 17:10:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Acquiring lock "/opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:10:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "/opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:10:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "/opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:10:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:10:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.192s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:10:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:10:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:10:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:10:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.199s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:10:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:10:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk 1073741824" returned: 0 in 0.052s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:10:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:10:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:10:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.195s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:10:25 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Checking if we can resize image /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:10:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:10:25 user nova-compute[75745]: DEBUG nova.network.neutron [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Successfully created port: 9c3aade6-4181-435d-aabd-07988112a373 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:10:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:10:26 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Cannot resize image /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:10:26 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:10:26 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Ensure instance console log exists: /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:10:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:10:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:10:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:10:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:27 user nova-compute[75745]: DEBUG nova.network.neutron [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Successfully updated port: 9c3aade6-4181-435d-aabd-07988112a373 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:10:27 user nova-compute[75745]: DEBUG nova.compute.manager [req-7aa8c094-a76c-4a74-bc91-05ca596855a6 req-60f458df-b832-4444-adf9-00600b01cb99 service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Received event network-changed-9c3aade6-4181-435d-aabd-07988112a373 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:10:27 user nova-compute[75745]: DEBUG nova.compute.manager [req-7aa8c094-a76c-4a74-bc91-05ca596855a6 req-60f458df-b832-4444-adf9-00600b01cb99 service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Refreshing instance network info cache due to event network-changed-9c3aade6-4181-435d-aabd-07988112a373. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:10:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7aa8c094-a76c-4a74-bc91-05ca596855a6 req-60f458df-b832-4444-adf9-00600b01cb99 service nova] Acquiring lock "refresh_cache-98b29ba5-9993-4494-b196-f7eea077df7a" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:10:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7aa8c094-a76c-4a74-bc91-05ca596855a6 req-60f458df-b832-4444-adf9-00600b01cb99 service nova] Acquired lock "refresh_cache-98b29ba5-9993-4494-b196-f7eea077df7a" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:10:27 user nova-compute[75745]: DEBUG nova.network.neutron [req-7aa8c094-a76c-4a74-bc91-05ca596855a6 req-60f458df-b832-4444-adf9-00600b01cb99 service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Refreshing network info cache for port 9c3aade6-4181-435d-aabd-07988112a373 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:10:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Acquiring lock "refresh_cache-98b29ba5-9993-4494-b196-f7eea077df7a" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:10:27 user nova-compute[75745]: DEBUG nova.network.neutron [req-7aa8c094-a76c-4a74-bc91-05ca596855a6 req-60f458df-b832-4444-adf9-00600b01cb99 service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:10:27 user nova-compute[75745]: DEBUG nova.network.neutron [req-7aa8c094-a76c-4a74-bc91-05ca596855a6 req-60f458df-b832-4444-adf9-00600b01cb99 service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:10:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7aa8c094-a76c-4a74-bc91-05ca596855a6 req-60f458df-b832-4444-adf9-00600b01cb99 service nova] Releasing lock "refresh_cache-98b29ba5-9993-4494-b196-f7eea077df7a" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:10:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Acquired lock "refresh_cache-98b29ba5-9993-4494-b196-f7eea077df7a" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:10:27 user nova-compute[75745]: DEBUG nova.network.neutron [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:10:27 user nova-compute[75745]: DEBUG nova.network.neutron [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG nova.network.neutron [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Updating instance_info_cache with network_info: [{"id": "9c3aade6-4181-435d-aabd-07988112a373", "address": "fa:16:3e:60:67:90", "network": {"id": "9083e0bd-c071-4794-bf87-74bc7ba3898b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-947489426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4f3ec75737429e8834e7d3576ffa69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3aade6-41", "ovs_interfaceid": "9c3aade6-4181-435d-aabd-07988112a373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Releasing lock "refresh_cache-98b29ba5-9993-4494-b196-f7eea077df7a" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG nova.compute.manager [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Instance network_info: |[{"id": "9c3aade6-4181-435d-aabd-07988112a373", "address": "fa:16:3e:60:67:90", "network": {"id": "9083e0bd-c071-4794-bf87-74bc7ba3898b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-947489426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4f3ec75737429e8834e7d3576ffa69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3aade6-41", "ovs_interfaceid": "9c3aade6-4181-435d-aabd-07988112a373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Start _get_guest_xml network_info=[{"id": "9c3aade6-4181-435d-aabd-07988112a373", "address": "fa:16:3e:60:67:90", "network": {"id": "9083e0bd-c071-4794-bf87-74bc7ba3898b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-947489426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4f3ec75737429e8834e7d3576ffa69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3aade6-41", "ovs_interfaceid": "9c3aade6-4181-435d-aabd-07988112a373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:10:28 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:10:28 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:10:28 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-321906429',display_name='tempest-ServerActionsTestOtherB-server-321906429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-321906429',id=14,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6Xv1Rwscmn/urtTSZP43LfdG03kX+bxRxOhmhIXfcYy1rBNpzO0Q01awhPBxn/6X5VK/oxuGhv1u1yXJ9Fp7a3tqYVzRZF/9QTyYTjIDpNO30GMbJX0Ytk2j/sLZKHuw==',key_name='tempest-keypair-56607333',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e4f3ec75737429e8834e7d3576ffa69',ramdisk_id='',reservation_id='r-64j6n0b5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-978518734',owner_user_name='tempest-ServerActionsTestOtherB-978518734-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:10:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad1d09d017314c67b4616642f1108f21',uuid=98b29ba5-9993-4494-b196-f7eea077df7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c3aade6-4181-435d-aabd-07988112a373", "address": "fa:16:3e:60:67:90", "network": {"id": "9083e0bd-c071-4794-bf87-74bc7ba3898b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-947489426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4f3ec75737429e8834e7d3576ffa69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3aade6-41", "ovs_interfaceid": "9c3aade6-4181-435d-aabd-07988112a373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Converting VIF {"id": "9c3aade6-4181-435d-aabd-07988112a373", "address": "fa:16:3e:60:67:90", "network": {"id": "9083e0bd-c071-4794-bf87-74bc7ba3898b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-947489426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4f3ec75737429e8834e7d3576ffa69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3aade6-41", "ovs_interfaceid": "9c3aade6-4181-435d-aabd-07988112a373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:67:90,bridge_name='br-int',has_traffic_filtering=True,id=9c3aade6-4181-435d-aabd-07988112a373,network=Network(9083e0bd-c071-4794-bf87-74bc7ba3898b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c3aade6-41') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG nova.objects.instance [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lazy-loading 'pci_devices' on Instance uuid 98b29ba5-9993-4494-b196-f7eea077df7a {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:10:28 user nova-compute[75745]:   <uuid>98b29ba5-9993-4494-b196-f7eea077df7a</uuid>
Dec 01 17:10:28 user nova-compute[75745]:   <name>instance-0000000e</name>
Dec 01 17:10:28 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:10:28 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:10:28 user nova-compute[75745]:   <metadata>
Dec 01 17:10:28 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:10:28 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:10:28 user nova-compute[75745]:       <nova:name>tempest-ServerActionsTestOtherB-server-321906429</nova:name>
Dec 01 17:10:28 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:10:28</nova:creationTime>
Dec 01 17:10:28 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:10:28 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:10:28 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:10:28 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:10:28 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:10:28 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:10:28 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:10:28 user nova-compute[75745]:       <nova:owner>
Dec 01 17:10:28 user nova-compute[75745]:         <nova:user uuid="ad1d09d017314c67b4616642f1108f21">tempest-ServerActionsTestOtherB-978518734-project-member</nova:user>
Dec 01 17:10:28 user nova-compute[75745]:         <nova:project uuid="2e4f3ec75737429e8834e7d3576ffa69">tempest-ServerActionsTestOtherB-978518734</nova:project>
Dec 01 17:10:28 user nova-compute[75745]:       </nova:owner>
Dec 01 17:10:28 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:10:28 user nova-compute[75745]:       <nova:ports>
Dec 01 17:10:28 user nova-compute[75745]:         <nova:port uuid="9c3aade6-4181-435d-aabd-07988112a373">
Dec 01 17:10:28 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 01 17:10:28 user nova-compute[75745]:         </nova:port>
Dec 01 17:10:28 user nova-compute[75745]:       </nova:ports>
Dec 01 17:10:28 user nova-compute[75745]:     </nova:instance>
Dec 01 17:10:28 user nova-compute[75745]:   </metadata>
Dec 01 17:10:28 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:10:28 user nova-compute[75745]:     <system>
Dec 01 17:10:28 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:10:28 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:10:28 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:10:28 user nova-compute[75745]:       <entry name="serial">98b29ba5-9993-4494-b196-f7eea077df7a</entry>
Dec 01 17:10:28 user nova-compute[75745]:       <entry name="uuid">98b29ba5-9993-4494-b196-f7eea077df7a</entry>
Dec 01 17:10:28 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:10:28 user nova-compute[75745]:     </system>
Dec 01 17:10:28 user nova-compute[75745]:   </sysinfo>
Dec 01 17:10:28 user nova-compute[75745]:   <os>
Dec 01 17:10:28 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:10:28 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:10:28 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:10:28 user nova-compute[75745]:   </os>
Dec 01 17:10:28 user nova-compute[75745]:   <features>
Dec 01 17:10:28 user nova-compute[75745]:     <acpi/>
Dec 01 17:10:28 user nova-compute[75745]:     <apic/>
Dec 01 17:10:28 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:10:28 user nova-compute[75745]:   </features>
Dec 01 17:10:28 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:10:28 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:10:28 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:10:28 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:10:28 user nova-compute[75745]:   </clock>
Dec 01 17:10:28 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:10:28 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:10:28 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:10:28 user nova-compute[75745]:   </cpu>
Dec 01 17:10:28 user nova-compute[75745]:   <devices>
Dec 01 17:10:28 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:10:28 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:10:28 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk"/>
Dec 01 17:10:28 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:10:28 user nova-compute[75745]:     </disk>
Dec 01 17:10:28 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:10:28 user nova-compute[75745]:       <mac address="fa:16:3e:60:67:90"/>
Dec 01 17:10:28 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:10:28 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:10:28 user nova-compute[75745]:       <target dev="tap9c3aade6-41"/>
Dec 01 17:10:28 user nova-compute[75745]:     </interface>
Dec 01 17:10:28 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:10:28 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/console.log" append="off"/>
Dec 01 17:10:28 user nova-compute[75745]:     </serial>
Dec 01 17:10:28 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:10:28 user nova-compute[75745]:     <video>
Dec 01 17:10:28 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:10:28 user nova-compute[75745]:     </video>
Dec 01 17:10:28 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:10:28 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:10:28 user nova-compute[75745]:     </rng>
Dec 01 17:10:28 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:10:28 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:10:28 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:10:28 user nova-compute[75745]:     </memballoon>
Dec 01 17:10:28 user nova-compute[75745]:   </devices>
Dec 01 17:10:28 user nova-compute[75745]: </domain>
Dec 01 17:10:28 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-321906429',display_name='tempest-ServerActionsTestOtherB-server-321906429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-321906429',id=14,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6Xv1Rwscmn/urtTSZP43LfdG03kX+bxRxOhmhIXfcYy1rBNpzO0Q01awhPBxn/6X5VK/oxuGhv1u1yXJ9Fp7a3tqYVzRZF/9QTyYTjIDpNO30GMbJX0Ytk2j/sLZKHuw==',key_name='tempest-keypair-56607333',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e4f3ec75737429e8834e7d3576ffa69',ramdisk_id='',reservation_id='r-64j6n0b5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-978518734',owner_user_name='tempest-ServerActionsTestOtherB-978518734-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:10:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad1d09d017314c67b4616642f1108f21',uuid=98b29ba5-9993-4494-b196-f7eea077df7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c3aade6-4181-435d-aabd-07988112a373", "address": "fa:16:3e:60:67:90", "network": {"id": "9083e0bd-c071-4794-bf87-74bc7ba3898b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-947489426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4f3ec75737429e8834e7d3576ffa69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3aade6-41", "ovs_interfaceid": "9c3aade6-4181-435d-aabd-07988112a373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Converting VIF {"id": "9c3aade6-4181-435d-aabd-07988112a373", "address": "fa:16:3e:60:67:90", "network": {"id": "9083e0bd-c071-4794-bf87-74bc7ba3898b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-947489426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4f3ec75737429e8834e7d3576ffa69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3aade6-41", "ovs_interfaceid": "9c3aade6-4181-435d-aabd-07988112a373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:67:90,bridge_name='br-int',has_traffic_filtering=True,id=9c3aade6-4181-435d-aabd-07988112a373,network=Network(9083e0bd-c071-4794-bf87-74bc7ba3898b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c3aade6-41') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG os_vif [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:67:90,bridge_name='br-int',has_traffic_filtering=True,id=9c3aade6-4181-435d-aabd-07988112a373,network=Network(9083e0bd-c071-4794-bf87-74bc7ba3898b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c3aade6-41') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec1b282c-a7fa-5026-9d11-8f93a071c319', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c3aade6-41, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c3aade6-41, col_values=(('qos', UUID('18fb1631-0c59-4628-8feb-fab77a22fa0d')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c3aade6-41, col_values=(('external_ids', {'iface-id': '9c3aade6-4181-435d-aabd-07988112a373', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:67:90', 'vm-uuid': '98b29ba5-9993-4494-b196-f7eea077df7a'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:28 user nova-compute[75745]: INFO os_vif [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:67:90,bridge_name='br-int',has_traffic_filtering=True,id=9c3aade6-4181-435d-aabd-07988112a373,network=Network(9083e0bd-c071-4794-bf87-74bc7ba3898b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c3aade6-41')
Dec 01 17:10:28 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] No VIF found with MAC fa:16:3e:60:67:90, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:10:28 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:30 user nova-compute[75745]: DEBUG nova.compute.manager [req-dbeb2cdf-b2bd-4323-b14b-912fcd344205 req-8a66e27c-5649-45e3-9ca7-2e852e5f5b84 service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Received event network-vif-plugged-9c3aade6-4181-435d-aabd-07988112a373 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:10:30 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-dbeb2cdf-b2bd-4323-b14b-912fcd344205 req-8a66e27c-5649-45e3-9ca7-2e852e5f5b84 service nova] Acquiring lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:10:30 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-dbeb2cdf-b2bd-4323-b14b-912fcd344205 req-8a66e27c-5649-45e3-9ca7-2e852e5f5b84 service nova] Lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:10:30 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-dbeb2cdf-b2bd-4323-b14b-912fcd344205 req-8a66e27c-5649-45e3-9ca7-2e852e5f5b84 service nova] Lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:10:30 user nova-compute[75745]: DEBUG nova.compute.manager [req-dbeb2cdf-b2bd-4323-b14b-912fcd344205 req-8a66e27c-5649-45e3-9ca7-2e852e5f5b84 service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] No waiting events found dispatching network-vif-plugged-9c3aade6-4181-435d-aabd-07988112a373 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:10:30 user nova-compute[75745]: WARNING nova.compute.manager [req-dbeb2cdf-b2bd-4323-b14b-912fcd344205 req-8a66e27c-5649-45e3-9ca7-2e852e5f5b84 service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Received unexpected event network-vif-plugged-9c3aade6-4181-435d-aabd-07988112a373 for instance with vm_state building and task_state spawning.
Dec 01 17:10:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:32 user nova-compute[75745]: DEBUG nova.compute.manager [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:10:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:10:32 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Instance spawned successfully.
Dec 01 17:10:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:10:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:10:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:10:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:10:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:10:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:10:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:10:32 user nova-compute[75745]: INFO nova.compute.manager [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Took 7.19 seconds to spawn the instance on the hypervisor.
Dec 01 17:10:32 user nova-compute[75745]: DEBUG nova.compute.manager [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:10:32 user nova-compute[75745]: DEBUG nova.compute.manager [req-e5130fe8-b627-4d91-a1f2-c74bd1532e86 req-5a2f309b-8d34-449b-bec2-7acaa50d8aff service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Received event network-vif-plugged-9c3aade6-4181-435d-aabd-07988112a373 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:10:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e5130fe8-b627-4d91-a1f2-c74bd1532e86 req-5a2f309b-8d34-449b-bec2-7acaa50d8aff service nova] Acquiring lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:10:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e5130fe8-b627-4d91-a1f2-c74bd1532e86 req-5a2f309b-8d34-449b-bec2-7acaa50d8aff service nova] Lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:10:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e5130fe8-b627-4d91-a1f2-c74bd1532e86 req-5a2f309b-8d34-449b-bec2-7acaa50d8aff service nova] Lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:10:32 user nova-compute[75745]: DEBUG nova.compute.manager [req-e5130fe8-b627-4d91-a1f2-c74bd1532e86 req-5a2f309b-8d34-449b-bec2-7acaa50d8aff service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] No waiting events found dispatching network-vif-plugged-9c3aade6-4181-435d-aabd-07988112a373 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:10:32 user nova-compute[75745]: WARNING nova.compute.manager [req-e5130fe8-b627-4d91-a1f2-c74bd1532e86 req-5a2f309b-8d34-449b-bec2-7acaa50d8aff service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Received unexpected event network-vif-plugged-9c3aade6-4181-435d-aabd-07988112a373 for instance with vm_state building and task_state spawning.
Dec 01 17:10:32 user nova-compute[75745]: INFO nova.compute.manager [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Took 8.18 seconds to build instance.
Dec 01 17:10:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fa5c0925-8aaa-402a-be58-1343ab4e0f5e tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "98b29ba5-9993-4494-b196-f7eea077df7a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.364s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:10:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:36 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:10:36 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:10:37 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:10:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:10:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.004s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:10:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:10:37 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:10:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:10:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:10:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:10:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:10:38 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:10:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:10:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk.rescue --force-share --output=json" returned: 0 in 0.263s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:10:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:10:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:10:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:10:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:10:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:10:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:10:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:10:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc78dcf1-f005-415c-ac27-798cab8f52fb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:10:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc78dcf1-f005-415c-ac27-798cab8f52fb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:10:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc78dcf1-f005-415c-ac27-798cab8f52fb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:10:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc78dcf1-f005-415c-ac27-798cab8f52fb/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:10:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:10:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:10:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:10:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:10:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:10:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:10:40 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:10:40 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:10:40 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=8199MB free_disk=25.527599334716797GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:10:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:10:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:10:41 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance dc78dcf1-f005-415c-ac27-798cab8f52fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:10:41 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 4ac6f586-cc5b-4a3f-b374-4b2006a48427 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:10:41 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 2abc6436-bf45-497a-acd2-47d43d5e158c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:10:41 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 71504d5d-0999-4960-8782-b454cb407e9f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:10:41 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 98b29ba5-9993-4494-b196-f7eea077df7a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:10:41 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:10:41 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:10:41 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:10:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "dc78dcf1-f005-415c-ac27-798cab8f52fb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:10:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "dc78dcf1-f005-415c-ac27-798cab8f52fb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:10:41 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:10:41 user nova-compute[75745]: INFO nova.compute.manager [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Detaching volume 3f50c0ac-c8a8-4290-8246-487eee7d3111
Dec 01 17:10:41 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:10:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.491s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:10:41 user nova-compute[75745]: INFO nova.virt.block_device [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Attempting to driver detach volume 3f50c0ac-c8a8-4290-8246-487eee7d3111 from mountpoint /dev/vdb
Dec 01 17:10:41 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Attempting to detach device vdb from instance dc78dcf1-f005-415c-ac27-798cab8f52fb from the persistent domain config. {{(pid=75745) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 17:10:41 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:10:41 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:10:41 user nova-compute[75745]:   <source dev="/dev/sdi"/>
Dec 01 17:10:41 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:10:41 user nova-compute[75745]:   <serial>3f50c0ac-c8a8-4290-8246-487eee7d3111</serial>
Dec 01 17:10:41 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 17:10:41 user nova-compute[75745]: </disk>
Dec 01 17:10:41 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:10:41 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Successfully detached device vdb from instance dc78dcf1-f005-415c-ac27-798cab8f52fb from the persistent domain config.
Dec 01 17:10:41 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dc78dcf1-f005-415c-ac27-798cab8f52fb from the live domain config. {{(pid=75745) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 17:10:41 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:10:41 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:10:41 user nova-compute[75745]:   <source dev="/dev/sdi"/>
Dec 01 17:10:41 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:10:41 user nova-compute[75745]:   <serial>3f50c0ac-c8a8-4290-8246-487eee7d3111</serial>
Dec 01 17:10:41 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 17:10:41 user nova-compute[75745]: </disk>
Dec 01 17:10:41 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:10:42 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dc78dcf1-f005-415c-ac27-798cab8f52fb {{(pid=75745) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 17:10:42 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:10:42 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:10:42 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:10:42 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:10:42 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:10:42 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:10:43 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:10:43 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Didn't find any instances for network info cache update. {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 17:10:43 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:10:43 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:10:43 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:10:43 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:10:43 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:43 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:10:43 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:10:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Acquiring lock "bdd70405-389f-4121-81e9-bfe317d33746" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:10:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Lock "bdd70405-389f-4121-81e9-bfe317d33746" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:10:52 user nova-compute[75745]: DEBUG nova.compute.manager [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:10:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:10:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:10:52 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:10:52 user nova-compute[75745]: INFO nova.compute.claims [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Claim successful on node user
Dec 01 17:10:52 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:10:52 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:10:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:10:52 user nova-compute[75745]: DEBUG nova.compute.manager [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:10:52 user nova-compute[75745]: DEBUG nova.compute.manager [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:10:52 user nova-compute[75745]: DEBUG nova.network.neutron [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:10:52 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:10:53 user nova-compute[75745]: DEBUG nova.compute.manager [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:10:53 user nova-compute[75745]: DEBUG nova.compute.manager [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:10:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:10:53 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Creating image(s)
Dec 01 17:10:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Acquiring lock "/opt/stack/data/nova/instances/bdd70405-389f-4121-81e9-bfe317d33746/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:10:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Lock "/opt/stack/data/nova/instances/bdd70405-389f-4121-81e9-bfe317d33746/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.005s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:10:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Lock "/opt/stack/data/nova/instances/bdd70405-389f-4121-81e9-bfe317d33746/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:10:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:10:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.194s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:10:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:10:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:10:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:10:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:53 user nova-compute[75745]: DEBUG nova.policy [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6189b38bdde14d68840d6c1e45cc7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f46239d6c4340528ad2d3df2aba37b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:10:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.265s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:10:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/bdd70405-389f-4121-81e9-bfe317d33746/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:10:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/bdd70405-389f-4121-81e9-bfe317d33746/disk 1073741824" returned: 0 in 0.063s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:10:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.336s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:10:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:10:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.235s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:10:53 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bdd70405-389f-4121-81e9-bfe317d33746/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:10:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdd70405-389f-4121-81e9-bfe317d33746/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:10:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdd70405-389f-4121-81e9-bfe317d33746/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:10:54 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Cannot resize image /opt/stack/data/nova/instances/bdd70405-389f-4121-81e9-bfe317d33746/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:10:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:10:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Ensure instance console log exists: /opt/stack/data/nova/instances/bdd70405-389f-4121-81e9-bfe317d33746/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:10:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:10:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:10:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:10:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:54 user nova-compute[75745]: DEBUG nova.network.neutron [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Successfully created port: f03d763d-cd15-4dd4-a82a-dcac1450fe0c {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:10:55 user nova-compute[75745]: DEBUG nova.network.neutron [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Successfully updated port: f03d763d-cd15-4dd4-a82a-dcac1450fe0c {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:10:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Acquiring lock "refresh_cache-bdd70405-389f-4121-81e9-bfe317d33746" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:10:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Acquired lock "refresh_cache-bdd70405-389f-4121-81e9-bfe317d33746" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:10:55 user nova-compute[75745]: DEBUG nova.network.neutron [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:10:55 user nova-compute[75745]: DEBUG nova.network.neutron [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:10:55 user nova-compute[75745]: DEBUG nova.compute.manager [req-2bbee697-3228-46f4-a38d-63d19de8244a req-a3ea807f-90e2-4c20-8c3a-63ebbb3d8c47 service nova] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Received event network-changed-f03d763d-cd15-4dd4-a82a-dcac1450fe0c {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:10:55 user nova-compute[75745]: DEBUG nova.compute.manager [req-2bbee697-3228-46f4-a38d-63d19de8244a req-a3ea807f-90e2-4c20-8c3a-63ebbb3d8c47 service nova] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Refreshing instance network info cache due to event network-changed-f03d763d-cd15-4dd4-a82a-dcac1450fe0c. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:10:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2bbee697-3228-46f4-a38d-63d19de8244a req-a3ea807f-90e2-4c20-8c3a-63ebbb3d8c47 service nova] Acquiring lock "refresh_cache-bdd70405-389f-4121-81e9-bfe317d33746" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG nova.network.neutron [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Updating instance_info_cache with network_info: [{"id": "f03d763d-cd15-4dd4-a82a-dcac1450fe0c", "address": "fa:16:3e:1d:16:3d", "network": {"id": "ac8343e9-b21b-4666-b33b-1d7b20ca8514", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "061216e5b9b54621948598ae244101c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03d763d-cd", "ovs_interfaceid": "f03d763d-cd15-4dd4-a82a-dcac1450fe0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Releasing lock "refresh_cache-bdd70405-389f-4121-81e9-bfe317d33746" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG nova.compute.manager [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Instance network_info: |[{"id": "f03d763d-cd15-4dd4-a82a-dcac1450fe0c", "address": "fa:16:3e:1d:16:3d", "network": {"id": "ac8343e9-b21b-4666-b33b-1d7b20ca8514", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "061216e5b9b54621948598ae244101c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03d763d-cd", "ovs_interfaceid": "f03d763d-cd15-4dd4-a82a-dcac1450fe0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2bbee697-3228-46f4-a38d-63d19de8244a req-a3ea807f-90e2-4c20-8c3a-63ebbb3d8c47 service nova] Acquired lock "refresh_cache-bdd70405-389f-4121-81e9-bfe317d33746" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG nova.network.neutron [req-2bbee697-3228-46f4-a38d-63d19de8244a req-a3ea807f-90e2-4c20-8c3a-63ebbb3d8c47 service nova] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Refreshing network info cache for port f03d763d-cd15-4dd4-a82a-dcac1450fe0c {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Start _get_guest_xml network_info=[{"id": "f03d763d-cd15-4dd4-a82a-dcac1450fe0c", "address": "fa:16:3e:1d:16:3d", "network": {"id": "ac8343e9-b21b-4666-b33b-1d7b20ca8514", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "061216e5b9b54621948598ae244101c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03d763d-cd", "ovs_interfaceid": "f03d763d-cd15-4dd4-a82a-dcac1450fe0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:10:56 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:10:56 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:10:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:10:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-487139023',display_name='tempest-VolumesNegativeTest-instance-487139023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-487139023',id=15,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f46239d6c4340528ad2d3df2aba37b0',ramdisk_id='',reservation_id='r-ngvotni6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1147934414',owner_user_name='tempest-VolumesNegativeTest-1147934414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:10:53Z,user_data=None,user_id='6189b38bdde14d68840d6c1e45cc7acb',uuid=bdd70405-389f-4121-81e9-bfe317d33746,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f03d763d-cd15-4dd4-a82a-dcac1450fe0c", "address": "fa:16:3e:1d:16:3d", "network": {"id": "ac8343e9-b21b-4666-b33b-1d7b20ca8514", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "061216e5b9b54621948598ae244101c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03d763d-cd", "ovs_interfaceid": "f03d763d-cd15-4dd4-a82a-dcac1450fe0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Converting VIF {"id": "f03d763d-cd15-4dd4-a82a-dcac1450fe0c", "address": "fa:16:3e:1d:16:3d", "network": {"id": "ac8343e9-b21b-4666-b33b-1d7b20ca8514", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "061216e5b9b54621948598ae244101c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03d763d-cd", "ovs_interfaceid": "f03d763d-cd15-4dd4-a82a-dcac1450fe0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:16:3d,bridge_name='br-int',has_traffic_filtering=True,id=f03d763d-cd15-4dd4-a82a-dcac1450fe0c,network=Network(ac8343e9-b21b-4666-b33b-1d7b20ca8514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf03d763d-cd') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG nova.objects.instance [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Lazy-loading 'pci_devices' on Instance uuid bdd70405-389f-4121-81e9-bfe317d33746 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:10:56 user nova-compute[75745]:   <uuid>bdd70405-389f-4121-81e9-bfe317d33746</uuid>
Dec 01 17:10:56 user nova-compute[75745]:   <name>instance-0000000f</name>
Dec 01 17:10:56 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:10:56 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:10:56 user nova-compute[75745]:   <metadata>
Dec 01 17:10:56 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:10:56 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:10:56 user nova-compute[75745]:       <nova:name>tempest-VolumesNegativeTest-instance-487139023</nova:name>
Dec 01 17:10:56 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:10:56</nova:creationTime>
Dec 01 17:10:56 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:10:56 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:10:56 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:10:56 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:10:56 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:10:56 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:10:56 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:10:56 user nova-compute[75745]:       <nova:owner>
Dec 01 17:10:56 user nova-compute[75745]:         <nova:user uuid="6189b38bdde14d68840d6c1e45cc7acb">tempest-VolumesNegativeTest-1147934414-project-member</nova:user>
Dec 01 17:10:56 user nova-compute[75745]:         <nova:project uuid="1f46239d6c4340528ad2d3df2aba37b0">tempest-VolumesNegativeTest-1147934414</nova:project>
Dec 01 17:10:56 user nova-compute[75745]:       </nova:owner>
Dec 01 17:10:56 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:10:56 user nova-compute[75745]:       <nova:ports>
Dec 01 17:10:56 user nova-compute[75745]:         <nova:port uuid="f03d763d-cd15-4dd4-a82a-dcac1450fe0c">
Dec 01 17:10:56 user nova-compute[75745]:           <nova:ip type="fixed" address="192.168.233.96" ipVersion="4"/>
Dec 01 17:10:56 user nova-compute[75745]:         </nova:port>
Dec 01 17:10:56 user nova-compute[75745]:       </nova:ports>
Dec 01 17:10:56 user nova-compute[75745]:     </nova:instance>
Dec 01 17:10:56 user nova-compute[75745]:   </metadata>
Dec 01 17:10:56 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:10:56 user nova-compute[75745]:     <system>
Dec 01 17:10:56 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:10:56 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:10:56 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:10:56 user nova-compute[75745]:       <entry name="serial">bdd70405-389f-4121-81e9-bfe317d33746</entry>
Dec 01 17:10:56 user nova-compute[75745]:       <entry name="uuid">bdd70405-389f-4121-81e9-bfe317d33746</entry>
Dec 01 17:10:56 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:10:56 user nova-compute[75745]:     </system>
Dec 01 17:10:56 user nova-compute[75745]:   </sysinfo>
Dec 01 17:10:56 user nova-compute[75745]:   <os>
Dec 01 17:10:56 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:10:56 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:10:56 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:10:56 user nova-compute[75745]:   </os>
Dec 01 17:10:56 user nova-compute[75745]:   <features>
Dec 01 17:10:56 user nova-compute[75745]:     <acpi/>
Dec 01 17:10:56 user nova-compute[75745]:     <apic/>
Dec 01 17:10:56 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:10:56 user nova-compute[75745]:   </features>
Dec 01 17:10:56 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:10:56 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:10:56 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:10:56 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:10:56 user nova-compute[75745]:   </clock>
Dec 01 17:10:56 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:10:56 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:10:56 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:10:56 user nova-compute[75745]:   </cpu>
Dec 01 17:10:56 user nova-compute[75745]:   <devices>
Dec 01 17:10:56 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:10:56 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:10:56 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/bdd70405-389f-4121-81e9-bfe317d33746/disk"/>
Dec 01 17:10:56 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:10:56 user nova-compute[75745]:     </disk>
Dec 01 17:10:56 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:10:56 user nova-compute[75745]:       <mac address="fa:16:3e:1d:16:3d"/>
Dec 01 17:10:56 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:10:56 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:10:56 user nova-compute[75745]:       <target dev="tapf03d763d-cd"/>
Dec 01 17:10:56 user nova-compute[75745]:     </interface>
Dec 01 17:10:56 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:10:56 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/bdd70405-389f-4121-81e9-bfe317d33746/console.log" append="off"/>
Dec 01 17:10:56 user nova-compute[75745]:     </serial>
Dec 01 17:10:56 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:10:56 user nova-compute[75745]:     <video>
Dec 01 17:10:56 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:10:56 user nova-compute[75745]:     </video>
Dec 01 17:10:56 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:10:56 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:10:56 user nova-compute[75745]:     </rng>
Dec 01 17:10:56 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:10:56 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:10:56 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:10:56 user nova-compute[75745]:     </memballoon>
Dec 01 17:10:56 user nova-compute[75745]:   </devices>
Dec 01 17:10:56 user nova-compute[75745]: </domain>
Dec 01 17:10:56 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:10:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-487139023',display_name='tempest-VolumesNegativeTest-instance-487139023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-487139023',id=15,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f46239d6c4340528ad2d3df2aba37b0',ramdisk_id='',reservation_id='r-ngvotni6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1147934414',owner_user_name='tempest-VolumesNegativeTest-1147934414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:10:53Z,user_data=None,user_id='6189b38bdde14d68840d6c1e45cc7acb',uuid=bdd70405-389f-4121-81e9-bfe317d33746,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f03d763d-cd15-4dd4-a82a-dcac1450fe0c", "address": "fa:16:3e:1d:16:3d", "network": {"id": "ac8343e9-b21b-4666-b33b-1d7b20ca8514", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "061216e5b9b54621948598ae244101c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03d763d-cd", "ovs_interfaceid": "f03d763d-cd15-4dd4-a82a-dcac1450fe0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Converting VIF {"id": "f03d763d-cd15-4dd4-a82a-dcac1450fe0c", "address": "fa:16:3e:1d:16:3d", "network": {"id": "ac8343e9-b21b-4666-b33b-1d7b20ca8514", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "061216e5b9b54621948598ae244101c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03d763d-cd", "ovs_interfaceid": "f03d763d-cd15-4dd4-a82a-dcac1450fe0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:16:3d,bridge_name='br-int',has_traffic_filtering=True,id=f03d763d-cd15-4dd4-a82a-dcac1450fe0c,network=Network(ac8343e9-b21b-4666-b33b-1d7b20ca8514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf03d763d-cd') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG os_vif [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:16:3d,bridge_name='br-int',has_traffic_filtering=True,id=f03d763d-cd15-4dd4-a82a-dcac1450fe0c,network=Network(ac8343e9-b21b-4666-b33b-1d7b20ca8514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf03d763d-cd') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '350827a7-90b6-5497-9a7e-350ea5b4167e', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf03d763d-cd, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf03d763d-cd, col_values=(('qos', UUID('d604cfec-cae8-4bb0-8a73-f08362e3fed3')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf03d763d-cd, col_values=(('external_ids', {'iface-id': 'f03d763d-cd15-4dd4-a82a-dcac1450fe0c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:16:3d', 'vm-uuid': 'bdd70405-389f-4121-81e9-bfe317d33746'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:56 user nova-compute[75745]: INFO os_vif [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:16:3d,bridge_name='br-int',has_traffic_filtering=True,id=f03d763d-cd15-4dd4-a82a-dcac1450fe0c,network=Network(ac8343e9-b21b-4666-b33b-1d7b20ca8514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf03d763d-cd')
Dec 01 17:10:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] No VIF found with MAC fa:16:3e:1d:16:3d, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG nova.network.neutron [req-2bbee697-3228-46f4-a38d-63d19de8244a req-a3ea807f-90e2-4c20-8c3a-63ebbb3d8c47 service nova] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Updated VIF entry in instance network info cache for port f03d763d-cd15-4dd4-a82a-dcac1450fe0c. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG nova.network.neutron [req-2bbee697-3228-46f4-a38d-63d19de8244a req-a3ea807f-90e2-4c20-8c3a-63ebbb3d8c47 service nova] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Updating instance_info_cache with network_info: [{"id": "f03d763d-cd15-4dd4-a82a-dcac1450fe0c", "address": "fa:16:3e:1d:16:3d", "network": {"id": "ac8343e9-b21b-4666-b33b-1d7b20ca8514", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "061216e5b9b54621948598ae244101c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03d763d-cd", "ovs_interfaceid": "f03d763d-cd15-4dd4-a82a-dcac1450fe0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:10:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2bbee697-3228-46f4-a38d-63d19de8244a req-a3ea807f-90e2-4c20-8c3a-63ebbb3d8c47 service nova] Releasing lock "refresh_cache-bdd70405-389f-4121-81e9-bfe317d33746" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:10:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-7bc1a4a8-3a26-464f-9559-620aae473bdb req-8a179b83-ab7e-4eee-8e84-7305671fb7cb service nova] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Received event network-vif-plugged-f03d763d-cd15-4dd4-a82a-dcac1450fe0c {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:10:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7bc1a4a8-3a26-464f-9559-620aae473bdb req-8a179b83-ab7e-4eee-8e84-7305671fb7cb service nova] Acquiring lock "bdd70405-389f-4121-81e9-bfe317d33746-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:10:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7bc1a4a8-3a26-464f-9559-620aae473bdb req-8a179b83-ab7e-4eee-8e84-7305671fb7cb service nova] Lock "bdd70405-389f-4121-81e9-bfe317d33746-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:10:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7bc1a4a8-3a26-464f-9559-620aae473bdb req-8a179b83-ab7e-4eee-8e84-7305671fb7cb service nova] Lock "bdd70405-389f-4121-81e9-bfe317d33746-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:10:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-7bc1a4a8-3a26-464f-9559-620aae473bdb req-8a179b83-ab7e-4eee-8e84-7305671fb7cb service nova] [instance: bdd70405-389f-4121-81e9-bfe317d33746] No waiting events found dispatching network-vif-plugged-f03d763d-cd15-4dd4-a82a-dcac1450fe0c {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:10:58 user nova-compute[75745]: WARNING nova.compute.manager [req-7bc1a4a8-3a26-464f-9559-620aae473bdb req-8a179b83-ab7e-4eee-8e84-7305671fb7cb service nova] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Received unexpected event network-vif-plugged-f03d763d-cd15-4dd4-a82a-dcac1450fe0c for instance with vm_state building and task_state spawning.
Dec 01 17:10:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:10:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:00 user nova-compute[75745]: DEBUG nova.compute.manager [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:11:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:11:00 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Instance spawned successfully.
Dec 01 17:11:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:11:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:11:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:11:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:11:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:11:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:11:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:11:00 user nova-compute[75745]: DEBUG nova.compute.manager [req-d95eb104-d65d-41bf-8748-7df1b629877e req-15d67143-928f-4288-a219-b53ba2bf87fd service nova] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Received event network-vif-plugged-f03d763d-cd15-4dd4-a82a-dcac1450fe0c {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:11:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d95eb104-d65d-41bf-8748-7df1b629877e req-15d67143-928f-4288-a219-b53ba2bf87fd service nova] Acquiring lock "bdd70405-389f-4121-81e9-bfe317d33746-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d95eb104-d65d-41bf-8748-7df1b629877e req-15d67143-928f-4288-a219-b53ba2bf87fd service nova] Lock "bdd70405-389f-4121-81e9-bfe317d33746-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d95eb104-d65d-41bf-8748-7df1b629877e req-15d67143-928f-4288-a219-b53ba2bf87fd service nova] Lock "bdd70405-389f-4121-81e9-bfe317d33746-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:00 user nova-compute[75745]: DEBUG nova.compute.manager [req-d95eb104-d65d-41bf-8748-7df1b629877e req-15d67143-928f-4288-a219-b53ba2bf87fd service nova] [instance: bdd70405-389f-4121-81e9-bfe317d33746] No waiting events found dispatching network-vif-plugged-f03d763d-cd15-4dd4-a82a-dcac1450fe0c {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:11:00 user nova-compute[75745]: WARNING nova.compute.manager [req-d95eb104-d65d-41bf-8748-7df1b629877e req-15d67143-928f-4288-a219-b53ba2bf87fd service nova] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Received unexpected event network-vif-plugged-f03d763d-cd15-4dd4-a82a-dcac1450fe0c for instance with vm_state building and task_state spawning.
Dec 01 17:11:00 user nova-compute[75745]: INFO nova.compute.manager [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Took 7.28 seconds to spawn the instance on the hypervisor.
Dec 01 17:11:00 user nova-compute[75745]: DEBUG nova.compute.manager [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:11:00 user nova-compute[75745]: INFO nova.compute.manager [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Took 8.13 seconds to build instance.
Dec 01 17:11:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-36f1cc41-7e39-4e89-90e3-f65d4d6d81be tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Lock "bdd70405-389f-4121-81e9-bfe317d33746" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.259s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:02 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dc78dcf1-f005-415c-ac27-798cab8f52fb is timed out.
Dec 01 17:11:02 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Successfully detached device vdb from instance dc78dcf1-f005-415c-ac27-798cab8f52fb from the live domain config.
Dec 01 17:11:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'csPfUOeM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:11:02 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:11:02 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ff020f-728f-4b15-a581-561bba3ee111]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:11:02 user nova-compute[75745]: No targets found.
Dec 01 17:11:02 user nova-compute[75745]: iSNS:
Dec 01 17:11:02 user nova-compute[75745]: No targets found.
Dec 01 17:11:02 user nova-compute[75745]: STATIC:
Dec 01 17:11:02 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98
Dec 01 17:11:02 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:11:02 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:11:02 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e
Dec 01 17:11:02 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:11:02 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:11:02 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111
Dec 01 17:11:02 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:11:02 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:11:02 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121
Dec 01 17:11:02 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:11:02 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:11:02 user nova-compute[75745]: FIRMWARE:
Dec 01 17:11:02 user nova-compute[75745]: No targets found.
Dec 01 17:11:02 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:11:02 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:11:02 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[519796dd-e7f4-47b1-a0a7-2f80033acbc6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aff2076-c82c-4a74-8e2b-a1cc83df51d6]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)
Dec 01 17:11:02 user nova-compute[75745]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e (non-flash)
Dec 01 17:11:02 user nova-compute[75745]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:11:02 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:11:02 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)
Dec 01 17:11:02 user nova-compute[75745]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e (non-flash)
Dec 01 17:11:02 user nova-compute[75745]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:11:02 user nova-compute[75745]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 (non-flash)
Dec 01 17:11:02 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f249870d5a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111'): ({'sdi'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Removing single pathed devices sdi {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e416fe43-2e84-4049-8695-648212c11a3a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.031s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[412638a7-0cd7-4efc-8c3e-105bf656b16e]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Flushing IO for device /dev/sdi {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bd5366-85dc-4f80-8af2-d71e9db20a04]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.049s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7567e08-877b-4534-bb6f-3465d7d54be2]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] SCSI volumes sdi have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedf07dc-1d1b-465a-93d6-313c010c9897]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4ea375-2292-499c-a0b9-f96861a73f07]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111, portal: 172.16.0.220,3260]
Dec 01 17:11:02 user nova-compute[75745]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111, portal: 172.16.0.220,3260] successful.
Dec 01 17:11:02 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f50c0ac-c8a8-4290-8246-487eee7d3111 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0099c04e-ed79-45a7-846e-7f25d2f04702]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.409s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] <== disconnect_volume: return (411ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:11:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:11:03 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:03 user nova-compute[75745]: DEBUG nova.objects.instance [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lazy-loading 'flavor' on Instance uuid dc78dcf1-f005-415c-ac27-798cab8f52fb {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:11:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-cf6b0ca3-c631-40fa-ba73-82f3b3705a4d tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "dc78dcf1-f005-415c-ac27-798cab8f52fb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.220s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:05 user nova-compute[75745]: DEBUG nova.compute.manager [req-efeec373-e4ce-47e4-9244-7f8d17ec2196 req-30c7debc-e8bb-4216-96fa-e062abfa342d service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Received event network-changed-d3079bd2-25ea-432b-a601-9bb7502fe9c8 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:11:05 user nova-compute[75745]: DEBUG nova.compute.manager [req-efeec373-e4ce-47e4-9244-7f8d17ec2196 req-30c7debc-e8bb-4216-96fa-e062abfa342d service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Refreshing instance network info cache due to event network-changed-d3079bd2-25ea-432b-a601-9bb7502fe9c8. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:11:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-efeec373-e4ce-47e4-9244-7f8d17ec2196 req-30c7debc-e8bb-4216-96fa-e062abfa342d service nova] Acquiring lock "refresh_cache-71504d5d-0999-4960-8782-b454cb407e9f" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:11:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-efeec373-e4ce-47e4-9244-7f8d17ec2196 req-30c7debc-e8bb-4216-96fa-e062abfa342d service nova] Acquired lock "refresh_cache-71504d5d-0999-4960-8782-b454cb407e9f" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:11:05 user nova-compute[75745]: DEBUG nova.network.neutron [req-efeec373-e4ce-47e4-9244-7f8d17ec2196 req-30c7debc-e8bb-4216-96fa-e062abfa342d service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Refreshing network info cache for port d3079bd2-25ea-432b-a601-9bb7502fe9c8 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:11:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:06 user nova-compute[75745]: DEBUG nova.network.neutron [req-efeec373-e4ce-47e4-9244-7f8d17ec2196 req-30c7debc-e8bb-4216-96fa-e062abfa342d service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Updated VIF entry in instance network info cache for port d3079bd2-25ea-432b-a601-9bb7502fe9c8. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:11:06 user nova-compute[75745]: DEBUG nova.network.neutron [req-efeec373-e4ce-47e4-9244-7f8d17ec2196 req-30c7debc-e8bb-4216-96fa-e062abfa342d service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Updating instance_info_cache with network_info: [{"id": "d3079bd2-25ea-432b-a601-9bb7502fe9c8", "address": "fa:16:3e:3a:86:18", "network": {"id": "b05bdd5e-502b-4f25-bef1-0b17b23a0765", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1245857440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a2dd2fc4fef47d584dd73c8bf3e42ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3079bd2-25", "ovs_interfaceid": "d3079bd2-25ea-432b-a601-9bb7502fe9c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:11:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-efeec373-e4ce-47e4-9244-7f8d17ec2196 req-30c7debc-e8bb-4216-96fa-e062abfa342d service nova] Releasing lock "refresh_cache-71504d5d-0999-4960-8782-b454cb407e9f" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:11:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:06 user nova-compute[75745]: INFO nova.compute.manager [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Rebuilding instance
Dec 01 17:11:07 user nova-compute[75745]: DEBUG nova.compute.manager [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:11:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:07 user nova-compute[75745]: DEBUG nova.compute.manager [req-819da07d-66fa-4afc-9fdf-08e468dc90c2 req-ad844462-7e28-41ab-92f1-54660c8b9d95 service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Received event network-vif-unplugged-d3079bd2-25ea-432b-a601-9bb7502fe9c8 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:11:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-819da07d-66fa-4afc-9fdf-08e468dc90c2 req-ad844462-7e28-41ab-92f1-54660c8b9d95 service nova] Acquiring lock "71504d5d-0999-4960-8782-b454cb407e9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-819da07d-66fa-4afc-9fdf-08e468dc90c2 req-ad844462-7e28-41ab-92f1-54660c8b9d95 service nova] Lock "71504d5d-0999-4960-8782-b454cb407e9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-819da07d-66fa-4afc-9fdf-08e468dc90c2 req-ad844462-7e28-41ab-92f1-54660c8b9d95 service nova] Lock "71504d5d-0999-4960-8782-b454cb407e9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:07 user nova-compute[75745]: DEBUG nova.compute.manager [req-819da07d-66fa-4afc-9fdf-08e468dc90c2 req-ad844462-7e28-41ab-92f1-54660c8b9d95 service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] No waiting events found dispatching network-vif-unplugged-d3079bd2-25ea-432b-a601-9bb7502fe9c8 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:11:07 user nova-compute[75745]: WARNING nova.compute.manager [req-819da07d-66fa-4afc-9fdf-08e468dc90c2 req-ad844462-7e28-41ab-92f1-54660c8b9d95 service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Received unexpected event network-vif-unplugged-d3079bd2-25ea-432b-a601-9bb7502fe9c8 for instance with vm_state active and task_state rebuilding.
Dec 01 17:11:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "d997cdd6-67c6-4263-814a-17cf9e27bbeb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "d997cdd6-67c6-4263-814a-17cf9e27bbeb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:07 user nova-compute[75745]: DEBUG nova.compute.manager [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:11:07 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Instance destroyed successfully.
Dec 01 17:11:08 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Instance destroyed successfully.
Dec 01 17:11:08 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:09:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1431601205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1079491771',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0vMcRe2hslMIizadcBGZgc30uKaeuXlHDf+WN8kFazoQVdMmpxW2R8vlqGKQfRbVS0qJwaTmeur8bI1mP+n7SfrtPRhzkJ9JoTM17YCGvpITsXmYzQv3QY/h+FSAFt5g==',key_name='tempest-keypair-785211803',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:09:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1a2dd2fc4fef47d584dd73c8bf3e42ae',ramdisk_id='',reservation_id='r-3kwsa42n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-861427896',owner_user_name='tempest-ServerActionsV293TestJSON-861427896-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:11:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc2b48b84ebb46ae9b300423b9e225be',uuid=71504d5d-0999-4960-8782-b454cb407e9f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3079bd2-25ea-432b-a601-9bb7502fe9c8", "address": "fa:16:3e:3a:86:18", "network": {"id": "b05bdd5e-502b-4f25-bef1-0b17b23a0765", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1245857440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a2dd2fc4fef47d584dd73c8bf3e42ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3079bd2-25", "ovs_interfaceid": "d3079bd2-25ea-432b-a601-9bb7502fe9c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Converting VIF {"id": "d3079bd2-25ea-432b-a601-9bb7502fe9c8", "address": "fa:16:3e:3a:86:18", "network": {"id": "b05bdd5e-502b-4f25-bef1-0b17b23a0765", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1245857440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a2dd2fc4fef47d584dd73c8bf3e42ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3079bd2-25", "ovs_interfaceid": "d3079bd2-25ea-432b-a601-9bb7502fe9c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:86:18,bridge_name='br-int',has_traffic_filtering=True,id=d3079bd2-25ea-432b-a601-9bb7502fe9c8,network=Network(b05bdd5e-502b-4f25-bef1-0b17b23a0765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3079bd2-25') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG os_vif [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:86:18,bridge_name='br-int',has_traffic_filtering=True,id=d3079bd2-25ea-432b-a601-9bb7502fe9c8,network=Network(b05bdd5e-502b-4f25-bef1-0b17b23a0765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3079bd2-25') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3079bd2-25, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f5d8ed5b-dd77-40a2-9d42-59952209e78d) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:08 user nova-compute[75745]: INFO os_vif [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:86:18,bridge_name='br-int',has_traffic_filtering=True,id=d3079bd2-25ea-432b-a601-9bb7502fe9c8,network=Network(b05bdd5e-502b-4f25-bef1-0b17b23a0765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3079bd2-25')
Dec 01 17:11:08 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vitPIayJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:11:08 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 01 17:11:08 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dda207a-4b79-40d4-8f72-ab70308fd8ca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:11:08 user nova-compute[75745]: No targets found.
Dec 01 17:11:08 user nova-compute[75745]: iSNS:
Dec 01 17:11:08 user nova-compute[75745]: No targets found.
Dec 01 17:11:08 user nova-compute[75745]: STATIC:
Dec 01 17:11:08 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98
Dec 01 17:11:08 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:11:08 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:11:08 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e
Dec 01 17:11:08 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:11:08 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:11:08 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121
Dec 01 17:11:08 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:11:08 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:11:08 user nova-compute[75745]: FIRMWARE:
Dec 01 17:11:08 user nova-compute[75745]: No targets found.
Dec 01 17:11:08 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:11:08 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:11:08 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:11:08 user nova-compute[75745]: INFO nova.compute.claims [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Claim successful on node user
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3139c17b-d1a2-4394-920c-0dcdc6a95775]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac7c18b-ba30-4815-a8c8-e9326859cef8]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)
Dec 01 17:11:08 user nova-compute[75745]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e (non-flash)
Dec 01 17:11:08 user nova-compute[75745]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:11:08 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)
Dec 01 17:11:08 user nova-compute[75745]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e (non-flash)
Dec 01 17:11:08 user nova-compute[75745]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:11:08 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b81d8280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98'): ({'sdb'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Removing single pathed devices sdb {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c005773-ad6d-4f3b-bcff-03850a1dbccd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04bdb8d-6a27-4c66-af23-1ef5d75e4d99]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Flushing IO for device /dev/sdb {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a87894-b39d-4498-bd80-ead43c0f4510]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f608a35-56f0-42d3-9053-cd52bf3b3b61]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] SCSI volumes sdb have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_f8fd9e12', '/dev/disk/by-id/scsi-1SCST_BIOf8fd9e12-6dc2d5211c7039c9', '/dev/disk/by-id/scsi-23664633264353231') {{(pid=86714) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ef9713-c972-4efd-bbff-5a109c43e79e]: (4, None) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b10992-f970-40df-9f83-6755adfb9478]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5500fb00-0ca7-4ee9-9ca4-821ac50520f3]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98, portal: 172.16.0.220,3260]
Dec 01 17:11:08 user nova-compute[75745]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98, portal: 172.16.0.220,3260] successful.
Dec 01 17:11:08 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bccdc3-d9da-4638-8162-cad52ad8e192]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.436s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] <== disconnect_volume: return (438ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:11:08 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Deleting instance files /opt/stack/data/nova/instances/71504d5d-0999-4960-8782-b454cb407e9f_del
Dec 01 17:11:08 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Deletion of /opt/stack/data/nova/instances/71504d5d-0999-4960-8782-b454cb407e9f_del complete
Dec 01 17:11:08 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.586s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG nova.compute.manager [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG nova.compute.manager [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG nova.network.neutron [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:11:08 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:11:08 user nova-compute[75745]: DEBUG nova.compute.manager [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:11:08 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 71504d5d-0999-4960-8782-b454cb407e9f could not be found.
Dec 01 17:11:08 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vitPIayJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:11:08 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 01 17:11:08 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb80cdd-4432-4cfd-900e-923c9785c954]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:11:08 user nova-compute[75745]: No targets found.
Dec 01 17:11:08 user nova-compute[75745]: iSNS:
Dec 01 17:11:08 user nova-compute[75745]: No targets found.
Dec 01 17:11:08 user nova-compute[75745]: STATIC:
Dec 01 17:11:08 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e
Dec 01 17:11:08 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:11:08 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:11:08 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121
Dec 01 17:11:08 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:11:08 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:11:08 user nova-compute[75745]: FIRMWARE:
Dec 01 17:11:08 user nova-compute[75745]: No targets found.
Dec 01 17:11:08 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:11:08 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:11:08 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG nova.policy [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5204ecaa9b354d10bac514c27acbccc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409356993ea442c5abdf4269aebe43ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.039s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bcaa49-720b-47ff-96cd-3c914deb7c92]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[531be60f-1f43-4d75-8c0c-a8fabd81978a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e (non-flash)
Dec 01 17:11:08 user nova-compute[75745]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:11:08 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e (non-flash)
Dec 01 17:11:08 user nova-compute[75745]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:11:08 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24d830c940>, {}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Disconnecting from: [] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.126s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] <== disconnect_volume: return (128ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:11:08 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:11:09 user nova-compute[75745]: DEBUG nova.compute.manager [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:11:09 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:11:09 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Creating image(s)
Dec 01 17:11:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "/opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "/opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "/opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.214s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.190s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk 1073741824" returned: 0 in 0.073s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.186s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:09 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:11:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:09 user nova-compute[75745]: DEBUG nova.compute.manager [req-3f9df3d1-607a-4d1d-807d-85f1486d30ae req-553203e2-5f2c-4554-9a52-8f9cb18ff756 service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Received event network-vif-plugged-d3079bd2-25ea-432b-a601-9bb7502fe9c8 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:11:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3f9df3d1-607a-4d1d-807d-85f1486d30ae req-553203e2-5f2c-4554-9a52-8f9cb18ff756 service nova] Acquiring lock "71504d5d-0999-4960-8782-b454cb407e9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3f9df3d1-607a-4d1d-807d-85f1486d30ae req-553203e2-5f2c-4554-9a52-8f9cb18ff756 service nova] Lock "71504d5d-0999-4960-8782-b454cb407e9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3f9df3d1-607a-4d1d-807d-85f1486d30ae req-553203e2-5f2c-4554-9a52-8f9cb18ff756 service nova] Lock "71504d5d-0999-4960-8782-b454cb407e9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:09 user nova-compute[75745]: DEBUG nova.compute.manager [req-3f9df3d1-607a-4d1d-807d-85f1486d30ae req-553203e2-5f2c-4554-9a52-8f9cb18ff756 service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] No waiting events found dispatching network-vif-plugged-d3079bd2-25ea-432b-a601-9bb7502fe9c8 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:11:09 user nova-compute[75745]: WARNING nova.compute.manager [req-3f9df3d1-607a-4d1d-807d-85f1486d30ae req-553203e2-5f2c-4554-9a52-8f9cb18ff756 service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Received unexpected event network-vif-plugged-d3079bd2-25ea-432b-a601-9bb7502fe9c8 for instance with vm_state active and task_state rebuilding.
Dec 01 17:11:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:09 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Cannot resize image /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:11:09 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:11:09 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Ensure instance console log exists: /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:11:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:10 user nova-compute[75745]: DEBUG nova.compute.manager [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Preparing to wait for external event volume-reimaged-47a3e21c-03d2-4df0-b96b-c78261e91b98 {{(pid=75745) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Dec 01 17:11:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Acquiring lock "71504d5d-0999-4960-8782-b454cb407e9f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Lock "71504d5d-0999-4960-8782-b454cb407e9f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Lock "71504d5d-0999-4960-8782-b454cb407e9f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:10 user nova-compute[75745]: DEBUG nova.network.neutron [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Successfully created port: 9d64a643-0dca-4fe1-8734-9778689292bc {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:11:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:10 user nova-compute[75745]: DEBUG nova.network.neutron [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Successfully updated port: 9d64a643-0dca-4fe1-8734-9778689292bc {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:11:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "refresh_cache-d997cdd6-67c6-4263-814a-17cf9e27bbeb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:11:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquired lock "refresh_cache-d997cdd6-67c6-4263-814a-17cf9e27bbeb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:11:10 user nova-compute[75745]: DEBUG nova.network.neutron [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.network.neutron [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Acquiring lock "d50a2d4e-82c3-409d-bc50-12dc1269741b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Lock "d50a2d4e-82c3-409d-bc50-12dc1269741b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.compute.manager [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.network.neutron [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Updating instance_info_cache with network_info: [{"id": "9d64a643-0dca-4fe1-8734-9778689292bc", "address": "fa:16:3e:e2:0c:90", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d64a643-0d", "ovs_interfaceid": "9d64a643-0dca-4fe1-8734-9778689292bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Releasing lock "refresh_cache-d997cdd6-67c6-4263-814a-17cf9e27bbeb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.compute.manager [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Instance network_info: |[{"id": "9d64a643-0dca-4fe1-8734-9778689292bc", "address": "fa:16:3e:e2:0c:90", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d64a643-0d", "ovs_interfaceid": "9d64a643-0dca-4fe1-8734-9778689292bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Start _get_guest_xml network_info=[{"id": "9d64a643-0dca-4fe1-8734-9778689292bc", "address": "fa:16:3e:e2:0c:90", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d64a643-0d", "ovs_interfaceid": "9d64a643-0dca-4fe1-8734-9778689292bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:11 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:11:11 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:11:11 user nova-compute[75745]: INFO nova.compute.claims [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Claim successful on node user
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:11:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-100760774',display_name='tempest-ServerActionsTestOtherA-server-100760774',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-100760774',id=16,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEe39hBsqXh7qTHbR/1n4TCThkWTxdl0f3mcj7VutursSM+B5AqiMiKGVg5IqL9MYbDfyNfGcyjgOxxpAU4qczogEswNK8dvSit+JyFqtuJxlzPiy3ZkcIr+yzYcqZB0A==',key_name='tempest-keypair-3711887',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='409356993ea442c5abdf4269aebe43ab',ramdisk_id='',reservation_id='r-65dv89la',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1500186869',owner_user_name='tempest-ServerActionsTestOtherA-1500186869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:11:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5204ecaa9b354d10bac514c27acbccc6',uuid=d997cdd6-67c6-4263-814a-17cf9e27bbeb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d64a643-0dca-4fe1-8734-9778689292bc", "address": "fa:16:3e:e2:0c:90", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d64a643-0d", "ovs_interfaceid": "9d64a643-0dca-4fe1-8734-9778689292bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Converting VIF {"id": "9d64a643-0dca-4fe1-8734-9778689292bc", "address": "fa:16:3e:e2:0c:90", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d64a643-0d", "ovs_interfaceid": "9d64a643-0dca-4fe1-8734-9778689292bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:0c:90,bridge_name='br-int',has_traffic_filtering=True,id=9d64a643-0dca-4fe1-8734-9778689292bc,network=Network(f7cefc9d-2279-4601-8a81-a640ad1aea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d64a643-0d') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.objects.instance [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lazy-loading 'pci_devices' on Instance uuid d997cdd6-67c6-4263-814a-17cf9e27bbeb {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:11:11 user nova-compute[75745]:   <uuid>d997cdd6-67c6-4263-814a-17cf9e27bbeb</uuid>
Dec 01 17:11:11 user nova-compute[75745]:   <name>instance-00000010</name>
Dec 01 17:11:11 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:11:11 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:11:11 user nova-compute[75745]:   <metadata>
Dec 01 17:11:11 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:11:11 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:11:11 user nova-compute[75745]:       <nova:name>tempest-ServerActionsTestOtherA-server-100760774</nova:name>
Dec 01 17:11:11 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:11:11</nova:creationTime>
Dec 01 17:11:11 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:11:11 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:11:11 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:11:11 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:11:11 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:11:11 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:11:11 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:11:11 user nova-compute[75745]:       <nova:owner>
Dec 01 17:11:11 user nova-compute[75745]:         <nova:user uuid="5204ecaa9b354d10bac514c27acbccc6">tempest-ServerActionsTestOtherA-1500186869-project-member</nova:user>
Dec 01 17:11:11 user nova-compute[75745]:         <nova:project uuid="409356993ea442c5abdf4269aebe43ab">tempest-ServerActionsTestOtherA-1500186869</nova:project>
Dec 01 17:11:11 user nova-compute[75745]:       </nova:owner>
Dec 01 17:11:11 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:11:11 user nova-compute[75745]:       <nova:ports>
Dec 01 17:11:11 user nova-compute[75745]:         <nova:port uuid="9d64a643-0dca-4fe1-8734-9778689292bc">
Dec 01 17:11:11 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 01 17:11:11 user nova-compute[75745]:         </nova:port>
Dec 01 17:11:11 user nova-compute[75745]:       </nova:ports>
Dec 01 17:11:11 user nova-compute[75745]:     </nova:instance>
Dec 01 17:11:11 user nova-compute[75745]:   </metadata>
Dec 01 17:11:11 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:11:11 user nova-compute[75745]:     <system>
Dec 01 17:11:11 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:11:11 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:11:11 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:11:11 user nova-compute[75745]:       <entry name="serial">d997cdd6-67c6-4263-814a-17cf9e27bbeb</entry>
Dec 01 17:11:11 user nova-compute[75745]:       <entry name="uuid">d997cdd6-67c6-4263-814a-17cf9e27bbeb</entry>
Dec 01 17:11:11 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:11:11 user nova-compute[75745]:     </system>
Dec 01 17:11:11 user nova-compute[75745]:   </sysinfo>
Dec 01 17:11:11 user nova-compute[75745]:   <os>
Dec 01 17:11:11 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:11:11 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:11:11 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:11:11 user nova-compute[75745]:   </os>
Dec 01 17:11:11 user nova-compute[75745]:   <features>
Dec 01 17:11:11 user nova-compute[75745]:     <acpi/>
Dec 01 17:11:11 user nova-compute[75745]:     <apic/>
Dec 01 17:11:11 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:11:11 user nova-compute[75745]:   </features>
Dec 01 17:11:11 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:11:11 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:11:11 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:11:11 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:11:11 user nova-compute[75745]:   </clock>
Dec 01 17:11:11 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:11:11 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:11:11 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:11:11 user nova-compute[75745]:   </cpu>
Dec 01 17:11:11 user nova-compute[75745]:   <devices>
Dec 01 17:11:11 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:11:11 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:11:11 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk"/>
Dec 01 17:11:11 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:11:11 user nova-compute[75745]:     </disk>
Dec 01 17:11:11 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:11:11 user nova-compute[75745]:       <mac address="fa:16:3e:e2:0c:90"/>
Dec 01 17:11:11 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:11:11 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:11:11 user nova-compute[75745]:       <target dev="tap9d64a643-0d"/>
Dec 01 17:11:11 user nova-compute[75745]:     </interface>
Dec 01 17:11:11 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:11:11 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/console.log" append="off"/>
Dec 01 17:11:11 user nova-compute[75745]:     </serial>
Dec 01 17:11:11 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:11:11 user nova-compute[75745]:     <video>
Dec 01 17:11:11 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:11:11 user nova-compute[75745]:     </video>
Dec 01 17:11:11 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:11:11 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:11:11 user nova-compute[75745]:     </rng>
Dec 01 17:11:11 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:11:11 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:11:11 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:11:11 user nova-compute[75745]:     </memballoon>
Dec 01 17:11:11 user nova-compute[75745]:   </devices>
Dec 01 17:11:11 user nova-compute[75745]: </domain>
Dec 01 17:11:11 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:11:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-100760774',display_name='tempest-ServerActionsTestOtherA-server-100760774',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-100760774',id=16,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEe39hBsqXh7qTHbR/1n4TCThkWTxdl0f3mcj7VutursSM+B5AqiMiKGVg5IqL9MYbDfyNfGcyjgOxxpAU4qczogEswNK8dvSit+JyFqtuJxlzPiy3ZkcIr+yzYcqZB0A==',key_name='tempest-keypair-3711887',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='409356993ea442c5abdf4269aebe43ab',ramdisk_id='',reservation_id='r-65dv89la',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1500186869',owner_user_name='tempest-ServerActionsTestOtherA-1500186869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:11:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5204ecaa9b354d10bac514c27acbccc6',uuid=d997cdd6-67c6-4263-814a-17cf9e27bbeb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d64a643-0dca-4fe1-8734-9778689292bc", "address": "fa:16:3e:e2:0c:90", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d64a643-0d", "ovs_interfaceid": "9d64a643-0dca-4fe1-8734-9778689292bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Converting VIF {"id": "9d64a643-0dca-4fe1-8734-9778689292bc", "address": "fa:16:3e:e2:0c:90", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d64a643-0d", "ovs_interfaceid": "9d64a643-0dca-4fe1-8734-9778689292bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:0c:90,bridge_name='br-int',has_traffic_filtering=True,id=9d64a643-0dca-4fe1-8734-9778689292bc,network=Network(f7cefc9d-2279-4601-8a81-a640ad1aea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d64a643-0d') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG os_vif [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:0c:90,bridge_name='br-int',has_traffic_filtering=True,id=9d64a643-0dca-4fe1-8734-9778689292bc,network=Network(f7cefc9d-2279-4601-8a81-a640ad1aea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d64a643-0d') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0d5834a7-d609-5906-9305-e7ed608c62db', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d64a643-0d, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9d64a643-0d, col_values=(('qos', UUID('9eba087d-530f-4cf6-afd6-62ed7477864b')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9d64a643-0d, col_values=(('external_ids', {'iface-id': '9d64a643-0dca-4fe1-8734-9778689292bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:0c:90', 'vm-uuid': 'd997cdd6-67c6-4263-814a-17cf9e27bbeb'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:11 user nova-compute[75745]: INFO os_vif [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:0c:90,bridge_name='br-int',has_traffic_filtering=True,id=9d64a643-0dca-4fe1-8734-9778689292bc,network=Network(f7cefc9d-2279-4601-8a81-a640ad1aea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d64a643-0d')
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] No VIF found with MAC fa:16:3e:e2:0c:90, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.537s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.compute.manager [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.compute.manager [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.network.neutron [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:11:11 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:11:11 user nova-compute[75745]: DEBUG nova.compute.manager [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:11:12 user nova-compute[75745]: DEBUG nova.compute.manager [req-e263bc74-4707-45e9-8678-9c044cf86a18 req-9aa942cf-fc25-40d9-94df-d113e964c3fd service nova] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Received event network-changed-9d64a643-0dca-4fe1-8734-9778689292bc {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:11:12 user nova-compute[75745]: DEBUG nova.compute.manager [req-e263bc74-4707-45e9-8678-9c044cf86a18 req-9aa942cf-fc25-40d9-94df-d113e964c3fd service nova] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Refreshing instance network info cache due to event network-changed-9d64a643-0dca-4fe1-8734-9778689292bc. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:11:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e263bc74-4707-45e9-8678-9c044cf86a18 req-9aa942cf-fc25-40d9-94df-d113e964c3fd service nova] Acquiring lock "refresh_cache-d997cdd6-67c6-4263-814a-17cf9e27bbeb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:11:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e263bc74-4707-45e9-8678-9c044cf86a18 req-9aa942cf-fc25-40d9-94df-d113e964c3fd service nova] Acquired lock "refresh_cache-d997cdd6-67c6-4263-814a-17cf9e27bbeb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:11:12 user nova-compute[75745]: DEBUG nova.network.neutron [req-e263bc74-4707-45e9-8678-9c044cf86a18 req-9aa942cf-fc25-40d9-94df-d113e964c3fd service nova] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Refreshing network info cache for port 9d64a643-0dca-4fe1-8734-9778689292bc {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:11:12 user nova-compute[75745]: DEBUG nova.policy [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '52fef9da772c4f8ba9f4be1b168ad305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88dee991f154d659d74d3dd5be6a231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:11:12 user nova-compute[75745]: DEBUG nova.compute.manager [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:11:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:11:12 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Creating image(s)
Dec 01 17:11:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Acquiring lock "/opt/stack/data/nova/instances/d50a2d4e-82c3-409d-bc50-12dc1269741b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Lock "/opt/stack/data/nova/instances/d50a2d4e-82c3-409d-bc50-12dc1269741b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Lock "/opt/stack/data/nova/instances/d50a2d4e-82c3-409d-bc50-12dc1269741b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.217s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.176s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/d50a2d4e-82c3-409d-bc50-12dc1269741b/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/d50a2d4e-82c3-409d-bc50-12dc1269741b/disk 1073741824" returned: 0 in 0.059s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:12 user nova-compute[75745]: DEBUG nova.network.neutron [req-e263bc74-4707-45e9-8678-9c044cf86a18 req-9aa942cf-fc25-40d9-94df-d113e964c3fd service nova] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Updated VIF entry in instance network info cache for port 9d64a643-0dca-4fe1-8734-9778689292bc. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:11:12 user nova-compute[75745]: DEBUG nova.network.neutron [req-e263bc74-4707-45e9-8678-9c044cf86a18 req-9aa942cf-fc25-40d9-94df-d113e964c3fd service nova] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Updating instance_info_cache with network_info: [{"id": "9d64a643-0dca-4fe1-8734-9778689292bc", "address": "fa:16:3e:e2:0c:90", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d64a643-0d", "ovs_interfaceid": "9d64a643-0dca-4fe1-8734-9778689292bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:11:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.206s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:12 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d50a2d4e-82c3-409d-bc50-12dc1269741b/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:11:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d50a2d4e-82c3-409d-bc50-12dc1269741b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e263bc74-4707-45e9-8678-9c044cf86a18 req-9aa942cf-fc25-40d9-94df-d113e964c3fd service nova] Releasing lock "refresh_cache-d997cdd6-67c6-4263-814a-17cf9e27bbeb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:11:12 user nova-compute[75745]: DEBUG nova.network.neutron [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Successfully created port: aacdd979-ea65-4c83-93da-e3127ee4ba2d {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:11:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d50a2d4e-82c3-409d-bc50-12dc1269741b/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:13 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Cannot resize image /opt/stack/data/nova/instances/d50a2d4e-82c3-409d-bc50-12dc1269741b/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:11:13 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:11:13 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Ensure instance console log exists: /opt/stack/data/nova/instances/d50a2d4e-82c3-409d-bc50-12dc1269741b/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:11:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:13 user nova-compute[75745]: DEBUG nova.network.neutron [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Successfully updated port: aacdd979-ea65-4c83-93da-e3127ee4ba2d {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Acquiring lock "refresh_cache-d50a2d4e-82c3-409d-bc50-12dc1269741b" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Acquired lock "refresh_cache-d50a2d4e-82c3-409d-bc50-12dc1269741b" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG nova.network.neutron [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG nova.network.neutron [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG nova.compute.manager [req-6117ad3b-086f-4707-af28-58dae281ccd3 req-120c5dfe-9b75-48fd-9115-1456c63b6d77 service nova] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Received event network-changed-aacdd979-ea65-4c83-93da-e3127ee4ba2d {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG nova.compute.manager [req-6117ad3b-086f-4707-af28-58dae281ccd3 req-120c5dfe-9b75-48fd-9115-1456c63b6d77 service nova] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Refreshing instance network info cache due to event network-changed-aacdd979-ea65-4c83-93da-e3127ee4ba2d. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6117ad3b-086f-4707-af28-58dae281ccd3 req-120c5dfe-9b75-48fd-9115-1456c63b6d77 service nova] Acquiring lock "refresh_cache-d50a2d4e-82c3-409d-bc50-12dc1269741b" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG nova.network.neutron [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Updating instance_info_cache with network_info: [{"id": "aacdd979-ea65-4c83-93da-e3127ee4ba2d", "address": "fa:16:3e:a9:2b:d1", "network": {"id": "3bcde777-87d9-442e-a2ff-85106f3b0299", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1741466836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b88dee991f154d659d74d3dd5be6a231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaacdd979-ea", "ovs_interfaceid": "aacdd979-ea65-4c83-93da-e3127ee4ba2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Releasing lock "refresh_cache-d50a2d4e-82c3-409d-bc50-12dc1269741b" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG nova.compute.manager [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Instance network_info: |[{"id": "aacdd979-ea65-4c83-93da-e3127ee4ba2d", "address": "fa:16:3e:a9:2b:d1", "network": {"id": "3bcde777-87d9-442e-a2ff-85106f3b0299", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1741466836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b88dee991f154d659d74d3dd5be6a231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaacdd979-ea", "ovs_interfaceid": "aacdd979-ea65-4c83-93da-e3127ee4ba2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6117ad3b-086f-4707-af28-58dae281ccd3 req-120c5dfe-9b75-48fd-9115-1456c63b6d77 service nova] Acquired lock "refresh_cache-d50a2d4e-82c3-409d-bc50-12dc1269741b" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG nova.network.neutron [req-6117ad3b-086f-4707-af28-58dae281ccd3 req-120c5dfe-9b75-48fd-9115-1456c63b6d77 service nova] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Refreshing network info cache for port aacdd979-ea65-4c83-93da-e3127ee4ba2d {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Start _get_guest_xml network_info=[{"id": "aacdd979-ea65-4c83-93da-e3127ee4ba2d", "address": "fa:16:3e:a9:2b:d1", "network": {"id": "3bcde777-87d9-442e-a2ff-85106f3b0299", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1741466836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b88dee991f154d659d74d3dd5be6a231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaacdd979-ea", "ovs_interfaceid": "aacdd979-ea65-4c83-93da-e3127ee4ba2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:11:14 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:11:14 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:11:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:11:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1632065389',display_name='tempest-VolumesActionsTest-instance-1632065389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1632065389',id=17,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b88dee991f154d659d74d3dd5be6a231',ramdisk_id='',reservation_id='r-3qndl261',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1774873278',owner_user_name='tempest-VolumesActionsTest-1774873278-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:11:12Z,user_data=None,user_id='52fef9da772c4f8ba9f4be1b168ad305',uuid=d50a2d4e-82c3-409d-bc50-12dc1269741b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aacdd979-ea65-4c83-93da-e3127ee4ba2d", "address": "fa:16:3e:a9:2b:d1", "network": {"id": "3bcde777-87d9-442e-a2ff-85106f3b0299", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1741466836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b88dee991f154d659d74d3dd5be6a231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaacdd979-ea", "ovs_interfaceid": "aacdd979-ea65-4c83-93da-e3127ee4ba2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Converting VIF {"id": "aacdd979-ea65-4c83-93da-e3127ee4ba2d", "address": "fa:16:3e:a9:2b:d1", "network": {"id": "3bcde777-87d9-442e-a2ff-85106f3b0299", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1741466836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b88dee991f154d659d74d3dd5be6a231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaacdd979-ea", "ovs_interfaceid": "aacdd979-ea65-4c83-93da-e3127ee4ba2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:2b:d1,bridge_name='br-int',has_traffic_filtering=True,id=aacdd979-ea65-4c83-93da-e3127ee4ba2d,network=Network(3bcde777-87d9-442e-a2ff-85106f3b0299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaacdd979-ea') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG nova.objects.instance [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Lazy-loading 'pci_devices' on Instance uuid d50a2d4e-82c3-409d-bc50-12dc1269741b {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:11:14 user nova-compute[75745]:   <uuid>d50a2d4e-82c3-409d-bc50-12dc1269741b</uuid>
Dec 01 17:11:14 user nova-compute[75745]:   <name>instance-00000011</name>
Dec 01 17:11:14 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:11:14 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:11:14 user nova-compute[75745]:   <metadata>
Dec 01 17:11:14 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:11:14 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:11:14 user nova-compute[75745]:       <nova:name>tempest-VolumesActionsTest-instance-1632065389</nova:name>
Dec 01 17:11:14 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:11:14</nova:creationTime>
Dec 01 17:11:14 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:11:14 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:11:14 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:11:14 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:11:14 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:11:14 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:11:14 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:11:14 user nova-compute[75745]:       <nova:owner>
Dec 01 17:11:14 user nova-compute[75745]:         <nova:user uuid="52fef9da772c4f8ba9f4be1b168ad305">tempest-VolumesActionsTest-1774873278-project-member</nova:user>
Dec 01 17:11:14 user nova-compute[75745]:         <nova:project uuid="b88dee991f154d659d74d3dd5be6a231">tempest-VolumesActionsTest-1774873278</nova:project>
Dec 01 17:11:14 user nova-compute[75745]:       </nova:owner>
Dec 01 17:11:14 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:11:14 user nova-compute[75745]:       <nova:ports>
Dec 01 17:11:14 user nova-compute[75745]:         <nova:port uuid="aacdd979-ea65-4c83-93da-e3127ee4ba2d">
Dec 01 17:11:14 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 01 17:11:14 user nova-compute[75745]:         </nova:port>
Dec 01 17:11:14 user nova-compute[75745]:       </nova:ports>
Dec 01 17:11:14 user nova-compute[75745]:     </nova:instance>
Dec 01 17:11:14 user nova-compute[75745]:   </metadata>
Dec 01 17:11:14 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:11:14 user nova-compute[75745]:     <system>
Dec 01 17:11:14 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:11:14 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:11:14 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:11:14 user nova-compute[75745]:       <entry name="serial">d50a2d4e-82c3-409d-bc50-12dc1269741b</entry>
Dec 01 17:11:14 user nova-compute[75745]:       <entry name="uuid">d50a2d4e-82c3-409d-bc50-12dc1269741b</entry>
Dec 01 17:11:14 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:11:14 user nova-compute[75745]:     </system>
Dec 01 17:11:14 user nova-compute[75745]:   </sysinfo>
Dec 01 17:11:14 user nova-compute[75745]:   <os>
Dec 01 17:11:14 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:11:14 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:11:14 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:11:14 user nova-compute[75745]:   </os>
Dec 01 17:11:14 user nova-compute[75745]:   <features>
Dec 01 17:11:14 user nova-compute[75745]:     <acpi/>
Dec 01 17:11:14 user nova-compute[75745]:     <apic/>
Dec 01 17:11:14 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:11:14 user nova-compute[75745]:   </features>
Dec 01 17:11:14 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:11:14 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:11:14 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:11:14 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:11:14 user nova-compute[75745]:   </clock>
Dec 01 17:11:14 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:11:14 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:11:14 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:11:14 user nova-compute[75745]:   </cpu>
Dec 01 17:11:14 user nova-compute[75745]:   <devices>
Dec 01 17:11:14 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:11:14 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:11:14 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/d50a2d4e-82c3-409d-bc50-12dc1269741b/disk"/>
Dec 01 17:11:14 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:11:14 user nova-compute[75745]:     </disk>
Dec 01 17:11:14 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:11:14 user nova-compute[75745]:       <mac address="fa:16:3e:a9:2b:d1"/>
Dec 01 17:11:14 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:11:14 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:11:14 user nova-compute[75745]:       <target dev="tapaacdd979-ea"/>
Dec 01 17:11:14 user nova-compute[75745]:     </interface>
Dec 01 17:11:14 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:11:14 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/d50a2d4e-82c3-409d-bc50-12dc1269741b/console.log" append="off"/>
Dec 01 17:11:14 user nova-compute[75745]:     </serial>
Dec 01 17:11:14 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:11:14 user nova-compute[75745]:     <video>
Dec 01 17:11:14 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:11:14 user nova-compute[75745]:     </video>
Dec 01 17:11:14 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:11:14 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:11:14 user nova-compute[75745]:     </rng>
Dec 01 17:11:14 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:11:14 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:11:14 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:11:14 user nova-compute[75745]:     </memballoon>
Dec 01 17:11:14 user nova-compute[75745]:   </devices>
Dec 01 17:11:14 user nova-compute[75745]: </domain>
Dec 01 17:11:14 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:11:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1632065389',display_name='tempest-VolumesActionsTest-instance-1632065389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1632065389',id=17,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b88dee991f154d659d74d3dd5be6a231',ramdisk_id='',reservation_id='r-3qndl261',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1774873278',owner_user_name='tempest-VolumesActionsTest-1774873278-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:11:12Z,user_data=None,user_id='52fef9da772c4f8ba9f4be1b168ad305',uuid=d50a2d4e-82c3-409d-bc50-12dc1269741b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aacdd979-ea65-4c83-93da-e3127ee4ba2d", "address": "fa:16:3e:a9:2b:d1", "network": {"id": "3bcde777-87d9-442e-a2ff-85106f3b0299", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1741466836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b88dee991f154d659d74d3dd5be6a231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaacdd979-ea", "ovs_interfaceid": "aacdd979-ea65-4c83-93da-e3127ee4ba2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Converting VIF {"id": "aacdd979-ea65-4c83-93da-e3127ee4ba2d", "address": "fa:16:3e:a9:2b:d1", "network": {"id": "3bcde777-87d9-442e-a2ff-85106f3b0299", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1741466836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b88dee991f154d659d74d3dd5be6a231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaacdd979-ea", "ovs_interfaceid": "aacdd979-ea65-4c83-93da-e3127ee4ba2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:2b:d1,bridge_name='br-int',has_traffic_filtering=True,id=aacdd979-ea65-4c83-93da-e3127ee4ba2d,network=Network(3bcde777-87d9-442e-a2ff-85106f3b0299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaacdd979-ea') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG os_vif [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:2b:d1,bridge_name='br-int',has_traffic_filtering=True,id=aacdd979-ea65-4c83-93da-e3127ee4ba2d,network=Network(3bcde777-87d9-442e-a2ff-85106f3b0299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaacdd979-ea') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9d6099f9-1fc7-5008-ba19-7f37a1906e79', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaacdd979-ea, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaacdd979-ea, col_values=(('qos', UUID('6191d066-9f1c-48cb-a595-e4e9cffa7e41')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaacdd979-ea, col_values=(('external_ids', {'iface-id': 'aacdd979-ea65-4c83-93da-e3127ee4ba2d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:2b:d1', 'vm-uuid': 'd50a2d4e-82c3-409d-bc50-12dc1269741b'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:14 user nova-compute[75745]: INFO os_vif [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:2b:d1,bridge_name='br-int',has_traffic_filtering=True,id=aacdd979-ea65-4c83-93da-e3127ee4ba2d,network=Network(3bcde777-87d9-442e-a2ff-85106f3b0299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaacdd979-ea')
Dec 01 17:11:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] No VIF found with MAC fa:16:3e:a9:2b:d1, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG nova.network.neutron [req-6117ad3b-086f-4707-af28-58dae281ccd3 req-120c5dfe-9b75-48fd-9115-1456c63b6d77 service nova] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Updated VIF entry in instance network info cache for port aacdd979-ea65-4c83-93da-e3127ee4ba2d. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG nova.network.neutron [req-6117ad3b-086f-4707-af28-58dae281ccd3 req-120c5dfe-9b75-48fd-9115-1456c63b6d77 service nova] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Updating instance_info_cache with network_info: [{"id": "aacdd979-ea65-4c83-93da-e3127ee4ba2d", "address": "fa:16:3e:a9:2b:d1", "network": {"id": "3bcde777-87d9-442e-a2ff-85106f3b0299", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1741466836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b88dee991f154d659d74d3dd5be6a231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaacdd979-ea", "ovs_interfaceid": "aacdd979-ea65-4c83-93da-e3127ee4ba2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:11:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6117ad3b-086f-4707-af28-58dae281ccd3 req-120c5dfe-9b75-48fd-9115-1456c63b6d77 service nova] Releasing lock "refresh_cache-d50a2d4e-82c3-409d-bc50-12dc1269741b" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:11:15 user nova-compute[75745]: DEBUG nova.compute.manager [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:11:15 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:11:15 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Instance spawned successfully.
Dec 01 17:11:15 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:11:15 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:11:15 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:11:15 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:11:15 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:11:15 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:11:15 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:11:15 user nova-compute[75745]: INFO nova.compute.manager [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Took 6.74 seconds to spawn the instance on the hypervisor.
Dec 01 17:11:15 user nova-compute[75745]: DEBUG nova.compute.manager [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:11:15 user nova-compute[75745]: INFO nova.compute.manager [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Took 7.86 seconds to build instance.
Dec 01 17:11:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-824c8f48-4cdf-44e6-b5b1-b7bca0852c5d tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "d997cdd6-67c6-4263-814a-17cf9e27bbeb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.061s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:18 user nova-compute[75745]: DEBUG nova.compute.manager [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:11:18 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:11:18 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Instance spawned successfully.
Dec 01 17:11:18 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:11:18 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:11:18 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:11:18 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:11:18 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:11:18 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:11:18 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:11:18 user nova-compute[75745]: DEBUG nova.compute.manager [req-8c109f64-2d87-416d-b1f6-d0c9756bfa97 req-28e77539-0142-4c52-987b-668a159d4fee service nova] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Received event network-vif-plugged-9d64a643-0dca-4fe1-8734-9778689292bc {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:11:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8c109f64-2d87-416d-b1f6-d0c9756bfa97 req-28e77539-0142-4c52-987b-668a159d4fee service nova] Acquiring lock "d997cdd6-67c6-4263-814a-17cf9e27bbeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8c109f64-2d87-416d-b1f6-d0c9756bfa97 req-28e77539-0142-4c52-987b-668a159d4fee service nova] Lock "d997cdd6-67c6-4263-814a-17cf9e27bbeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8c109f64-2d87-416d-b1f6-d0c9756bfa97 req-28e77539-0142-4c52-987b-668a159d4fee service nova] Lock "d997cdd6-67c6-4263-814a-17cf9e27bbeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:18 user nova-compute[75745]: DEBUG nova.compute.manager [req-8c109f64-2d87-416d-b1f6-d0c9756bfa97 req-28e77539-0142-4c52-987b-668a159d4fee service nova] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] No waiting events found dispatching network-vif-plugged-9d64a643-0dca-4fe1-8734-9778689292bc {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:11:18 user nova-compute[75745]: WARNING nova.compute.manager [req-8c109f64-2d87-416d-b1f6-d0c9756bfa97 req-28e77539-0142-4c52-987b-668a159d4fee service nova] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Received unexpected event network-vif-plugged-9d64a643-0dca-4fe1-8734-9778689292bc for instance with vm_state active and task_state None.
Dec 01 17:11:18 user nova-compute[75745]: INFO nova.compute.manager [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Took 6.67 seconds to spawn the instance on the hypervisor.
Dec 01 17:11:18 user nova-compute[75745]: DEBUG nova.compute.manager [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:11:18 user nova-compute[75745]: INFO nova.compute.manager [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Took 7.69 seconds to build instance.
Dec 01 17:11:18 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c1d5e012-ad10-4f80-9343-7c69b484b015 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Lock "d50a2d4e-82c3-409d-bc50-12dc1269741b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.814s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:20 user nova-compute[75745]: DEBUG nova.compute.manager [req-1a0a3599-ff7d-463c-8a4a-76e5c60e0386 req-17a0f769-6768-4707-ab08-f0262787194b service nova] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Received event network-vif-plugged-9d64a643-0dca-4fe1-8734-9778689292bc {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:11:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1a0a3599-ff7d-463c-8a4a-76e5c60e0386 req-17a0f769-6768-4707-ab08-f0262787194b service nova] Acquiring lock "d997cdd6-67c6-4263-814a-17cf9e27bbeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1a0a3599-ff7d-463c-8a4a-76e5c60e0386 req-17a0f769-6768-4707-ab08-f0262787194b service nova] Lock "d997cdd6-67c6-4263-814a-17cf9e27bbeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1a0a3599-ff7d-463c-8a4a-76e5c60e0386 req-17a0f769-6768-4707-ab08-f0262787194b service nova] Lock "d997cdd6-67c6-4263-814a-17cf9e27bbeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:20 user nova-compute[75745]: DEBUG nova.compute.manager [req-1a0a3599-ff7d-463c-8a4a-76e5c60e0386 req-17a0f769-6768-4707-ab08-f0262787194b service nova] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] No waiting events found dispatching network-vif-plugged-9d64a643-0dca-4fe1-8734-9778689292bc {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:11:20 user nova-compute[75745]: WARNING nova.compute.manager [req-1a0a3599-ff7d-463c-8a4a-76e5c60e0386 req-17a0f769-6768-4707-ab08-f0262787194b service nova] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Received unexpected event network-vif-plugged-9d64a643-0dca-4fe1-8734-9778689292bc for instance with vm_state active and task_state None.
Dec 01 17:11:20 user nova-compute[75745]: DEBUG nova.compute.manager [req-1a0a3599-ff7d-463c-8a4a-76e5c60e0386 req-17a0f769-6768-4707-ab08-f0262787194b service nova] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Received event network-vif-plugged-aacdd979-ea65-4c83-93da-e3127ee4ba2d {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:11:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1a0a3599-ff7d-463c-8a4a-76e5c60e0386 req-17a0f769-6768-4707-ab08-f0262787194b service nova] Acquiring lock "d50a2d4e-82c3-409d-bc50-12dc1269741b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1a0a3599-ff7d-463c-8a4a-76e5c60e0386 req-17a0f769-6768-4707-ab08-f0262787194b service nova] Lock "d50a2d4e-82c3-409d-bc50-12dc1269741b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1a0a3599-ff7d-463c-8a4a-76e5c60e0386 req-17a0f769-6768-4707-ab08-f0262787194b service nova] Lock "d50a2d4e-82c3-409d-bc50-12dc1269741b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:20 user nova-compute[75745]: DEBUG nova.compute.manager [req-1a0a3599-ff7d-463c-8a4a-76e5c60e0386 req-17a0f769-6768-4707-ab08-f0262787194b service nova] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] No waiting events found dispatching network-vif-plugged-aacdd979-ea65-4c83-93da-e3127ee4ba2d {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:11:20 user nova-compute[75745]: WARNING nova.compute.manager [req-1a0a3599-ff7d-463c-8a4a-76e5c60e0386 req-17a0f769-6768-4707-ab08-f0262787194b service nova] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Received unexpected event network-vif-plugged-aacdd979-ea65-4c83-93da-e3127ee4ba2d for instance with vm_state active and task_state None.
Dec 01 17:11:20 user nova-compute[75745]: DEBUG nova.compute.manager [req-1a0a3599-ff7d-463c-8a4a-76e5c60e0386 req-17a0f769-6768-4707-ab08-f0262787194b service nova] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Received event network-vif-plugged-aacdd979-ea65-4c83-93da-e3127ee4ba2d {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:11:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1a0a3599-ff7d-463c-8a4a-76e5c60e0386 req-17a0f769-6768-4707-ab08-f0262787194b service nova] Acquiring lock "d50a2d4e-82c3-409d-bc50-12dc1269741b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1a0a3599-ff7d-463c-8a4a-76e5c60e0386 req-17a0f769-6768-4707-ab08-f0262787194b service nova] Lock "d50a2d4e-82c3-409d-bc50-12dc1269741b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1a0a3599-ff7d-463c-8a4a-76e5c60e0386 req-17a0f769-6768-4707-ab08-f0262787194b service nova] Lock "d50a2d4e-82c3-409d-bc50-12dc1269741b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:20 user nova-compute[75745]: DEBUG nova.compute.manager [req-1a0a3599-ff7d-463c-8a4a-76e5c60e0386 req-17a0f769-6768-4707-ab08-f0262787194b service nova] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] No waiting events found dispatching network-vif-plugged-aacdd979-ea65-4c83-93da-e3127ee4ba2d {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:11:20 user nova-compute[75745]: WARNING nova.compute.manager [req-1a0a3599-ff7d-463c-8a4a-76e5c60e0386 req-17a0f769-6768-4707-ab08-f0262787194b service nova] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Received unexpected event network-vif-plugged-aacdd979-ea65-4c83-93da-e3127ee4ba2d for instance with vm_state active and task_state None.
Dec 01 17:11:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Acquiring lock "3a56aca8-ffbb-450b-a953-fc2071902486" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "3a56aca8-ffbb-450b-a953-fc2071902486" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:22 user nova-compute[75745]: DEBUG nova.compute.manager [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:11:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:22 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:11:22 user nova-compute[75745]: INFO nova.compute.claims [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Claim successful on node user
Dec 01 17:11:23 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:11:23 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:11:23 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.575s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:23 user nova-compute[75745]: DEBUG nova.compute.manager [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:11:23 user nova-compute[75745]: DEBUG nova.compute.manager [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:11:23 user nova-compute[75745]: DEBUG nova.network.neutron [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:11:23 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:11:23 user nova-compute[75745]: DEBUG nova.policy [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c4522c1762bd4fea8ee7190642b63e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0919015c0904a8481a5297b6aa9af40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:11:24 user nova-compute[75745]: DEBUG nova.compute.manager [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:11:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:24 user nova-compute[75745]: DEBUG nova.compute.manager [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:11:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:11:24 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Creating image(s)
Dec 01 17:11:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "/opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "/opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.277s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.230s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:25 user nova-compute[75745]: DEBUG nova.network.neutron [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Successfully created port: 0bfa2344-df4f-4c3a-9b5d-97b85e4b2515 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:11:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486/disk 1073741824" returned: 0 in 0.093s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.333s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.249s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:25 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:11:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:25 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Cannot resize image /opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:11:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:11:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Ensure instance console log exists: /opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:11:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:26 user nova-compute[75745]: DEBUG nova.network.neutron [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Successfully updated port: 0bfa2344-df4f-4c3a-9b5d-97b85e4b2515 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:11:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Acquiring lock "refresh_cache-3a56aca8-ffbb-450b-a953-fc2071902486" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:11:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Acquired lock "refresh_cache-3a56aca8-ffbb-450b-a953-fc2071902486" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:11:26 user nova-compute[75745]: DEBUG nova.network.neutron [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:11:26 user nova-compute[75745]: DEBUG nova.compute.manager [req-3b90802f-1452-40da-8b2c-084fc7c72617 req-532a2d1b-bb69-4721-b0d0-9fcc62204449 service nova] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Received event network-changed-0bfa2344-df4f-4c3a-9b5d-97b85e4b2515 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:11:26 user nova-compute[75745]: DEBUG nova.compute.manager [req-3b90802f-1452-40da-8b2c-084fc7c72617 req-532a2d1b-bb69-4721-b0d0-9fcc62204449 service nova] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Refreshing instance network info cache due to event network-changed-0bfa2344-df4f-4c3a-9b5d-97b85e4b2515. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:11:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3b90802f-1452-40da-8b2c-084fc7c72617 req-532a2d1b-bb69-4721-b0d0-9fcc62204449 service nova] Acquiring lock "refresh_cache-3a56aca8-ffbb-450b-a953-fc2071902486" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:11:26 user nova-compute[75745]: DEBUG nova.network.neutron [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG nova.network.neutron [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Updating instance_info_cache with network_info: [{"id": "0bfa2344-df4f-4c3a-9b5d-97b85e4b2515", "address": "fa:16:3e:3a:4a:12", "network": {"id": "b40e2616-f366-491f-a652-c99fc1c6b989", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-538343107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0919015c0904a8481a5297b6aa9af40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfa2344-df", "ovs_interfaceid": "0bfa2344-df4f-4c3a-9b5d-97b85e4b2515", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Releasing lock "refresh_cache-3a56aca8-ffbb-450b-a953-fc2071902486" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG nova.compute.manager [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Instance network_info: |[{"id": "0bfa2344-df4f-4c3a-9b5d-97b85e4b2515", "address": "fa:16:3e:3a:4a:12", "network": {"id": "b40e2616-f366-491f-a652-c99fc1c6b989", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-538343107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0919015c0904a8481a5297b6aa9af40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfa2344-df", "ovs_interfaceid": "0bfa2344-df4f-4c3a-9b5d-97b85e4b2515", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3b90802f-1452-40da-8b2c-084fc7c72617 req-532a2d1b-bb69-4721-b0d0-9fcc62204449 service nova] Acquired lock "refresh_cache-3a56aca8-ffbb-450b-a953-fc2071902486" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG nova.network.neutron [req-3b90802f-1452-40da-8b2c-084fc7c72617 req-532a2d1b-bb69-4721-b0d0-9fcc62204449 service nova] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Refreshing network info cache for port 0bfa2344-df4f-4c3a-9b5d-97b85e4b2515 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Start _get_guest_xml network_info=[{"id": "0bfa2344-df4f-4c3a-9b5d-97b85e4b2515", "address": "fa:16:3e:3a:4a:12", "network": {"id": "b40e2616-f366-491f-a652-c99fc1c6b989", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-538343107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0919015c0904a8481a5297b6aa9af40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfa2344-df", "ovs_interfaceid": "0bfa2344-df4f-4c3a-9b5d-97b85e4b2515", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:11:27 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:11:27 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:11:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:11:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-487107947',display_name='tempest-VolumesAdminNegativeTest-server-487107947',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-487107947',id=18,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZLjze4FkGOylb0jFVFIB9tdNcTx7AFKqs6N3dDsif+JQE0moFczIgm27ATGKpT6/vcBlLfM13o4y2KyvscBeC1gX5gLUohJTPxtoo55ayB3yoSsiT7YdW7OuWhGOnjww==',key_name='tempest-keypair-1098877628',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0919015c0904a8481a5297b6aa9af40',ramdisk_id='',reservation_id='r-jkg27j2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-483419746',owner_user_name='tempest-VolumesAdminNegativeTest-483419746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:11:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4522c1762bd4fea8ee7190642b63e06',uuid=3a56aca8-ffbb-450b-a953-fc2071902486,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bfa2344-df4f-4c3a-9b5d-97b85e4b2515", "address": "fa:16:3e:3a:4a:12", "network": {"id": "b40e2616-f366-491f-a652-c99fc1c6b989", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-538343107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0919015c0904a8481a5297b6aa9af40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfa2344-df", "ovs_interfaceid": "0bfa2344-df4f-4c3a-9b5d-97b85e4b2515", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Converting VIF {"id": "0bfa2344-df4f-4c3a-9b5d-97b85e4b2515", "address": "fa:16:3e:3a:4a:12", "network": {"id": "b40e2616-f366-491f-a652-c99fc1c6b989", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-538343107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0919015c0904a8481a5297b6aa9af40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfa2344-df", "ovs_interfaceid": "0bfa2344-df4f-4c3a-9b5d-97b85e4b2515", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4a:12,bridge_name='br-int',has_traffic_filtering=True,id=0bfa2344-df4f-4c3a-9b5d-97b85e4b2515,network=Network(b40e2616-f366-491f-a652-c99fc1c6b989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bfa2344-df') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG nova.objects.instance [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a56aca8-ffbb-450b-a953-fc2071902486 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:11:27 user nova-compute[75745]:   <uuid>3a56aca8-ffbb-450b-a953-fc2071902486</uuid>
Dec 01 17:11:27 user nova-compute[75745]:   <name>instance-00000012</name>
Dec 01 17:11:27 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:11:27 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:11:27 user nova-compute[75745]:   <metadata>
Dec 01 17:11:27 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:11:27 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:11:27 user nova-compute[75745]:       <nova:name>tempest-VolumesAdminNegativeTest-server-487107947</nova:name>
Dec 01 17:11:27 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:11:27</nova:creationTime>
Dec 01 17:11:27 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:11:27 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:11:27 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:11:27 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:11:27 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:11:27 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:11:27 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:11:27 user nova-compute[75745]:       <nova:owner>
Dec 01 17:11:27 user nova-compute[75745]:         <nova:user uuid="c4522c1762bd4fea8ee7190642b63e06">tempest-VolumesAdminNegativeTest-483419746-project-member</nova:user>
Dec 01 17:11:27 user nova-compute[75745]:         <nova:project uuid="b0919015c0904a8481a5297b6aa9af40">tempest-VolumesAdminNegativeTest-483419746</nova:project>
Dec 01 17:11:27 user nova-compute[75745]:       </nova:owner>
Dec 01 17:11:27 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:11:27 user nova-compute[75745]:       <nova:ports>
Dec 01 17:11:27 user nova-compute[75745]:         <nova:port uuid="0bfa2344-df4f-4c3a-9b5d-97b85e4b2515">
Dec 01 17:11:27 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 01 17:11:27 user nova-compute[75745]:         </nova:port>
Dec 01 17:11:27 user nova-compute[75745]:       </nova:ports>
Dec 01 17:11:27 user nova-compute[75745]:     </nova:instance>
Dec 01 17:11:27 user nova-compute[75745]:   </metadata>
Dec 01 17:11:27 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:11:27 user nova-compute[75745]:     <system>
Dec 01 17:11:27 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:11:27 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:11:27 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:11:27 user nova-compute[75745]:       <entry name="serial">3a56aca8-ffbb-450b-a953-fc2071902486</entry>
Dec 01 17:11:27 user nova-compute[75745]:       <entry name="uuid">3a56aca8-ffbb-450b-a953-fc2071902486</entry>
Dec 01 17:11:27 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:11:27 user nova-compute[75745]:     </system>
Dec 01 17:11:27 user nova-compute[75745]:   </sysinfo>
Dec 01 17:11:27 user nova-compute[75745]:   <os>
Dec 01 17:11:27 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:11:27 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:11:27 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:11:27 user nova-compute[75745]:   </os>
Dec 01 17:11:27 user nova-compute[75745]:   <features>
Dec 01 17:11:27 user nova-compute[75745]:     <acpi/>
Dec 01 17:11:27 user nova-compute[75745]:     <apic/>
Dec 01 17:11:27 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:11:27 user nova-compute[75745]:   </features>
Dec 01 17:11:27 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:11:27 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:11:27 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:11:27 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:11:27 user nova-compute[75745]:   </clock>
Dec 01 17:11:27 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:11:27 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:11:27 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:11:27 user nova-compute[75745]:   </cpu>
Dec 01 17:11:27 user nova-compute[75745]:   <devices>
Dec 01 17:11:27 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:11:27 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:11:27 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486/disk"/>
Dec 01 17:11:27 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:11:27 user nova-compute[75745]:     </disk>
Dec 01 17:11:27 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:11:27 user nova-compute[75745]:       <mac address="fa:16:3e:3a:4a:12"/>
Dec 01 17:11:27 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:11:27 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:11:27 user nova-compute[75745]:       <target dev="tap0bfa2344-df"/>
Dec 01 17:11:27 user nova-compute[75745]:     </interface>
Dec 01 17:11:27 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:11:27 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486/console.log" append="off"/>
Dec 01 17:11:27 user nova-compute[75745]:     </serial>
Dec 01 17:11:27 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:11:27 user nova-compute[75745]:     <video>
Dec 01 17:11:27 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:11:27 user nova-compute[75745]:     </video>
Dec 01 17:11:27 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:11:27 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:11:27 user nova-compute[75745]:     </rng>
Dec 01 17:11:27 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:11:27 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:11:27 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:11:27 user nova-compute[75745]:     </memballoon>
Dec 01 17:11:27 user nova-compute[75745]:   </devices>
Dec 01 17:11:27 user nova-compute[75745]: </domain>
Dec 01 17:11:27 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:11:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-487107947',display_name='tempest-VolumesAdminNegativeTest-server-487107947',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-487107947',id=18,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZLjze4FkGOylb0jFVFIB9tdNcTx7AFKqs6N3dDsif+JQE0moFczIgm27ATGKpT6/vcBlLfM13o4y2KyvscBeC1gX5gLUohJTPxtoo55ayB3yoSsiT7YdW7OuWhGOnjww==',key_name='tempest-keypair-1098877628',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0919015c0904a8481a5297b6aa9af40',ramdisk_id='',reservation_id='r-jkg27j2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-483419746',owner_user_name='tempest-VolumesAdminNegativeTest-483419746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:11:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4522c1762bd4fea8ee7190642b63e06',uuid=3a56aca8-ffbb-450b-a953-fc2071902486,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bfa2344-df4f-4c3a-9b5d-97b85e4b2515", "address": "fa:16:3e:3a:4a:12", "network": {"id": "b40e2616-f366-491f-a652-c99fc1c6b989", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-538343107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0919015c0904a8481a5297b6aa9af40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfa2344-df", "ovs_interfaceid": "0bfa2344-df4f-4c3a-9b5d-97b85e4b2515", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Converting VIF {"id": "0bfa2344-df4f-4c3a-9b5d-97b85e4b2515", "address": "fa:16:3e:3a:4a:12", "network": {"id": "b40e2616-f366-491f-a652-c99fc1c6b989", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-538343107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0919015c0904a8481a5297b6aa9af40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfa2344-df", "ovs_interfaceid": "0bfa2344-df4f-4c3a-9b5d-97b85e4b2515", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4a:12,bridge_name='br-int',has_traffic_filtering=True,id=0bfa2344-df4f-4c3a-9b5d-97b85e4b2515,network=Network(b40e2616-f366-491f-a652-c99fc1c6b989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bfa2344-df') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG os_vif [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4a:12,bridge_name='br-int',has_traffic_filtering=True,id=0bfa2344-df4f-4c3a-9b5d-97b85e4b2515,network=Network(b40e2616-f366-491f-a652-c99fc1c6b989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bfa2344-df') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '517b675d-2434-55e3-b9f6-c0ab6260e7f2', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0bfa2344-df, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0bfa2344-df, col_values=(('qos', UUID('03673d24-6ae2-45a8-b430-ccfb392e0599')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0bfa2344-df, col_values=(('external_ids', {'iface-id': '0bfa2344-df4f-4c3a-9b5d-97b85e4b2515', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:4a:12', 'vm-uuid': '3a56aca8-ffbb-450b-a953-fc2071902486'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:27 user nova-compute[75745]: INFO os_vif [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4a:12,bridge_name='br-int',has_traffic_filtering=True,id=0bfa2344-df4f-4c3a-9b5d-97b85e4b2515,network=Network(b40e2616-f366-491f-a652-c99fc1c6b989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bfa2344-df')
Dec 01 17:11:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] No VIF found with MAC fa:16:3e:3a:4a:12, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG nova.network.neutron [req-3b90802f-1452-40da-8b2c-084fc7c72617 req-532a2d1b-bb69-4721-b0d0-9fcc62204449 service nova] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Updated VIF entry in instance network info cache for port 0bfa2344-df4f-4c3a-9b5d-97b85e4b2515. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG nova.network.neutron [req-3b90802f-1452-40da-8b2c-084fc7c72617 req-532a2d1b-bb69-4721-b0d0-9fcc62204449 service nova] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Updating instance_info_cache with network_info: [{"id": "0bfa2344-df4f-4c3a-9b5d-97b85e4b2515", "address": "fa:16:3e:3a:4a:12", "network": {"id": "b40e2616-f366-491f-a652-c99fc1c6b989", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-538343107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0919015c0904a8481a5297b6aa9af40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfa2344-df", "ovs_interfaceid": "0bfa2344-df4f-4c3a-9b5d-97b85e4b2515", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:11:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3b90802f-1452-40da-8b2c-084fc7c72617 req-532a2d1b-bb69-4721-b0d0-9fcc62204449 service nova] Releasing lock "refresh_cache-3a56aca8-ffbb-450b-a953-fc2071902486" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:11:28 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:28 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:28 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:28 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:28 user nova-compute[75745]: DEBUG nova.compute.manager [req-53bb70e0-2b7d-4218-8656-2c3ae775596e req-f9eb6c9e-c8fb-4bac-bc7a-ea231e8ab582 service nova] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Received event network-vif-plugged-0bfa2344-df4f-4c3a-9b5d-97b85e4b2515 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:11:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-53bb70e0-2b7d-4218-8656-2c3ae775596e req-f9eb6c9e-c8fb-4bac-bc7a-ea231e8ab582 service nova] Acquiring lock "3a56aca8-ffbb-450b-a953-fc2071902486-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-53bb70e0-2b7d-4218-8656-2c3ae775596e req-f9eb6c9e-c8fb-4bac-bc7a-ea231e8ab582 service nova] Lock "3a56aca8-ffbb-450b-a953-fc2071902486-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-53bb70e0-2b7d-4218-8656-2c3ae775596e req-f9eb6c9e-c8fb-4bac-bc7a-ea231e8ab582 service nova] Lock "3a56aca8-ffbb-450b-a953-fc2071902486-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:28 user nova-compute[75745]: DEBUG nova.compute.manager [req-53bb70e0-2b7d-4218-8656-2c3ae775596e req-f9eb6c9e-c8fb-4bac-bc7a-ea231e8ab582 service nova] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] No waiting events found dispatching network-vif-plugged-0bfa2344-df4f-4c3a-9b5d-97b85e4b2515 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:11:28 user nova-compute[75745]: WARNING nova.compute.manager [req-53bb70e0-2b7d-4218-8656-2c3ae775596e req-f9eb6c9e-c8fb-4bac-bc7a-ea231e8ab582 service nova] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Received unexpected event network-vif-plugged-0bfa2344-df4f-4c3a-9b5d-97b85e4b2515 for instance with vm_state building and task_state spawning.
Dec 01 17:11:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:31 user nova-compute[75745]: DEBUG nova.compute.manager [req-172a0d53-7527-4fae-b579-ddc9b00d342f req-06412e29-bc2d-4efb-951e-1860e33e052e service nova] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Received event network-vif-plugged-0bfa2344-df4f-4c3a-9b5d-97b85e4b2515 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:11:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-172a0d53-7527-4fae-b579-ddc9b00d342f req-06412e29-bc2d-4efb-951e-1860e33e052e service nova] Acquiring lock "3a56aca8-ffbb-450b-a953-fc2071902486-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-172a0d53-7527-4fae-b579-ddc9b00d342f req-06412e29-bc2d-4efb-951e-1860e33e052e service nova] Lock "3a56aca8-ffbb-450b-a953-fc2071902486-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-172a0d53-7527-4fae-b579-ddc9b00d342f req-06412e29-bc2d-4efb-951e-1860e33e052e service nova] Lock "3a56aca8-ffbb-450b-a953-fc2071902486-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:31 user nova-compute[75745]: DEBUG nova.compute.manager [req-172a0d53-7527-4fae-b579-ddc9b00d342f req-06412e29-bc2d-4efb-951e-1860e33e052e service nova] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] No waiting events found dispatching network-vif-plugged-0bfa2344-df4f-4c3a-9b5d-97b85e4b2515 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:11:31 user nova-compute[75745]: WARNING nova.compute.manager [req-172a0d53-7527-4fae-b579-ddc9b00d342f req-06412e29-bc2d-4efb-951e-1860e33e052e service nova] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Received unexpected event network-vif-plugged-0bfa2344-df4f-4c3a-9b5d-97b85e4b2515 for instance with vm_state building and task_state spawning.
Dec 01 17:11:31 user nova-compute[75745]: DEBUG nova.compute.manager [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:11:31 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:11:31 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Instance spawned successfully.
Dec 01 17:11:31 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:11:31 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:11:31 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:11:31 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:11:31 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:11:31 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:11:31 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:11:31 user nova-compute[75745]: INFO nova.compute.manager [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Took 6.67 seconds to spawn the instance on the hypervisor.
Dec 01 17:11:31 user nova-compute[75745]: DEBUG nova.compute.manager [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:11:31 user nova-compute[75745]: INFO nova.compute.manager [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Took 8.83 seconds to build instance.
Dec 01 17:11:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-498cb10f-f195-428b-81ea-0f5ded1d911b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "3a56aca8-ffbb-450b-a953-fc2071902486" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.045s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-35c54ebb-a86c-4193-91e9-1e19101d7b9b tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "dc78dcf1-f005-415c-ac27-798cab8f52fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-35c54ebb-a86c-4193-91e9-1e19101d7b9b tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "dc78dcf1-f005-415c-ac27-798cab8f52fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-35c54ebb-a86c-4193-91e9-1e19101d7b9b tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "dc78dcf1-f005-415c-ac27-798cab8f52fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-35c54ebb-a86c-4193-91e9-1e19101d7b9b tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "dc78dcf1-f005-415c-ac27-798cab8f52fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-35c54ebb-a86c-4193-91e9-1e19101d7b9b tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "dc78dcf1-f005-415c-ac27-798cab8f52fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:31 user nova-compute[75745]: INFO nova.compute.manager [None req-35c54ebb-a86c-4193-91e9-1e19101d7b9b tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Terminating instance
Dec 01 17:11:31 user nova-compute[75745]: DEBUG nova.compute.manager [None req-35c54ebb-a86c-4193-91e9-1e19101d7b9b tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:11:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:32 user nova-compute[75745]: DEBUG nova.compute.manager [req-374e9479-4f22-4e99-bb1b-61f9c980e8d8 req-1b061a8f-56d3-41f4-b2f2-9158c4f7f6b1 service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Received event network-vif-unplugged-7b52d740-f797-4bc8-9e0c-d9f4744e4a4f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:11:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-374e9479-4f22-4e99-bb1b-61f9c980e8d8 req-1b061a8f-56d3-41f4-b2f2-9158c4f7f6b1 service nova] Acquiring lock "dc78dcf1-f005-415c-ac27-798cab8f52fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-374e9479-4f22-4e99-bb1b-61f9c980e8d8 req-1b061a8f-56d3-41f4-b2f2-9158c4f7f6b1 service nova] Lock "dc78dcf1-f005-415c-ac27-798cab8f52fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-374e9479-4f22-4e99-bb1b-61f9c980e8d8 req-1b061a8f-56d3-41f4-b2f2-9158c4f7f6b1 service nova] Lock "dc78dcf1-f005-415c-ac27-798cab8f52fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:32 user nova-compute[75745]: DEBUG nova.compute.manager [req-374e9479-4f22-4e99-bb1b-61f9c980e8d8 req-1b061a8f-56d3-41f4-b2f2-9158c4f7f6b1 service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] No waiting events found dispatching network-vif-unplugged-7b52d740-f797-4bc8-9e0c-d9f4744e4a4f {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:11:32 user nova-compute[75745]: DEBUG nova.compute.manager [req-374e9479-4f22-4e99-bb1b-61f9c980e8d8 req-1b061a8f-56d3-41f4-b2f2-9158c4f7f6b1 service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Received event network-vif-unplugged-7b52d740-f797-4bc8-9e0c-d9f4744e4a4f for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:11:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:32 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Instance destroyed successfully.
Dec 01 17:11:32 user nova-compute[75745]: DEBUG nova.objects.instance [None req-35c54ebb-a86c-4193-91e9-1e19101d7b9b tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lazy-loading 'resources' on Instance uuid dc78dcf1-f005-415c-ac27-798cab8f52fb {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:11:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-35c54ebb-a86c-4193-91e9-1e19101d7b9b tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:05:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-74686175',display_name='tempest-AttachVolumeNegativeTest-server-74686175',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-74686175',id=1,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxQbuZ6pL9AzqfCKdlXIwkonW0IJbt9/C8QwCaZVeyx0x4cqEOzW4mO6odh6GxveZ4byoy5iZhwSMd/SnUAcabevk5ic2Y34hOncfMv36jTBNq1XsSiYMc90xrJ52koZQ==',key_name='tempest-keypair-374482113',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:06:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1730419061445f98680b8c81753a4f3',ramdisk_id='',reservation_id='r-bnbil0hz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1227943771',owner_user_name='tempest-AttachVolumeNegativeTest-1227943771-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:06:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76845c98f91449df9196e19187b1b786',uuid=dc78dcf1-f005-415c-ac27-798cab8f52fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b52d740-f797-4bc8-9e0c-d9f4744e4a4f", "address": "fa:16:3e:9e:67:88", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b52d740-f7", "ovs_interfaceid": "7b52d740-f797-4bc8-9e0c-d9f4744e4a4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:11:32 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-35c54ebb-a86c-4193-91e9-1e19101d7b9b tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Converting VIF {"id": "7b52d740-f797-4bc8-9e0c-d9f4744e4a4f", "address": "fa:16:3e:9e:67:88", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b52d740-f7", "ovs_interfaceid": "7b52d740-f797-4bc8-9e0c-d9f4744e4a4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:11:32 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-35c54ebb-a86c-4193-91e9-1e19101d7b9b tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:67:88,bridge_name='br-int',has_traffic_filtering=True,id=7b52d740-f797-4bc8-9e0c-d9f4744e4a4f,network=Network(8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b52d740-f7') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:11:32 user nova-compute[75745]: DEBUG os_vif [None req-35c54ebb-a86c-4193-91e9-1e19101d7b9b tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:67:88,bridge_name='br-int',has_traffic_filtering=True,id=7b52d740-f797-4bc8-9e0c-d9f4744e4a4f,network=Network(8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b52d740-f7') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:11:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b52d740-f7, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:11:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:11:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9f0fd05c-192d-4450-bd89-a692b7aa14c3) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:11:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:11:32 user nova-compute[75745]: INFO os_vif [None req-35c54ebb-a86c-4193-91e9-1e19101d7b9b tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:67:88,bridge_name='br-int',has_traffic_filtering=True,id=7b52d740-f797-4bc8-9e0c-d9f4744e4a4f,network=Network(8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b52d740-f7')
Dec 01 17:11:32 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-35c54ebb-a86c-4193-91e9-1e19101d7b9b tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Deleting instance files /opt/stack/data/nova/instances/dc78dcf1-f005-415c-ac27-798cab8f52fb_del
Dec 01 17:11:32 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-35c54ebb-a86c-4193-91e9-1e19101d7b9b tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Deletion of /opt/stack/data/nova/instances/dc78dcf1-f005-415c-ac27-798cab8f52fb_del complete
Dec 01 17:11:33 user nova-compute[75745]: INFO nova.compute.manager [None req-35c54ebb-a86c-4193-91e9-1e19101d7b9b tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Took 1.32 seconds to destroy the instance on the hypervisor.
Dec 01 17:11:33 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-35c54ebb-a86c-4193-91e9-1e19101d7b9b tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:11:33 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:11:33 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:11:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:33 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:11:34 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Took 0.96 seconds to deallocate network for instance.
Dec 01 17:11:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-5d21a9ae-8ea8-4d8d-955e-e1f4d182ed84 req-73388c7d-cb8a-4d5a-ab80-559094bd294c service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Received event network-vif-deleted-7b52d740-f797-4bc8-9e0c-d9f4744e4a4f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:11:34 user nova-compute[75745]: INFO nova.compute.manager [req-5d21a9ae-8ea8-4d8d-955e-e1f4d182ed84 req-73388c7d-cb8a-4d5a-ab80-559094bd294c service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Neutron deleted interface 7b52d740-f797-4bc8-9e0c-d9f4744e4a4f; detaching it from the instance and deleting it from the info cache
Dec 01 17:11:34 user nova-compute[75745]: DEBUG nova.network.neutron [req-5d21a9ae-8ea8-4d8d-955e-e1f4d182ed84 req-73388c7d-cb8a-4d5a-ab80-559094bd294c service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-c8daf79b-cd60-441f-a45b-748f5a0af6bd req-fb3b4b65-8812-4007-b769-ea26c7dc4c29 service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Received event volume-reimaged-47a3e21c-03d2-4df0-b96b-c78261e91b98 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c8daf79b-cd60-441f-a45b-748f5a0af6bd req-fb3b4b65-8812-4007-b769-ea26c7dc4c29 service nova] Acquiring lock "71504d5d-0999-4960-8782-b454cb407e9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c8daf79b-cd60-441f-a45b-748f5a0af6bd req-fb3b4b65-8812-4007-b769-ea26c7dc4c29 service nova] Lock "71504d5d-0999-4960-8782-b454cb407e9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c8daf79b-cd60-441f-a45b-748f5a0af6bd req-fb3b4b65-8812-4007-b769-ea26c7dc4c29 service nova] Lock "71504d5d-0999-4960-8782-b454cb407e9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-c8daf79b-cd60-441f-a45b-748f5a0af6bd req-fb3b4b65-8812-4007-b769-ea26c7dc4c29 service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Processing event volume-reimaged-47a3e21c-03d2-4df0-b96b-c78261e91b98 {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG nova.compute.manager [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Instance event wait completed in 23 seconds for volume-reimaged {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-5d21a9ae-8ea8-4d8d-955e-e1f4d182ed84 req-73388c7d-cb8a-4d5a-ab80-559094bd294c service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Detach interface failed, port_id=7b52d740-f797-4bc8-9e0c-d9f4744e4a4f, reason: Instance dc78dcf1-f005-415c-ac27-798cab8f52fb could not be found. {{(pid=75745) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-35c54ebb-a86c-4193-91e9-1e19101d7b9b tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-35c54ebb-a86c-4193-91e9-1e19101d7b9b tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:34 user nova-compute[75745]: INFO nova.virt.block_device [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Booting with volume 47a3e21c-03d2-4df0-b96b-c78261e91b98 at /dev/vda
Dec 01 17:11:34 user nova-compute[75745]: DEBUG os_brick.utils [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b521da4d-d43a-4c76-ad91-c99092c0bde1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b598a08f-056f-4ce0-baab-4449b3fd7cf2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.042s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef83e16-0889-4a88-befd-3f55ccdd0e36]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5558ba39-0efa-4625-babb-c6c5b9070685]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-d2956562-369e-47a1-811a-4499785252ed req-035cea91-edba-4f60-9b7d-0eb3fa551d04 service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Received event network-vif-plugged-7b52d740-f797-4bc8-9e0c-d9f4744e4a4f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d2956562-369e-47a1-811a-4499785252ed req-035cea91-edba-4f60-9b7d-0eb3fa551d04 service nova] Acquiring lock "dc78dcf1-f005-415c-ac27-798cab8f52fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d2956562-369e-47a1-811a-4499785252ed req-035cea91-edba-4f60-9b7d-0eb3fa551d04 service nova] Lock "dc78dcf1-f005-415c-ac27-798cab8f52fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d2956562-369e-47a1-811a-4499785252ed req-035cea91-edba-4f60-9b7d-0eb3fa551d04 service nova] Lock "dc78dcf1-f005-415c-ac27-798cab8f52fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-d2956562-369e-47a1-811a-4499785252ed req-035cea91-edba-4f60-9b7d-0eb3fa551d04 service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] No waiting events found dispatching network-vif-plugged-7b52d740-f797-4bc8-9e0c-d9f4744e4a4f {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:11:34 user nova-compute[75745]: WARNING nova.compute.manager [req-d2956562-369e-47a1-811a-4499785252ed req-035cea91-edba-4f60-9b7d-0eb3fa551d04 service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Received unexpected event network-vif-plugged-7b52d740-f797-4bc8-9e0c-d9f4744e4a4f for instance with vm_state deleted and task_state None.
Dec 01 17:11:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-d2956562-369e-47a1-811a-4499785252ed req-035cea91-edba-4f60-9b7d-0eb3fa551d04 service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Received event network-vif-plugged-7b52d740-f797-4bc8-9e0c-d9f4744e4a4f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d2956562-369e-47a1-811a-4499785252ed req-035cea91-edba-4f60-9b7d-0eb3fa551d04 service nova] Acquiring lock "dc78dcf1-f005-415c-ac27-798cab8f52fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d2956562-369e-47a1-811a-4499785252ed req-035cea91-edba-4f60-9b7d-0eb3fa551d04 service nova] Lock "dc78dcf1-f005-415c-ac27-798cab8f52fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d2956562-369e-47a1-811a-4499785252ed req-035cea91-edba-4f60-9b7d-0eb3fa551d04 service nova] Lock "dc78dcf1-f005-415c-ac27-798cab8f52fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-d2956562-369e-47a1-811a-4499785252ed req-035cea91-edba-4f60-9b7d-0eb3fa551d04 service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] No waiting events found dispatching network-vif-plugged-7b52d740-f797-4bc8-9e0c-d9f4744e4a4f {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:11:34 user nova-compute[75745]: WARNING nova.compute.manager [req-d2956562-369e-47a1-811a-4499785252ed req-035cea91-edba-4f60-9b7d-0eb3fa551d04 service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Received unexpected event network-vif-plugged-7b52d740-f797-4bc8-9e0c-d9f4744e4a4f for instance with vm_state deleted and task_state None.
Dec 01 17:11:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-d2956562-369e-47a1-811a-4499785252ed req-035cea91-edba-4f60-9b7d-0eb3fa551d04 service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Received event network-vif-plugged-7b52d740-f797-4bc8-9e0c-d9f4744e4a4f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d2956562-369e-47a1-811a-4499785252ed req-035cea91-edba-4f60-9b7d-0eb3fa551d04 service nova] Acquiring lock "dc78dcf1-f005-415c-ac27-798cab8f52fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d2956562-369e-47a1-811a-4499785252ed req-035cea91-edba-4f60-9b7d-0eb3fa551d04 service nova] Lock "dc78dcf1-f005-415c-ac27-798cab8f52fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d2956562-369e-47a1-811a-4499785252ed req-035cea91-edba-4f60-9b7d-0eb3fa551d04 service nova] Lock "dc78dcf1-f005-415c-ac27-798cab8f52fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-d2956562-369e-47a1-811a-4499785252ed req-035cea91-edba-4f60-9b7d-0eb3fa551d04 service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] No waiting events found dispatching network-vif-plugged-7b52d740-f797-4bc8-9e0c-d9f4744e4a4f {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:11:34 user nova-compute[75745]: WARNING nova.compute.manager [req-d2956562-369e-47a1-811a-4499785252ed req-035cea91-edba-4f60-9b7d-0eb3fa551d04 service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Received unexpected event network-vif-plugged-7b52d740-f797-4bc8-9e0c-d9f4744e4a4f for instance with vm_state deleted and task_state None.
Dec 01 17:11:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-d2956562-369e-47a1-811a-4499785252ed req-035cea91-edba-4f60-9b7d-0eb3fa551d04 service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Received event network-vif-unplugged-7b52d740-f797-4bc8-9e0c-d9f4744e4a4f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d2956562-369e-47a1-811a-4499785252ed req-035cea91-edba-4f60-9b7d-0eb3fa551d04 service nova] Acquiring lock "dc78dcf1-f005-415c-ac27-798cab8f52fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d2956562-369e-47a1-811a-4499785252ed req-035cea91-edba-4f60-9b7d-0eb3fa551d04 service nova] Lock "dc78dcf1-f005-415c-ac27-798cab8f52fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d2956562-369e-47a1-811a-4499785252ed req-035cea91-edba-4f60-9b7d-0eb3fa551d04 service nova] Lock "dc78dcf1-f005-415c-ac27-798cab8f52fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-d2956562-369e-47a1-811a-4499785252ed req-035cea91-edba-4f60-9b7d-0eb3fa551d04 service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] No waiting events found dispatching network-vif-unplugged-7b52d740-f797-4bc8-9e0c-d9f4744e4a4f {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:11:34 user nova-compute[75745]: WARNING nova.compute.manager [req-d2956562-369e-47a1-811a-4499785252ed req-035cea91-edba-4f60-9b7d-0eb3fa551d04 service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Received unexpected event network-vif-unplugged-7b52d740-f797-4bc8-9e0c-d9f4744e4a4f for instance with vm_state deleted and task_state None.
Dec 01 17:11:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-d2956562-369e-47a1-811a-4499785252ed req-035cea91-edba-4f60-9b7d-0eb3fa551d04 service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Received event network-vif-plugged-7b52d740-f797-4bc8-9e0c-d9f4744e4a4f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d2956562-369e-47a1-811a-4499785252ed req-035cea91-edba-4f60-9b7d-0eb3fa551d04 service nova] Acquiring lock "dc78dcf1-f005-415c-ac27-798cab8f52fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d2956562-369e-47a1-811a-4499785252ed req-035cea91-edba-4f60-9b7d-0eb3fa551d04 service nova] Lock "dc78dcf1-f005-415c-ac27-798cab8f52fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d2956562-369e-47a1-811a-4499785252ed req-035cea91-edba-4f60-9b7d-0eb3fa551d04 service nova] Lock "dc78dcf1-f005-415c-ac27-798cab8f52fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-d2956562-369e-47a1-811a-4499785252ed req-035cea91-edba-4f60-9b7d-0eb3fa551d04 service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] No waiting events found dispatching network-vif-plugged-7b52d740-f797-4bc8-9e0c-d9f4744e4a4f {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:11:34 user nova-compute[75745]: WARNING nova.compute.manager [req-d2956562-369e-47a1-811a-4499785252ed req-035cea91-edba-4f60-9b7d-0eb3fa551d04 service nova] [instance: dc78dcf1-f005-415c-ac27-798cab8f52fb] Received unexpected event network-vif-plugged-7b52d740-f797-4bc8-9e0c-d9f4744e4a4f for instance with vm_state deleted and task_state None.
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:11:34 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c95387d-e743-453b-b261-dff160cd844e]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG os_brick.utils [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Updating existing volume attachment record: 0bf4b522-fb65-4706-b4af-72b3f888b288 {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-35c54ebb-a86c-4193-91e9-1e19101d7b9b tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-35c54ebb-a86c-4193-91e9-1e19101d7b9b tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-35c54ebb-a86c-4193-91e9-1e19101d7b9b tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.454s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:34 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-35c54ebb-a86c-4193-91e9-1e19101d7b9b tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Deleted allocations for instance dc78dcf1-f005-415c-ac27-798cab8f52fb
Dec 01 17:11:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-35c54ebb-a86c-4193-91e9-1e19101d7b9b tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "dc78dcf1-f005-415c-ac27-798cab8f52fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.171s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:35 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:11:35 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Cleaning up deleted instances {{(pid=75745) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 01 17:11:35 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] There are 0 instances to clean {{(pid=75745) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 01 17:11:36 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:11:36 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75745) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 01 17:11:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:37 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:11:37 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:11:38 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:11:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:39 user nova-compute[75745]: INFO nova.compute.manager [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Detaching volume 609a2122-bfa0-40d7-b912-c4d799157121
Dec 01 17:11:39 user nova-compute[75745]: INFO nova.virt.block_device [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Attempting to driver detach volume 609a2122-bfa0-40d7-b912-c4d799157121 from mountpoint /dev/vdb
Dec 01 17:11:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Attempting to detach device vdb from instance 4ac6f586-cc5b-4a3f-b374-4b2006a48427 from the persistent domain config. {{(pid=75745) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 17:11:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:11:39 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:11:39 user nova-compute[75745]:   <source dev="/dev/sdd"/>
Dec 01 17:11:39 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:11:39 user nova-compute[75745]:   <serial>609a2122-bfa0-40d7-b912-c4d799157121</serial>
Dec 01 17:11:39 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 01 17:11:39 user nova-compute[75745]: </disk>
Dec 01 17:11:39 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:11:39 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Successfully detached device vdb from instance 4ac6f586-cc5b-4a3f-b374-4b2006a48427 from the persistent domain config.
Dec 01 17:11:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4ac6f586-cc5b-4a3f-b374-4b2006a48427 from the live domain config. {{(pid=75745) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 17:11:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:11:39 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:11:39 user nova-compute[75745]:   <source dev="/dev/sdd"/>
Dec 01 17:11:39 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:11:39 user nova-compute[75745]:   <serial>609a2122-bfa0-40d7-b912-c4d799157121</serial>
Dec 01 17:11:39 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 01 17:11:39 user nova-compute[75745]: </disk>
Dec 01 17:11:39 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:11:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4ac6f586-cc5b-4a3f-b374-4b2006a48427 {{(pid=75745) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 17:11:39 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:11:39 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:11:39 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:11:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:39 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:11:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdd70405-389f-4121-81e9-bfe317d33746/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdd70405-389f-4121-81e9-bfe317d33746/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdd70405-389f-4121-81e9-bfe317d33746/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdd70405-389f-4121-81e9-bfe317d33746/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d50a2d4e-82c3-409d-bc50-12dc1269741b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d50a2d4e-82c3-409d-bc50-12dc1269741b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d50a2d4e-82c3-409d-bc50-12dc1269741b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d50a2d4e-82c3-409d-bc50-12dc1269741b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:42 user nova-compute[75745]: INFO nova.compute.manager [None req-d777befc-7696-46f3-9047-7d77a16bdd0c tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Unrescuing
Dec 01 17:11:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d777befc-7696-46f3-9047-7d77a16bdd0c tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Acquiring lock "refresh_cache-2abc6436-bf45-497a-acd2-47d43d5e158c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:11:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d777befc-7696-46f3-9047-7d77a16bdd0c tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Acquired lock "refresh_cache-2abc6436-bf45-497a-acd2-47d43d5e158c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:11:42 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d777befc-7696-46f3-9047-7d77a16bdd0c tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:11:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:42 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:11:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:42 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d777befc-7696-46f3-9047-7d77a16bdd0c tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Updating instance_info_cache with network_info: [{"id": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "address": "fa:16:3e:66:74:ba", "network": {"id": "3d78774f-ff2b-4705-b359-7a1fb7fc272f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-234182378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1efefd35d14e03a3eebfff2ac0d335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5897fde5-fe", "ovs_interfaceid": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:11:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d777befc-7696-46f3-9047-7d77a16bdd0c tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Releasing lock "refresh_cache-2abc6436-bf45-497a-acd2-47d43d5e158c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:11:42 user nova-compute[75745]: DEBUG nova.objects.instance [None req-d777befc-7696-46f3-9047-7d77a16bdd0c tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lazy-loading 'flavor' on Instance uuid 2abc6436-bf45-497a-acd2-47d43d5e158c {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:11:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:43 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:43 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:43 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:43 user nova-compute[75745]: DEBUG nova.compute.manager [req-24bd484b-ea59-4da0-90f7-ee6670b7ca2b req-e054f648-4caf-4fe2-aa72-9afcb809a987 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Received event network-vif-unplugged-5897fde5-fea9-4ff3-98b8-db1020cf5127 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:11:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-24bd484b-ea59-4da0-90f7-ee6670b7ca2b req-e054f648-4caf-4fe2-aa72-9afcb809a987 service nova] Acquiring lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-24bd484b-ea59-4da0-90f7-ee6670b7ca2b req-e054f648-4caf-4fe2-aa72-9afcb809a987 service nova] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-24bd484b-ea59-4da0-90f7-ee6670b7ca2b req-e054f648-4caf-4fe2-aa72-9afcb809a987 service nova] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:43 user nova-compute[75745]: DEBUG nova.compute.manager [req-24bd484b-ea59-4da0-90f7-ee6670b7ca2b req-e054f648-4caf-4fe2-aa72-9afcb809a987 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] No waiting events found dispatching network-vif-unplugged-5897fde5-fea9-4ff3-98b8-db1020cf5127 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:11:43 user nova-compute[75745]: WARNING nova.compute.manager [req-24bd484b-ea59-4da0-90f7-ee6670b7ca2b req-e054f648-4caf-4fe2-aa72-9afcb809a987 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Received unexpected event network-vif-unplugged-5897fde5-fea9-4ff3-98b8-db1020cf5127 for instance with vm_state rescued and task_state unrescuing.
Dec 01 17:11:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:44 user nova-compute[75745]: DEBUG nova.compute.manager [req-b4fb4539-5838-4c0e-bada-29a3bd222ebe req-3695c3c3-22c3-4660-837b-ed0db8897ffd service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Received event network-changed-5897fde5-fea9-4ff3-98b8-db1020cf5127 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:11:44 user nova-compute[75745]: DEBUG nova.compute.manager [req-b4fb4539-5838-4c0e-bada-29a3bd222ebe req-3695c3c3-22c3-4660-837b-ed0db8897ffd service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Refreshing instance network info cache due to event network-changed-5897fde5-fea9-4ff3-98b8-db1020cf5127. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:11:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b4fb4539-5838-4c0e-bada-29a3bd222ebe req-3695c3c3-22c3-4660-837b-ed0db8897ffd service nova] Acquiring lock "refresh_cache-2abc6436-bf45-497a-acd2-47d43d5e158c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:11:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b4fb4539-5838-4c0e-bada-29a3bd222ebe req-3695c3c3-22c3-4660-837b-ed0db8897ffd service nova] Acquired lock "refresh_cache-2abc6436-bf45-497a-acd2-47d43d5e158c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:11:44 user nova-compute[75745]: DEBUG nova.network.neutron [req-b4fb4539-5838-4c0e-bada-29a3bd222ebe req-3695c3c3-22c3-4660-837b-ed0db8897ffd service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Refreshing network info cache for port 5897fde5-fea9-4ff3-98b8-db1020cf5127 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:11:44 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:11:44 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:11:44 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=7699MB free_disk=25.410888671875GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:11:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:44 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Instance destroyed successfully.
Dec 01 17:11:44 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 4ac6f586-cc5b-4a3f-b374-4b2006a48427 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:11:44 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 2abc6436-bf45-497a-acd2-47d43d5e158c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:11:44 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 71504d5d-0999-4960-8782-b454cb407e9f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:11:44 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 98b29ba5-9993-4494-b196-f7eea077df7a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:11:44 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance bdd70405-389f-4121-81e9-bfe317d33746 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:11:44 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance d997cdd6-67c6-4263-814a-17cf9e27bbeb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:11:44 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance d50a2d4e-82c3-409d-bc50-12dc1269741b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:11:44 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 3a56aca8-ffbb-450b-a953-fc2071902486 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:11:44 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:11:44 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:11:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:44 user nova-compute[75745]: DEBUG nova.network.neutron [req-b4fb4539-5838-4c0e-bada-29a3bd222ebe req-3695c3c3-22c3-4660-837b-ed0db8897ffd service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Updated VIF entry in instance network info cache for port 5897fde5-fea9-4ff3-98b8-db1020cf5127. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:11:44 user nova-compute[75745]: DEBUG nova.network.neutron [req-b4fb4539-5838-4c0e-bada-29a3bd222ebe req-3695c3c3-22c3-4660-837b-ed0db8897ffd service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Updating instance_info_cache with network_info: [{"id": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "address": "fa:16:3e:66:74:ba", "network": {"id": "3d78774f-ff2b-4705-b359-7a1fb7fc272f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-234182378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1efefd35d14e03a3eebfff2ac0d335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5897fde5-fe", "ovs_interfaceid": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:11:44 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:11:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b4fb4539-5838-4c0e-bada-29a3bd222ebe req-3695c3c3-22c3-4660-837b-ed0db8897ffd service nova] Releasing lock "refresh_cache-2abc6436-bf45-497a-acd2-47d43d5e158c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:11:44 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:11:44 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:11:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.491s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:11:45 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Creating image(s)
Dec 01 17:11:45 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Did not create local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Ensure instance console log exists: /opt/stack/data/nova/instances/71504d5d-0999-4960-8782-b454cb407e9f/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Start _get_guest_xml network_info=[{"id": "d3079bd2-25ea-432b-a601-9bb7502fe9c8", "address": "fa:16:3e:3a:86:18", "network": {"id": "b05bdd5e-502b-4f25-bef1-0b17b23a0765", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1245857440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a2dd2fc4fef47d584dd73c8bf3e42ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3079bd2-25", "ovs_interfaceid": "d3079bd2-25ea-432b-a601-9bb7502fe9c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': '0bf4b522-fb65-4706-b4af-72b3f888b288', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vitPIayJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '71504d5d-0999-4960-8782-b454cb407e9f', 'attached_at': '', 'detached_at': '', 'volume_id': '47a3e21c-03d2-4df0-b96b-c78261e91b98', 'serial': '47a3e21c-03d2-4df0-b96b-c78261e91b98'}, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:11:45 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Dec 01 17:11:45 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Dec 01 17:11:45 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG nova.objects.instance [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Lazy-loading 'vcpu_model' on Instance uuid 71504d5d-0999-4960-8782-b454cb407e9f {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vitPIayJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:11:45 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 01 17:11:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:11:45 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 01 17:11:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:11:45 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e77b194-b01c-472d-ba75-2d924ba8f269]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:11:45 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff07fadc-5535-45ea-bf08-65ec1d30286c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98] added
Dec 01 17:11:45 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1bf6f1f-2e46-4bb8-b773-b6f4273d0ba0]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c46de7-9e48-4248-8e6d-93ebfb12f280]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vitPIayJ {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vitPIayJ" returned: 0 in 0.026s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e82342-064c-4740-9f79-40f3074b679f]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vitPIayJ'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffbc72f-bccd-402f-a8ba-f35c8a3095af]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5a91d5-eefd-472b-bd86-66e747782c2c]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e (non-flash)
Dec 01 17:11:45 user nova-compute[75745]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:11:45 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e (non-flash)
Dec 01 17:11:45 user nova-compute[75745]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:11:45 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG nova.compute.manager [req-c6df7ef2-67a6-44a9-8f24-9faff1518ce3 req-f5fa4691-0bbb-4daa-a8b4-88322db40630 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Received event network-vif-plugged-5897fde5-fea9-4ff3-98b8-db1020cf5127 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c6df7ef2-67a6-44a9-8f24-9faff1518ce3 req-f5fa4691-0bbb-4daa-a8b4-88322db40630 service nova] Acquiring lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c6df7ef2-67a6-44a9-8f24-9faff1518ce3 req-f5fa4691-0bbb-4daa-a8b4-88322db40630 service nova] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c6df7ef2-67a6-44a9-8f24-9faff1518ce3 req-f5fa4691-0bbb-4daa-a8b4-88322db40630 service nova] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG nova.compute.manager [req-c6df7ef2-67a6-44a9-8f24-9faff1518ce3 req-f5fa4691-0bbb-4daa-a8b4-88322db40630 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] No waiting events found dispatching network-vif-plugged-5897fde5-fea9-4ff3-98b8-db1020cf5127 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:11:45 user nova-compute[75745]: WARNING nova.compute.manager [req-c6df7ef2-67a6-44a9-8f24-9faff1518ce3 req-f5fa4691-0bbb-4daa-a8b4-88322db40630 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Received unexpected event network-vif-plugged-5897fde5-fea9-4ff3-98b8-db1020cf5127 for instance with vm_state rescued and task_state unrescuing.
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f808a2-270e-4f00-a933-63ee64387fac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98, portal: 172.16.0.220,3260]
Dec 01 17:11:45 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98, portal: 172.16.0.220,3260] successful.
Dec 01 17:11:45 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.113s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5c55f0-6111-475a-bee9-b20a5800f267]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Rebuilding the list of instances to heal {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cc102c-02fb-4fc5-af62-7a5675781531]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e (non-flash)
Dec 01 17:11:45 user nova-compute[75745]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:11:45 user nova-compute[75745]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)
Dec 01 17:11:45 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e (non-flash)
Dec 01 17:11:45 user nova-compute[75745]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:11:45 user nova-compute[75745]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)
Dec 01 17:11:45 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.498s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2358faa-98a5-412b-89c0-c70276215bff]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: None {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-4ac6f586-cc5b-4a3f-b374-4b2006a48427" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-4ac6f586-cc5b-4a3f-b374-4b2006a48427" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG nova.objects.instance [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lazy-loading 'info_cache' on Instance uuid 4ac6f586-cc5b-4a3f-b374-4b2006a48427 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG nova.compute.manager [req-e77ed651-9020-4359-ab0d-cc4761f3d0dd req-dd7dab6a-fcd0-44d3-b4b2-bffb8ca2c2e3 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Received event network-changed-5897fde5-fea9-4ff3-98b8-db1020cf5127 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG nova.compute.manager [req-e77ed651-9020-4359-ab0d-cc4761f3d0dd req-dd7dab6a-fcd0-44d3-b4b2-bffb8ca2c2e3 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Refreshing instance network info cache due to event network-changed-5897fde5-fea9-4ff3-98b8-db1020cf5127. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e77ed651-9020-4359-ab0d-cc4761f3d0dd req-dd7dab6a-fcd0-44d3-b4b2-bffb8ca2c2e3 service nova] Acquiring lock "refresh_cache-2abc6436-bf45-497a-acd2-47d43d5e158c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e77ed651-9020-4359-ab0d-cc4761f3d0dd req-dd7dab6a-fcd0-44d3-b4b2-bffb8ca2c2e3 service nova] Acquired lock "refresh_cache-2abc6436-bf45-497a-acd2-47d43d5e158c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:11:45 user nova-compute[75745]: DEBUG nova.network.neutron [req-e77ed651-9020-4359-ab0d-cc4761f3d0dd req-dd7dab6a-fcd0-44d3-b4b2-bffb8ca2c2e3 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Refreshing network info cache for port 5897fde5-fea9-4ff3-98b8-db1020cf5127 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG nova.network.neutron [req-e77ed651-9020-4359-ab0d-cc4761f3d0dd req-dd7dab6a-fcd0-44d3-b4b2-bffb8ca2c2e3 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Updated VIF entry in instance network info cache for port 5897fde5-fea9-4ff3-98b8-db1020cf5127. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG nova.network.neutron [req-e77ed651-9020-4359-ab0d-cc4761f3d0dd req-dd7dab6a-fcd0-44d3-b4b2-bffb8ca2c2e3 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Updating instance_info_cache with network_info: [{"id": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "address": "fa:16:3e:66:74:ba", "network": {"id": "3d78774f-ff2b-4705-b359-7a1fb7fc272f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-234182378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1efefd35d14e03a3eebfff2ac0d335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5897fde5-fe", "ovs_interfaceid": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vitPIayJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.557s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] <== connect_volume: return (1560ms) {'type': 'block', 'scsi_wwn': '23664633264353231', 'path': '/dev/sdb'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664633264353231', 'path': '/dev/sdb'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e77ed651-9020-4359-ab0d-cc4761f3d0dd req-dd7dab6a-fcd0-44d3-b4b2-bffb8ca2c2e3 service nova] Releasing lock "refresh_cache-2abc6436-bf45-497a-acd2-47d43d5e158c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Updating instance_info_cache with network_info: [{"id": "b4990a3b-371a-44eb-98d8-685dc63590da", "address": "fa:16:3e:d3:4e:b4", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4990a3b-37", "ovs_interfaceid": "b4990a3b-371a-44eb-98d8-685dc63590da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T17:09:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1431601205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1079491771',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0vMcRe2hslMIizadcBGZgc30uKaeuXlHDf+WN8kFazoQVdMmpxW2R8vlqGKQfRbVS0qJwaTmeur8bI1mP+n7SfrtPRhzkJ9JoTM17YCGvpITsXmYzQv3QY/h+FSAFt5g==',key_name='tempest-keypair-785211803',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:09:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1a2dd2fc4fef47d584dd73c8bf3e42ae',ramdisk_id='',reservation_id='r-3kwsa42n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-861427896',owner_user_name='tempest-ServerActionsV293TestJSON-861427896-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:11:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc2b48b84ebb46ae9b300423b9e225be',uuid=71504d5d-0999-4960-8782-b454cb407e9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3079bd2-25ea-432b-a601-9bb7502fe9c8", "address": "fa:16:3e:3a:86:18", "network": {"id": "b05bdd5e-502b-4f25-bef1-0b17b23a0765", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1245857440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a2dd2fc4fef47d584dd73c8bf3e42ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3079bd2-25", "ovs_interfaceid": "d3079bd2-25ea-432b-a601-9bb7502fe9c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Converting VIF {"id": "d3079bd2-25ea-432b-a601-9bb7502fe9c8", "address": "fa:16:3e:3a:86:18", "network": {"id": "b05bdd5e-502b-4f25-bef1-0b17b23a0765", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1245857440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a2dd2fc4fef47d584dd73c8bf3e42ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3079bd2-25", "ovs_interfaceid": "d3079bd2-25ea-432b-a601-9bb7502fe9c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:86:18,bridge_name='br-int',has_traffic_filtering=True,id=d3079bd2-25ea-432b-a601-9bb7502fe9c8,network=Network(b05bdd5e-502b-4f25-bef1-0b17b23a0765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3079bd2-25') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:11:46 user nova-compute[75745]:   <uuid>71504d5d-0999-4960-8782-b454cb407e9f</uuid>
Dec 01 17:11:46 user nova-compute[75745]:   <name>instance-0000000d</name>
Dec 01 17:11:46 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:11:46 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:11:46 user nova-compute[75745]:   <metadata>
Dec 01 17:11:46 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:11:46 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:11:46 user nova-compute[75745]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1431601205</nova:name>
Dec 01 17:11:46 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:11:45</nova:creationTime>
Dec 01 17:11:46 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:11:46 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:11:46 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:11:46 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:11:46 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:11:46 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:11:46 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:11:46 user nova-compute[75745]:       <nova:owner>
Dec 01 17:11:46 user nova-compute[75745]:         <nova:user uuid="dc2b48b84ebb46ae9b300423b9e225be">tempest-ServerActionsV293TestJSON-861427896-project-member</nova:user>
Dec 01 17:11:46 user nova-compute[75745]:         <nova:project uuid="1a2dd2fc4fef47d584dd73c8bf3e42ae">tempest-ServerActionsV293TestJSON-861427896</nova:project>
Dec 01 17:11:46 user nova-compute[75745]:       </nova:owner>
Dec 01 17:11:46 user nova-compute[75745]:       <nova:ports>
Dec 01 17:11:46 user nova-compute[75745]:         <nova:port uuid="d3079bd2-25ea-432b-a601-9bb7502fe9c8">
Dec 01 17:11:46 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 01 17:11:46 user nova-compute[75745]:         </nova:port>
Dec 01 17:11:46 user nova-compute[75745]:       </nova:ports>
Dec 01 17:11:46 user nova-compute[75745]:     </nova:instance>
Dec 01 17:11:46 user nova-compute[75745]:   </metadata>
Dec 01 17:11:46 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:11:46 user nova-compute[75745]:     <system>
Dec 01 17:11:46 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:11:46 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:11:46 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:11:46 user nova-compute[75745]:       <entry name="serial">71504d5d-0999-4960-8782-b454cb407e9f</entry>
Dec 01 17:11:46 user nova-compute[75745]:       <entry name="uuid">71504d5d-0999-4960-8782-b454cb407e9f</entry>
Dec 01 17:11:46 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:11:46 user nova-compute[75745]:     </system>
Dec 01 17:11:46 user nova-compute[75745]:   </sysinfo>
Dec 01 17:11:46 user nova-compute[75745]:   <os>
Dec 01 17:11:46 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:11:46 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:11:46 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:11:46 user nova-compute[75745]:   </os>
Dec 01 17:11:46 user nova-compute[75745]:   <features>
Dec 01 17:11:46 user nova-compute[75745]:     <acpi/>
Dec 01 17:11:46 user nova-compute[75745]:     <apic/>
Dec 01 17:11:46 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:11:46 user nova-compute[75745]:   </features>
Dec 01 17:11:46 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:11:46 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:11:46 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:11:46 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:11:46 user nova-compute[75745]:   </clock>
Dec 01 17:11:46 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:11:46 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:11:46 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:11:46 user nova-compute[75745]:   </cpu>
Dec 01 17:11:46 user nova-compute[75745]:   <devices>
Dec 01 17:11:46 user nova-compute[75745]:     <disk type="block" device="disk">
Dec 01 17:11:46 user nova-compute[75745]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:11:46 user nova-compute[75745]:       <source dev="/dev/sdb"/>
Dec 01 17:11:46 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:11:46 user nova-compute[75745]:       <serial>47a3e21c-03d2-4df0-b96b-c78261e91b98</serial>
Dec 01 17:11:46 user nova-compute[75745]:     </disk>
Dec 01 17:11:46 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:11:46 user nova-compute[75745]:       <mac address="fa:16:3e:3a:86:18"/>
Dec 01 17:11:46 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:11:46 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:11:46 user nova-compute[75745]:       <target dev="tapd3079bd2-25"/>
Dec 01 17:11:46 user nova-compute[75745]:     </interface>
Dec 01 17:11:46 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:11:46 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/71504d5d-0999-4960-8782-b454cb407e9f/console.log" append="off"/>
Dec 01 17:11:46 user nova-compute[75745]:     </serial>
Dec 01 17:11:46 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:11:46 user nova-compute[75745]:     <video>
Dec 01 17:11:46 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:11:46 user nova-compute[75745]:     </video>
Dec 01 17:11:46 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:11:46 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:11:46 user nova-compute[75745]:     </rng>
Dec 01 17:11:46 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:11:46 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:11:46 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:11:46 user nova-compute[75745]:     </memballoon>
Dec 01 17:11:46 user nova-compute[75745]:   </devices>
Dec 01 17:11:46 user nova-compute[75745]: </domain>
Dec 01 17:11:46 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T17:09:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1431601205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1079491771',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0vMcRe2hslMIizadcBGZgc30uKaeuXlHDf+WN8kFazoQVdMmpxW2R8vlqGKQfRbVS0qJwaTmeur8bI1mP+n7SfrtPRhzkJ9JoTM17YCGvpITsXmYzQv3QY/h+FSAFt5g==',key_name='tempest-keypair-785211803',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:09:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1a2dd2fc4fef47d584dd73c8bf3e42ae',ramdisk_id='',reservation_id='r-3kwsa42n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-861427896',owner_user_name='tempest-ServerActionsV293TestJSON-861427896-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:11:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc2b48b84ebb46ae9b300423b9e225be',uuid=71504d5d-0999-4960-8782-b454cb407e9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3079bd2-25ea-432b-a601-9bb7502fe9c8", "address": "fa:16:3e:3a:86:18", "network": {"id": "b05bdd5e-502b-4f25-bef1-0b17b23a0765", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1245857440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a2dd2fc4fef47d584dd73c8bf3e42ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3079bd2-25", "ovs_interfaceid": "d3079bd2-25ea-432b-a601-9bb7502fe9c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Converting VIF {"id": "d3079bd2-25ea-432b-a601-9bb7502fe9c8", "address": "fa:16:3e:3a:86:18", "network": {"id": "b05bdd5e-502b-4f25-bef1-0b17b23a0765", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1245857440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a2dd2fc4fef47d584dd73c8bf3e42ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3079bd2-25", "ovs_interfaceid": "d3079bd2-25ea-432b-a601-9bb7502fe9c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:86:18,bridge_name='br-int',has_traffic_filtering=True,id=d3079bd2-25ea-432b-a601-9bb7502fe9c8,network=Network(b05bdd5e-502b-4f25-bef1-0b17b23a0765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3079bd2-25') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG os_vif [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:86:18,bridge_name='br-int',has_traffic_filtering=True,id=d3079bd2-25ea-432b-a601-9bb7502fe9c8,network=Network(b05bdd5e-502b-4f25-bef1-0b17b23a0765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3079bd2-25') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9cb02040-5eca-5ada-9b3a-3003180e6454', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-4ac6f586-cc5b-4a3f-b374-4b2006a48427" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3079bd2-25, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd3079bd2-25, col_values=(('qos', UUID('3e896be0-5e13-41a5-9a01-4a0e101891aa')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd3079bd2-25, col_values=(('external_ids', {'iface-id': 'd3079bd2-25ea-432b-a601-9bb7502fe9c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:86:18', 'vm-uuid': '71504d5d-0999-4960-8782-b454cb407e9f'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:46 user nova-compute[75745]: INFO os_vif [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:86:18,bridge_name='br-int',has_traffic_filtering=True,id=d3079bd2-25ea-432b-a601-9bb7502fe9c8,network=Network(b05bdd5e-502b-4f25-bef1-0b17b23a0765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3079bd2-25')
Dec 01 17:11:46 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:11:46 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] No VIF found with MAC fa:16:3e:3a:86:18, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:11:47 user nova-compute[75745]: DEBUG nova.compute.manager [req-1753f6ba-e44b-42ef-8f03-0be080d87cb2 req-b768178b-3d39-4f5c-b7ad-fa7c24709bd7 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Received event network-vif-plugged-5897fde5-fea9-4ff3-98b8-db1020cf5127 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:11:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1753f6ba-e44b-42ef-8f03-0be080d87cb2 req-b768178b-3d39-4f5c-b7ad-fa7c24709bd7 service nova] Acquiring lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1753f6ba-e44b-42ef-8f03-0be080d87cb2 req-b768178b-3d39-4f5c-b7ad-fa7c24709bd7 service nova] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1753f6ba-e44b-42ef-8f03-0be080d87cb2 req-b768178b-3d39-4f5c-b7ad-fa7c24709bd7 service nova] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:47 user nova-compute[75745]: DEBUG nova.compute.manager [req-1753f6ba-e44b-42ef-8f03-0be080d87cb2 req-b768178b-3d39-4f5c-b7ad-fa7c24709bd7 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] No waiting events found dispatching network-vif-plugged-5897fde5-fea9-4ff3-98b8-db1020cf5127 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:11:47 user nova-compute[75745]: WARNING nova.compute.manager [req-1753f6ba-e44b-42ef-8f03-0be080d87cb2 req-b768178b-3d39-4f5c-b7ad-fa7c24709bd7 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Received unexpected event network-vif-plugged-5897fde5-fea9-4ff3-98b8-db1020cf5127 for instance with vm_state rescued and task_state unrescuing.
Dec 01 17:11:47 user nova-compute[75745]: DEBUG nova.compute.manager [req-1753f6ba-e44b-42ef-8f03-0be080d87cb2 req-b768178b-3d39-4f5c-b7ad-fa7c24709bd7 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Received event network-vif-plugged-5897fde5-fea9-4ff3-98b8-db1020cf5127 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:11:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1753f6ba-e44b-42ef-8f03-0be080d87cb2 req-b768178b-3d39-4f5c-b7ad-fa7c24709bd7 service nova] Acquiring lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1753f6ba-e44b-42ef-8f03-0be080d87cb2 req-b768178b-3d39-4f5c-b7ad-fa7c24709bd7 service nova] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1753f6ba-e44b-42ef-8f03-0be080d87cb2 req-b768178b-3d39-4f5c-b7ad-fa7c24709bd7 service nova] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:47 user nova-compute[75745]: DEBUG nova.compute.manager [req-1753f6ba-e44b-42ef-8f03-0be080d87cb2 req-b768178b-3d39-4f5c-b7ad-fa7c24709bd7 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] No waiting events found dispatching network-vif-plugged-5897fde5-fea9-4ff3-98b8-db1020cf5127 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:11:47 user nova-compute[75745]: WARNING nova.compute.manager [req-1753f6ba-e44b-42ef-8f03-0be080d87cb2 req-b768178b-3d39-4f5c-b7ad-fa7c24709bd7 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Received unexpected event network-vif-plugged-5897fde5-fea9-4ff3-98b8-db1020cf5127 for instance with vm_state rescued and task_state unrescuing.
Dec 01 17:11:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:48 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d777befc-7696-46f3-9047-7d77a16bdd0c tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:11:48 user nova-compute[75745]: DEBUG nova.compute.manager [req-e363d8f1-cc5e-41fa-8fb1-c72496255cfd req-669dad78-fa44-4348-8347-5e40b9e4a57f service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Received event network-vif-plugged-d3079bd2-25ea-432b-a601-9bb7502fe9c8 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:11:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e363d8f1-cc5e-41fa-8fb1-c72496255cfd req-669dad78-fa44-4348-8347-5e40b9e4a57f service nova] Acquiring lock "71504d5d-0999-4960-8782-b454cb407e9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e363d8f1-cc5e-41fa-8fb1-c72496255cfd req-669dad78-fa44-4348-8347-5e40b9e4a57f service nova] Lock "71504d5d-0999-4960-8782-b454cb407e9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e363d8f1-cc5e-41fa-8fb1-c72496255cfd req-669dad78-fa44-4348-8347-5e40b9e4a57f service nova] Lock "71504d5d-0999-4960-8782-b454cb407e9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:48 user nova-compute[75745]: DEBUG nova.compute.manager [req-e363d8f1-cc5e-41fa-8fb1-c72496255cfd req-669dad78-fa44-4348-8347-5e40b9e4a57f service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] No waiting events found dispatching network-vif-plugged-d3079bd2-25ea-432b-a601-9bb7502fe9c8 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:11:48 user nova-compute[75745]: WARNING nova.compute.manager [req-e363d8f1-cc5e-41fa-8fb1-c72496255cfd req-669dad78-fa44-4348-8347-5e40b9e4a57f service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Received unexpected event network-vif-plugged-d3079bd2-25ea-432b-a601-9bb7502fe9c8 for instance with vm_state active and task_state rebuild_spawning.
Dec 01 17:11:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-2a80b41b-ca74-4e75-9425-0b652b43a92a req-c7e84f00-73f0-4337-82a1-ee0b3b0eca6b service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Received event network-vif-plugged-d3079bd2-25ea-432b-a601-9bb7502fe9c8 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:11:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2a80b41b-ca74-4e75-9425-0b652b43a92a req-c7e84f00-73f0-4337-82a1-ee0b3b0eca6b service nova] Acquiring lock "71504d5d-0999-4960-8782-b454cb407e9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2a80b41b-ca74-4e75-9425-0b652b43a92a req-c7e84f00-73f0-4337-82a1-ee0b3b0eca6b service nova] Lock "71504d5d-0999-4960-8782-b454cb407e9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2a80b41b-ca74-4e75-9425-0b652b43a92a req-c7e84f00-73f0-4337-82a1-ee0b3b0eca6b service nova] Lock "71504d5d-0999-4960-8782-b454cb407e9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-2a80b41b-ca74-4e75-9425-0b652b43a92a req-c7e84f00-73f0-4337-82a1-ee0b3b0eca6b service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] No waiting events found dispatching network-vif-plugged-d3079bd2-25ea-432b-a601-9bb7502fe9c8 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:11:51 user nova-compute[75745]: WARNING nova.compute.manager [req-2a80b41b-ca74-4e75-9425-0b652b43a92a req-c7e84f00-73f0-4337-82a1-ee0b3b0eca6b service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Received unexpected event network-vif-plugged-d3079bd2-25ea-432b-a601-9bb7502fe9c8 for instance with vm_state active and task_state rebuild_spawning.
Dec 01 17:11:51 user nova-compute[75745]: DEBUG nova.compute.manager [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:11:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:11:51 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Instance spawned successfully.
Dec 01 17:11:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:11:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:11:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:11:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:11:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:11:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:11:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:11:51 user nova-compute[75745]: DEBUG nova.compute.manager [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:11:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:11:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:11:51 user nova-compute[75745]: DEBUG nova.objects.instance [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75745) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Dec 01 17:11:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c8daf79b-cd60-441f-a45b-748f5a0af6bd tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.093s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:11:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:11:59 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4ac6f586-cc5b-4a3f-b374-4b2006a48427 is timed out.
Dec 01 17:11:59 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Successfully detached device vdb from instance 4ac6f586-cc5b-4a3f-b374-4b2006a48427 from the live domain config.
Dec 01 17:11:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SQOjKMiW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:11:59 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:11:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0245cb8-df30-42de-9aa9-a1ba75b31399]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:11:59 user nova-compute[75745]: No targets found.
Dec 01 17:11:59 user nova-compute[75745]: iSNS:
Dec 01 17:11:59 user nova-compute[75745]: No targets found.
Dec 01 17:11:59 user nova-compute[75745]: STATIC:
Dec 01 17:11:59 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98
Dec 01 17:11:59 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:11:59 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:11:59 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e
Dec 01 17:11:59 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:11:59 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:11:59 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121
Dec 01 17:11:59 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:11:59 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:11:59 user nova-compute[75745]: FIRMWARE:
Dec 01 17:11:59 user nova-compute[75745]: No targets found.
Dec 01 17:11:59 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:11:59 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:11:59 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9a4abe-2587-484c-9ec2-5d752f2cb6bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ad46e9-79fb-49d0-a9c1-1e46b0c87dfa]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e (non-flash)
Dec 01 17:11:59 user nova-compute[75745]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:11:59 user nova-compute[75745]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)
Dec 01 17:11:59 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e (non-flash)
Dec 01 17:11:59 user nova-compute[75745]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 (non-flash)
Dec 01 17:11:59 user nova-compute[75745]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)
Dec 01 17:11:59 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24e4989ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121'): ({'sdd'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Removing single pathed devices sdd {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3f2aca-eb59-4d5d-992c-0205c6a856e9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aef479c-fa62-455f-a46c-24fbd43bdb8e]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Flushing IO for device /dev/sdd {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed8cba1-4c4b-49c3-9282-60181c05b826]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8159a487-03b7-479a-83d7-220d4a234709]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] SCSI volumes sdd have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[096e3f27-be18-40d7-a88f-bc3ef2f29783]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c0605e-d6c7-409f-808e-70415134823e]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121, portal: 172.16.0.220,3260]
Dec 01 17:11:59 user nova-compute[75745]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121, portal: 172.16.0.220,3260] successful.
Dec 01 17:11:59 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:11:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609a2122-bfa0-40d7-b912-c4d799157121 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3c5ffb-777d-479b-b2c5-07573ffb38b8]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:12:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:12:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:12:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] <== disconnect_volume: return (326ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:12:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:12:00 user nova-compute[75745]: DEBUG nova.objects.instance [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lazy-loading 'flavor' on Instance uuid 4ac6f586-cc5b-4a3f-b374-4b2006a48427 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:12:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0d041e30-bcab-404f-9da4-dd071ef244fc tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.879s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:12:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a783e7d9-177b-435e-879b-9395a01808dd tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:12:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a783e7d9-177b-435e-879b-9395a01808dd tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:12:02 user nova-compute[75745]: DEBUG nova.compute.manager [None req-a783e7d9-177b-435e-879b-9395a01808dd tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:12:02 user nova-compute[75745]: DEBUG nova.compute.manager [None req-a783e7d9-177b-435e-879b-9395a01808dd tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75745) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Dec 01 17:12:02 user nova-compute[75745]: DEBUG nova.objects.instance [None req-a783e7d9-177b-435e-879b-9395a01808dd tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lazy-loading 'flavor' on Instance uuid 4ac6f586-cc5b-4a3f-b374-4b2006a48427 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:12:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:02 user nova-compute[75745]: DEBUG nova.compute.manager [req-5c6861fb-6594-417a-9c39-a30ed4bb9344 req-dd4e0fce-e9f6-4112-ab7f-79a38e8c4824 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Received event network-vif-unplugged-b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:12:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5c6861fb-6594-417a-9c39-a30ed4bb9344 req-dd4e0fce-e9f6-4112-ab7f-79a38e8c4824 service nova] Acquiring lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:12:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5c6861fb-6594-417a-9c39-a30ed4bb9344 req-dd4e0fce-e9f6-4112-ab7f-79a38e8c4824 service nova] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:12:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5c6861fb-6594-417a-9c39-a30ed4bb9344 req-dd4e0fce-e9f6-4112-ab7f-79a38e8c4824 service nova] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:12:02 user nova-compute[75745]: DEBUG nova.compute.manager [req-5c6861fb-6594-417a-9c39-a30ed4bb9344 req-dd4e0fce-e9f6-4112-ab7f-79a38e8c4824 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] No waiting events found dispatching network-vif-unplugged-b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:12:02 user nova-compute[75745]: WARNING nova.compute.manager [req-5c6861fb-6594-417a-9c39-a30ed4bb9344 req-dd4e0fce-e9f6-4112-ab7f-79a38e8c4824 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Received unexpected event network-vif-unplugged-b4990a3b-371a-44eb-98d8-685dc63590da for instance with vm_state active and task_state powering-off.
Dec 01 17:12:02 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Instance destroyed successfully.
Dec 01 17:12:02 user nova-compute[75745]: DEBUG nova.compute.manager [None req-a783e7d9-177b-435e-879b-9395a01808dd tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:12:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a783e7d9-177b-435e-879b-9395a01808dd tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.905s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:12:04 user nova-compute[75745]: DEBUG nova.compute.manager [req-68f1dedb-4a86-4079-8233-2193a1d55fd4 req-f179eb83-ae65-41f8-b761-0bd711df01eb service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Received event network-vif-plugged-b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:12:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-68f1dedb-4a86-4079-8233-2193a1d55fd4 req-f179eb83-ae65-41f8-b761-0bd711df01eb service nova] Acquiring lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:12:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-68f1dedb-4a86-4079-8233-2193a1d55fd4 req-f179eb83-ae65-41f8-b761-0bd711df01eb service nova] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:12:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-68f1dedb-4a86-4079-8233-2193a1d55fd4 req-f179eb83-ae65-41f8-b761-0bd711df01eb service nova] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:12:04 user nova-compute[75745]: DEBUG nova.compute.manager [req-68f1dedb-4a86-4079-8233-2193a1d55fd4 req-f179eb83-ae65-41f8-b761-0bd711df01eb service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] No waiting events found dispatching network-vif-plugged-b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:12:04 user nova-compute[75745]: WARNING nova.compute.manager [req-68f1dedb-4a86-4079-8233-2193a1d55fd4 req-f179eb83-ae65-41f8-b761-0bd711df01eb service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Received unexpected event network-vif-plugged-b4990a3b-371a-44eb-98d8-685dc63590da for instance with vm_state stopped and task_state None.
Dec 01 17:12:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:15 user nova-compute[75745]: DEBUG nova.compute.manager [req-3cf41fef-49a1-48d7-9e2f-51cd555949ab req-dfee850f-4661-4764-872b-0893c7426081 service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Received event network-changed-9c3aade6-4181-435d-aabd-07988112a373 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:12:15 user nova-compute[75745]: DEBUG nova.compute.manager [req-3cf41fef-49a1-48d7-9e2f-51cd555949ab req-dfee850f-4661-4764-872b-0893c7426081 service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Refreshing instance network info cache due to event network-changed-9c3aade6-4181-435d-aabd-07988112a373. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:12:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3cf41fef-49a1-48d7-9e2f-51cd555949ab req-dfee850f-4661-4764-872b-0893c7426081 service nova] Acquiring lock "refresh_cache-98b29ba5-9993-4494-b196-f7eea077df7a" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:12:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3cf41fef-49a1-48d7-9e2f-51cd555949ab req-dfee850f-4661-4764-872b-0893c7426081 service nova] Acquired lock "refresh_cache-98b29ba5-9993-4494-b196-f7eea077df7a" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:12:15 user nova-compute[75745]: DEBUG nova.network.neutron [req-3cf41fef-49a1-48d7-9e2f-51cd555949ab req-dfee850f-4661-4764-872b-0893c7426081 service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Refreshing network info cache for port 9c3aade6-4181-435d-aabd-07988112a373 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:12:15 user nova-compute[75745]: DEBUG nova.network.neutron [req-3cf41fef-49a1-48d7-9e2f-51cd555949ab req-dfee850f-4661-4764-872b-0893c7426081 service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Updated VIF entry in instance network info cache for port 9c3aade6-4181-435d-aabd-07988112a373. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:12:15 user nova-compute[75745]: DEBUG nova.network.neutron [req-3cf41fef-49a1-48d7-9e2f-51cd555949ab req-dfee850f-4661-4764-872b-0893c7426081 service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Updating instance_info_cache with network_info: [{"id": "9c3aade6-4181-435d-aabd-07988112a373", "address": "fa:16:3e:60:67:90", "network": {"id": "9083e0bd-c071-4794-bf87-74bc7ba3898b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-947489426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4f3ec75737429e8834e7d3576ffa69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3aade6-41", "ovs_interfaceid": "9c3aade6-4181-435d-aabd-07988112a373", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:12:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3cf41fef-49a1-48d7-9e2f-51cd555949ab req-dfee850f-4661-4764-872b-0893c7426081 service nova] Releasing lock "refresh_cache-98b29ba5-9993-4494-b196-f7eea077df7a" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:12:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Acquiring lock "2abc6436-bf45-497a-acd2-47d43d5e158c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:12:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:12:15 user nova-compute[75745]: INFO nova.compute.manager [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Detaching volume fcd8549e-610f-4ede-841e-88c1b93df25e
Dec 01 17:12:15 user nova-compute[75745]: INFO nova.virt.block_device [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Attempting to driver detach volume fcd8549e-610f-4ede-841e-88c1b93df25e from mountpoint /dev/vdb
Dec 01 17:12:15 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Attempting to detach device vdb from instance 2abc6436-bf45-497a-acd2-47d43d5e158c from the persistent domain config. {{(pid=75745) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 17:12:15 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:12:15 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:12:15 user nova-compute[75745]:   <source dev="/dev/sdc"/>
Dec 01 17:12:15 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:12:15 user nova-compute[75745]:   <serial>fcd8549e-610f-4ede-841e-88c1b93df25e</serial>
Dec 01 17:12:15 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 17:12:15 user nova-compute[75745]: </disk>
Dec 01 17:12:15 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:12:15 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Successfully detached device vdb from instance 2abc6436-bf45-497a-acd2-47d43d5e158c from the persistent domain config.
Dec 01 17:12:15 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2abc6436-bf45-497a-acd2-47d43d5e158c from the live domain config. {{(pid=75745) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 17:12:15 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:12:15 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:12:15 user nova-compute[75745]:   <source dev="/dev/sdc"/>
Dec 01 17:12:15 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:12:15 user nova-compute[75745]:   <serial>fcd8549e-610f-4ede-841e-88c1b93df25e</serial>
Dec 01 17:12:15 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 17:12:15 user nova-compute[75745]: </disk>
Dec 01 17:12:15 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:12:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2abc6436-bf45-497a-acd2-47d43d5e158c {{(pid=75745) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 17:12:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:18 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:12:18 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Triggering sync for uuid 4ac6f586-cc5b-4a3f-b374-4b2006a48427 {{(pid=75745) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 17:12:18 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Triggering sync for uuid 2abc6436-bf45-497a-acd2-47d43d5e158c {{(pid=75745) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 17:12:18 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Triggering sync for uuid 98b29ba5-9993-4494-b196-f7eea077df7a {{(pid=75745) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 17:12:18 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Triggering sync for uuid bdd70405-389f-4121-81e9-bfe317d33746 {{(pid=75745) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 17:12:18 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Triggering sync for uuid d997cdd6-67c6-4263-814a-17cf9e27bbeb {{(pid=75745) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 17:12:18 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Triggering sync for uuid d50a2d4e-82c3-409d-bc50-12dc1269741b {{(pid=75745) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 17:12:18 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Triggering sync for uuid 3a56aca8-ffbb-450b-a953-fc2071902486 {{(pid=75745) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 17:12:18 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Triggering sync for uuid 71504d5d-0999-4960-8782-b454cb407e9f {{(pid=75745) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 17:12:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:12:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:12:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "2abc6436-bf45-497a-acd2-47d43d5e158c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:12:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "98b29ba5-9993-4494-b196-f7eea077df7a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:12:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "98b29ba5-9993-4494-b196-f7eea077df7a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:12:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "bdd70405-389f-4121-81e9-bfe317d33746" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:12:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "bdd70405-389f-4121-81e9-bfe317d33746" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:12:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "d997cdd6-67c6-4263-814a-17cf9e27bbeb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:12:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "d997cdd6-67c6-4263-814a-17cf9e27bbeb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:12:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "d50a2d4e-82c3-409d-bc50-12dc1269741b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:12:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "d50a2d4e-82c3-409d-bc50-12dc1269741b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:12:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "3a56aca8-ffbb-450b-a953-fc2071902486" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:12:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "3a56aca8-ffbb-450b-a953-fc2071902486" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:12:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "71504d5d-0999-4960-8782-b454cb407e9f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:12:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "71504d5d-0999-4960-8782-b454cb407e9f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:12:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:12:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "98b29ba5-9993-4494-b196-f7eea077df7a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:12:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "bdd70405-389f-4121-81e9-bfe317d33746" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:12:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "d997cdd6-67c6-4263-814a-17cf9e27bbeb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:12:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "3a56aca8-ffbb-450b-a953-fc2071902486" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:12:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "d50a2d4e-82c3-409d-bc50-12dc1269741b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:12:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "71504d5d-0999-4960-8782-b454cb407e9f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:12:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "06356800-2f67-4c35-9703-a71ca3271693" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:12:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "06356800-2f67-4c35-9703-a71ca3271693" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:12:25 user nova-compute[75745]: DEBUG nova.compute.manager [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:12:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:12:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:12:26 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:12:26 user nova-compute[75745]: INFO nova.compute.claims [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Claim successful on node user
Dec 01 17:12:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:26 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Refreshing inventories for resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 01 17:12:26 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Updating ProviderTree inventory for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 01 17:12:26 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Updating inventory in ProviderTree for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 01 17:12:26 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Refreshing aggregate associations for resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9, aggregates: None {{(pid=75745) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 01 17:12:26 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Refreshing trait associations for resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9, traits: COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=75745) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 01 17:12:26 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:12:26 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:12:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.627s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:12:26 user nova-compute[75745]: DEBUG nova.compute.manager [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:12:26 user nova-compute[75745]: DEBUG nova.compute.manager [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:12:26 user nova-compute[75745]: DEBUG nova.network.neutron [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:12:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:26 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:12:26 user nova-compute[75745]: DEBUG nova.compute.manager [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:12:26 user nova-compute[75745]: DEBUG nova.policy [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76845c98f91449df9196e19187b1b786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1730419061445f98680b8c81753a4f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:12:27 user nova-compute[75745]: DEBUG nova.compute.manager [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:12:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:12:27 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Creating image(s)
Dec 01 17:12:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "/opt/stack/data/nova/instances/06356800-2f67-4c35-9703-a71ca3271693/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:12:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "/opt/stack/data/nova/instances/06356800-2f67-4c35-9703-a71ca3271693/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:12:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "/opt/stack/data/nova/instances/06356800-2f67-4c35-9703-a71ca3271693/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:12:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.189s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:12:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:12:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.197s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/06356800-2f67-4c35-9703-a71ca3271693/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/06356800-2f67-4c35-9703-a71ca3271693/disk 1073741824" returned: 0 in 0.056s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:12:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.202s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:27 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Checking if we can resize image /opt/stack/data/nova/instances/06356800-2f67-4c35-9703-a71ca3271693/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:12:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06356800-2f67-4c35-9703-a71ca3271693/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06356800-2f67-4c35-9703-a71ca3271693/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:27 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Cannot resize image /opt/stack/data/nova/instances/06356800-2f67-4c35-9703-a71ca3271693/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:12:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:12:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Ensure instance console log exists: /opt/stack/data/nova/instances/06356800-2f67-4c35-9703-a71ca3271693/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:12:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:12:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:12:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:12:28 user nova-compute[75745]: DEBUG nova.network.neutron [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Successfully created port: 9b2916b4-ab61-436b-b0a1-1fecb6bee4fa {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG nova.network.neutron [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Successfully updated port: 9b2916b4-ab61-436b-b0a1-1fecb6bee4fa {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "refresh_cache-06356800-2f67-4c35-9703-a71ca3271693" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquired lock "refresh_cache-06356800-2f67-4c35-9703-a71ca3271693" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG nova.network.neutron [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG nova.compute.manager [req-ce589376-c7ce-468f-8e3e-20b0a7ef4b21 req-2e2808af-4b34-4227-9237-bc136352c684 service nova] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Received event network-changed-9b2916b4-ab61-436b-b0a1-1fecb6bee4fa {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG nova.compute.manager [req-ce589376-c7ce-468f-8e3e-20b0a7ef4b21 req-2e2808af-4b34-4227-9237-bc136352c684 service nova] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Refreshing instance network info cache due to event network-changed-9b2916b4-ab61-436b-b0a1-1fecb6bee4fa. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ce589376-c7ce-468f-8e3e-20b0a7ef4b21 req-2e2808af-4b34-4227-9237-bc136352c684 service nova] Acquiring lock "refresh_cache-06356800-2f67-4c35-9703-a71ca3271693" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG nova.network.neutron [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG nova.network.neutron [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Updating instance_info_cache with network_info: [{"id": "9b2916b4-ab61-436b-b0a1-1fecb6bee4fa", "address": "fa:16:3e:e1:90:4e", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2916b4-ab", "ovs_interfaceid": "9b2916b4-ab61-436b-b0a1-1fecb6bee4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Releasing lock "refresh_cache-06356800-2f67-4c35-9703-a71ca3271693" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG nova.compute.manager [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Instance network_info: |[{"id": "9b2916b4-ab61-436b-b0a1-1fecb6bee4fa", "address": "fa:16:3e:e1:90:4e", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2916b4-ab", "ovs_interfaceid": "9b2916b4-ab61-436b-b0a1-1fecb6bee4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ce589376-c7ce-468f-8e3e-20b0a7ef4b21 req-2e2808af-4b34-4227-9237-bc136352c684 service nova] Acquired lock "refresh_cache-06356800-2f67-4c35-9703-a71ca3271693" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG nova.network.neutron [req-ce589376-c7ce-468f-8e3e-20b0a7ef4b21 req-2e2808af-4b34-4227-9237-bc136352c684 service nova] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Refreshing network info cache for port 9b2916b4-ab61-436b-b0a1-1fecb6bee4fa {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Start _get_guest_xml network_info=[{"id": "9b2916b4-ab61-436b-b0a1-1fecb6bee4fa", "address": "fa:16:3e:e1:90:4e", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2916b4-ab", "ovs_interfaceid": "9b2916b4-ab61-436b-b0a1-1fecb6bee4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:12:29 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:12:29 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:12:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:12:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1435269449',display_name='tempest-AttachVolumeNegativeTest-server-1435269449',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1435269449',id=19,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtqwquuShxYMqWMPctqcQtjzSW4DWT+9w3SZAFuo2ZmtHYDax/Q8O6qbwl2O1K3c2iS1/9qFZLBKT+Yowi6riKJhG5okf+bCdOuOVxw8yCohOECfsT/QD1N7XekPJdSew==',key_name='tempest-keypair-2042853901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1730419061445f98680b8c81753a4f3',ramdisk_id='',reservation_id='r-1whtszwk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1227943771',owner_user_name='tempest-AttachVolumeNegativeTest-1227943771-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:12:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76845c98f91449df9196e19187b1b786',uuid=06356800-2f67-4c35-9703-a71ca3271693,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b2916b4-ab61-436b-b0a1-1fecb6bee4fa", "address": "fa:16:3e:e1:90:4e", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2916b4-ab", "ovs_interfaceid": "9b2916b4-ab61-436b-b0a1-1fecb6bee4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Converting VIF {"id": "9b2916b4-ab61-436b-b0a1-1fecb6bee4fa", "address": "fa:16:3e:e1:90:4e", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2916b4-ab", "ovs_interfaceid": "9b2916b4-ab61-436b-b0a1-1fecb6bee4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:90:4e,bridge_name='br-int',has_traffic_filtering=True,id=9b2916b4-ab61-436b-b0a1-1fecb6bee4fa,network=Network(8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2916b4-ab') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG nova.objects.instance [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lazy-loading 'pci_devices' on Instance uuid 06356800-2f67-4c35-9703-a71ca3271693 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:12:29 user nova-compute[75745]:   <uuid>06356800-2f67-4c35-9703-a71ca3271693</uuid>
Dec 01 17:12:29 user nova-compute[75745]:   <name>instance-00000013</name>
Dec 01 17:12:29 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:12:29 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:12:29 user nova-compute[75745]:   <metadata>
Dec 01 17:12:29 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:12:29 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:12:29 user nova-compute[75745]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1435269449</nova:name>
Dec 01 17:12:29 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:12:29</nova:creationTime>
Dec 01 17:12:29 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:12:29 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:12:29 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:12:29 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:12:29 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:12:29 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:12:29 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:12:29 user nova-compute[75745]:       <nova:owner>
Dec 01 17:12:29 user nova-compute[75745]:         <nova:user uuid="76845c98f91449df9196e19187b1b786">tempest-AttachVolumeNegativeTest-1227943771-project-member</nova:user>
Dec 01 17:12:29 user nova-compute[75745]:         <nova:project uuid="c1730419061445f98680b8c81753a4f3">tempest-AttachVolumeNegativeTest-1227943771</nova:project>
Dec 01 17:12:29 user nova-compute[75745]:       </nova:owner>
Dec 01 17:12:29 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:12:29 user nova-compute[75745]:       <nova:ports>
Dec 01 17:12:29 user nova-compute[75745]:         <nova:port uuid="9b2916b4-ab61-436b-b0a1-1fecb6bee4fa">
Dec 01 17:12:29 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 01 17:12:29 user nova-compute[75745]:         </nova:port>
Dec 01 17:12:29 user nova-compute[75745]:       </nova:ports>
Dec 01 17:12:29 user nova-compute[75745]:     </nova:instance>
Dec 01 17:12:29 user nova-compute[75745]:   </metadata>
Dec 01 17:12:29 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:12:29 user nova-compute[75745]:     <system>
Dec 01 17:12:29 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:12:29 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:12:29 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:12:29 user nova-compute[75745]:       <entry name="serial">06356800-2f67-4c35-9703-a71ca3271693</entry>
Dec 01 17:12:29 user nova-compute[75745]:       <entry name="uuid">06356800-2f67-4c35-9703-a71ca3271693</entry>
Dec 01 17:12:29 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:12:29 user nova-compute[75745]:     </system>
Dec 01 17:12:29 user nova-compute[75745]:   </sysinfo>
Dec 01 17:12:29 user nova-compute[75745]:   <os>
Dec 01 17:12:29 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:12:29 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:12:29 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:12:29 user nova-compute[75745]:   </os>
Dec 01 17:12:29 user nova-compute[75745]:   <features>
Dec 01 17:12:29 user nova-compute[75745]:     <acpi/>
Dec 01 17:12:29 user nova-compute[75745]:     <apic/>
Dec 01 17:12:29 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:12:29 user nova-compute[75745]:   </features>
Dec 01 17:12:29 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:12:29 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:12:29 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:12:29 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:12:29 user nova-compute[75745]:   </clock>
Dec 01 17:12:29 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:12:29 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:12:29 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:12:29 user nova-compute[75745]:   </cpu>
Dec 01 17:12:29 user nova-compute[75745]:   <devices>
Dec 01 17:12:29 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:12:29 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:12:29 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/06356800-2f67-4c35-9703-a71ca3271693/disk"/>
Dec 01 17:12:29 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:12:29 user nova-compute[75745]:     </disk>
Dec 01 17:12:29 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:12:29 user nova-compute[75745]:       <mac address="fa:16:3e:e1:90:4e"/>
Dec 01 17:12:29 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:12:29 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:12:29 user nova-compute[75745]:       <target dev="tap9b2916b4-ab"/>
Dec 01 17:12:29 user nova-compute[75745]:     </interface>
Dec 01 17:12:29 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:12:29 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/06356800-2f67-4c35-9703-a71ca3271693/console.log" append="off"/>
Dec 01 17:12:29 user nova-compute[75745]:     </serial>
Dec 01 17:12:29 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:12:29 user nova-compute[75745]:     <video>
Dec 01 17:12:29 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:12:29 user nova-compute[75745]:     </video>
Dec 01 17:12:29 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:12:29 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:12:29 user nova-compute[75745]:     </rng>
Dec 01 17:12:29 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:12:29 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:12:29 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:12:29 user nova-compute[75745]:     </memballoon>
Dec 01 17:12:29 user nova-compute[75745]:   </devices>
Dec 01 17:12:29 user nova-compute[75745]: </domain>
Dec 01 17:12:29 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:12:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1435269449',display_name='tempest-AttachVolumeNegativeTest-server-1435269449',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1435269449',id=19,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtqwquuShxYMqWMPctqcQtjzSW4DWT+9w3SZAFuo2ZmtHYDax/Q8O6qbwl2O1K3c2iS1/9qFZLBKT+Yowi6riKJhG5okf+bCdOuOVxw8yCohOECfsT/QD1N7XekPJdSew==',key_name='tempest-keypair-2042853901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1730419061445f98680b8c81753a4f3',ramdisk_id='',reservation_id='r-1whtszwk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1227943771',owner_user_name='tempest-AttachVolumeNegativeTest-1227943771-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:12:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76845c98f91449df9196e19187b1b786',uuid=06356800-2f67-4c35-9703-a71ca3271693,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b2916b4-ab61-436b-b0a1-1fecb6bee4fa", "address": "fa:16:3e:e1:90:4e", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2916b4-ab", "ovs_interfaceid": "9b2916b4-ab61-436b-b0a1-1fecb6bee4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Converting VIF {"id": "9b2916b4-ab61-436b-b0a1-1fecb6bee4fa", "address": "fa:16:3e:e1:90:4e", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2916b4-ab", "ovs_interfaceid": "9b2916b4-ab61-436b-b0a1-1fecb6bee4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:90:4e,bridge_name='br-int',has_traffic_filtering=True,id=9b2916b4-ab61-436b-b0a1-1fecb6bee4fa,network=Network(8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2916b4-ab') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG os_vif [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:90:4e,bridge_name='br-int',has_traffic_filtering=True,id=9b2916b4-ab61-436b-b0a1-1fecb6bee4fa,network=Network(8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2916b4-ab') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03c6841f-43e5-57c7-ba24-309c74a8ed41', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b2916b4-ab, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9b2916b4-ab, col_values=(('qos', UUID('febb0be1-bb37-48a5-8fb8-bab555ea1b6c')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9b2916b4-ab, col_values=(('external_ids', {'iface-id': '9b2916b4-ab61-436b-b0a1-1fecb6bee4fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:90:4e', 'vm-uuid': '06356800-2f67-4c35-9703-a71ca3271693'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:12:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:29 user nova-compute[75745]: INFO os_vif [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:90:4e,bridge_name='br-int',has_traffic_filtering=True,id=9b2916b4-ab61-436b-b0a1-1fecb6bee4fa,network=Network(8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2916b4-ab')
Dec 01 17:12:30 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:12:30 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] No VIF found with MAC fa:16:3e:e1:90:4e, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:12:30 user nova-compute[75745]: DEBUG nova.network.neutron [req-ce589376-c7ce-468f-8e3e-20b0a7ef4b21 req-2e2808af-4b34-4227-9237-bc136352c684 service nova] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Updated VIF entry in instance network info cache for port 9b2916b4-ab61-436b-b0a1-1fecb6bee4fa. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:12:30 user nova-compute[75745]: DEBUG nova.network.neutron [req-ce589376-c7ce-468f-8e3e-20b0a7ef4b21 req-2e2808af-4b34-4227-9237-bc136352c684 service nova] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Updating instance_info_cache with network_info: [{"id": "9b2916b4-ab61-436b-b0a1-1fecb6bee4fa", "address": "fa:16:3e:e1:90:4e", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2916b4-ab", "ovs_interfaceid": "9b2916b4-ab61-436b-b0a1-1fecb6bee4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:12:30 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ce589376-c7ce-468f-8e3e-20b0a7ef4b21 req-2e2808af-4b34-4227-9237-bc136352c684 service nova] Releasing lock "refresh_cache-06356800-2f67-4c35-9703-a71ca3271693" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:12:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:33 user nova-compute[75745]: DEBUG nova.compute.manager [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:12:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:12:33 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Instance spawned successfully.
Dec 01 17:12:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:12:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:12:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:12:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:12:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:12:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:12:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:12:33 user nova-compute[75745]: INFO nova.compute.manager [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Took 6.56 seconds to spawn the instance on the hypervisor.
Dec 01 17:12:33 user nova-compute[75745]: DEBUG nova.compute.manager [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:12:33 user nova-compute[75745]: INFO nova.compute.manager [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Took 7.80 seconds to build instance.
Dec 01 17:12:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-95d5961f-a9c4-4857-9a4f-d23a7cdac412 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "06356800-2f67-4c35-9703-a71ca3271693" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.897s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:12:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Acquiring lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:12:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:12:33 user nova-compute[75745]: DEBUG nova.compute.manager [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:12:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:12:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:12:34 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:12:34 user nova-compute[75745]: INFO nova.compute.claims [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Claim successful on node user
Dec 01 17:12:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-9ca48777-fdea-40a8-893c-e9fc1e528425 req-89c47bd7-435a-4251-af0f-c57016bd1c9d service nova] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Received event network-vif-plugged-9b2916b4-ab61-436b-b0a1-1fecb6bee4fa {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:12:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-9ca48777-fdea-40a8-893c-e9fc1e528425 req-89c47bd7-435a-4251-af0f-c57016bd1c9d service nova] Acquiring lock "06356800-2f67-4c35-9703-a71ca3271693-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:12:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-9ca48777-fdea-40a8-893c-e9fc1e528425 req-89c47bd7-435a-4251-af0f-c57016bd1c9d service nova] Lock "06356800-2f67-4c35-9703-a71ca3271693-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:12:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-9ca48777-fdea-40a8-893c-e9fc1e528425 req-89c47bd7-435a-4251-af0f-c57016bd1c9d service nova] Lock "06356800-2f67-4c35-9703-a71ca3271693-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:12:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-9ca48777-fdea-40a8-893c-e9fc1e528425 req-89c47bd7-435a-4251-af0f-c57016bd1c9d service nova] [instance: 06356800-2f67-4c35-9703-a71ca3271693] No waiting events found dispatching network-vif-plugged-9b2916b4-ab61-436b-b0a1-1fecb6bee4fa {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:12:34 user nova-compute[75745]: WARNING nova.compute.manager [req-9ca48777-fdea-40a8-893c-e9fc1e528425 req-89c47bd7-435a-4251-af0f-c57016bd1c9d service nova] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Received unexpected event network-vif-plugged-9b2916b4-ab61-436b-b0a1-1fecb6bee4fa for instance with vm_state active and task_state None.
Dec 01 17:12:34 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:12:34 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:12:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:12:34 user nova-compute[75745]: DEBUG nova.compute.manager [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:12:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:34 user nova-compute[75745]: DEBUG nova.compute.manager [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:12:34 user nova-compute[75745]: DEBUG nova.network.neutron [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:12:34 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:12:34 user nova-compute[75745]: DEBUG nova.compute.manager [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:12:34 user nova-compute[75745]: DEBUG nova.policy [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5fc9474087534d659beef3cd9f01eb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f601b29e4ec41cba8048a7c999ccdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:12:34 user nova-compute[75745]: DEBUG nova.compute.manager [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:12:34 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:12:34 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Creating image(s)
Dec 01 17:12:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:12:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "/opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:12:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "/opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:12:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.204s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:12:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:12:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.186s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk 1073741824" returned: 0 in 0.049s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:12:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.191s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:35 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:12:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:35 user nova-compute[75745]: DEBUG nova.network.neutron [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Successfully created port: 030e12c5-9662-4774-a9fc-5073144043f0 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:12:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:35 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Cannot resize image /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:12:35 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:12:35 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Ensure instance console log exists: /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:12:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:12:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:12:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.network.neutron [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Successfully updated port: 030e12c5-9662-4774-a9fc-5073144043f0 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Acquiring lock "refresh_cache-0ab0c115-74aa-4e55-92a3-6fa91ba753e3" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Acquired lock "refresh_cache-0ab0c115-74aa-4e55-92a3-6fa91ba753e3" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.network.neutron [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:12:36 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2abc6436-bf45-497a-acd2-47d43d5e158c is timed out.
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.network.neutron [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:12:36 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Successfully detached device vdb from instance 2abc6436-bf45-497a-acd2-47d43d5e158c from the live domain config.
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FkMgtsJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:12:36 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:12:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[125ab954-3cef-4fb5-ad15-e0dbfdc717a1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:12:36 user nova-compute[75745]: No targets found.
Dec 01 17:12:36 user nova-compute[75745]: iSNS:
Dec 01 17:12:36 user nova-compute[75745]: No targets found.
Dec 01 17:12:36 user nova-compute[75745]: STATIC:
Dec 01 17:12:36 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98
Dec 01 17:12:36 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:12:36 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:12:36 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e
Dec 01 17:12:36 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:12:36 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:12:36 user nova-compute[75745]: FIRMWARE:
Dec 01 17:12:36 user nova-compute[75745]: No targets found.
Dec 01 17:12:36 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:12:36 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:12:36 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.compute.manager [req-1bda723c-8908-4816-ba0f-0a0349ff91c2 req-b537bad8-7313-4ae5-a249-e611a94834d9 service nova] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Received event network-vif-plugged-9b2916b4-ab61-436b-b0a1-1fecb6bee4fa {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1bda723c-8908-4816-ba0f-0a0349ff91c2 req-b537bad8-7313-4ae5-a249-e611a94834d9 service nova] Acquiring lock "06356800-2f67-4c35-9703-a71ca3271693-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1bda723c-8908-4816-ba0f-0a0349ff91c2 req-b537bad8-7313-4ae5-a249-e611a94834d9 service nova] Lock "06356800-2f67-4c35-9703-a71ca3271693-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1bda723c-8908-4816-ba0f-0a0349ff91c2 req-b537bad8-7313-4ae5-a249-e611a94834d9 service nova] Lock "06356800-2f67-4c35-9703-a71ca3271693-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.compute.manager [req-1bda723c-8908-4816-ba0f-0a0349ff91c2 req-b537bad8-7313-4ae5-a249-e611a94834d9 service nova] [instance: 06356800-2f67-4c35-9703-a71ca3271693] No waiting events found dispatching network-vif-plugged-9b2916b4-ab61-436b-b0a1-1fecb6bee4fa {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:12:36 user nova-compute[75745]: WARNING nova.compute.manager [req-1bda723c-8908-4816-ba0f-0a0349ff91c2 req-b537bad8-7313-4ae5-a249-e611a94834d9 service nova] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Received unexpected event network-vif-plugged-9b2916b4-ab61-436b-b0a1-1fecb6bee4fa for instance with vm_state active and task_state None.
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.compute.manager [req-1bda723c-8908-4816-ba0f-0a0349ff91c2 req-b537bad8-7313-4ae5-a249-e611a94834d9 service nova] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Received event network-changed-030e12c5-9662-4774-a9fc-5073144043f0 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.compute.manager [req-1bda723c-8908-4816-ba0f-0a0349ff91c2 req-b537bad8-7313-4ae5-a249-e611a94834d9 service nova] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Refreshing instance network info cache due to event network-changed-030e12c5-9662-4774-a9fc-5073144043f0. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1bda723c-8908-4816-ba0f-0a0349ff91c2 req-b537bad8-7313-4ae5-a249-e611a94834d9 service nova] Acquiring lock "refresh_cache-0ab0c115-74aa-4e55-92a3-6fa91ba753e3" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2504f590-a3ec-416c-b42c-ff0b245bd8ff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de7ac01-fdb2-4a38-bf64-1d8b5f7a6275]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e (non-flash)
Dec 01 17:12:36 user nova-compute[75745]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)
Dec 01 17:12:36 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e (non-flash)
Dec 01 17:12:36 user nova-compute[75745]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)
Dec 01 17:12:36 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24d830d990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e'): ({'sdc'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Removing single pathed devices sdc {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e92e6d-87bb-408e-b395-ffe32ef6df26]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21ce228-a69e-4ca3-b4a8-78d946c965a6]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Flushing IO for device /dev/sdc {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7920031-fc42-4cd5-a73c-7a7787fa2b56]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[537c6bbb-3cde-4f69-a4b8-f45f9591a406]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] SCSI volumes sdc have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[83465474-d81a-4c63-b9f7-db9d859cda66]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.network.neutron [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Updating instance_info_cache with network_info: [{"id": "030e12c5-9662-4774-a9fc-5073144043f0", "address": "fa:16:3e:f5:29:5f", "network": {"id": "636c0eca-05bf-45a8-a587-9f9a43f430e8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-52821118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f601b29e4ec41cba8048a7c999ccdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030e12c5-96", "ovs_interfaceid": "030e12c5-9662-4774-a9fc-5073144043f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Releasing lock "refresh_cache-0ab0c115-74aa-4e55-92a3-6fa91ba753e3" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.compute.manager [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Instance network_info: |[{"id": "030e12c5-9662-4774-a9fc-5073144043f0", "address": "fa:16:3e:f5:29:5f", "network": {"id": "636c0eca-05bf-45a8-a587-9f9a43f430e8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-52821118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f601b29e4ec41cba8048a7c999ccdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030e12c5-96", "ovs_interfaceid": "030e12c5-9662-4774-a9fc-5073144043f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1bda723c-8908-4816-ba0f-0a0349ff91c2 req-b537bad8-7313-4ae5-a249-e611a94834d9 service nova] Acquired lock "refresh_cache-0ab0c115-74aa-4e55-92a3-6fa91ba753e3" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.network.neutron [req-1bda723c-8908-4816-ba0f-0a0349ff91c2 req-b537bad8-7313-4ae5-a249-e611a94834d9 service nova] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Refreshing network info cache for port 030e12c5-9662-4774-a9fc-5073144043f0 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Start _get_guest_xml network_info=[{"id": "030e12c5-9662-4774-a9fc-5073144043f0", "address": "fa:16:3e:f5:29:5f", "network": {"id": "636c0eca-05bf-45a8-a587-9f9a43f430e8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-52821118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f601b29e4ec41cba8048a7c999ccdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030e12c5-96", "ovs_interfaceid": "030e12c5-9662-4774-a9fc-5073144043f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:12:36 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:12:36 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:12:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1559268353',display_name='tempest-SnapshotDataIntegrityTests-server-1559268353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1559268353',id=20,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPW2was/W2oV0+Sgn8jzsmfWovebpnmqxoGcbK2sMDQnoW/A2AYcsFBLMhqYOM3Cat20E1mXQf4X4FL1PRDJGYAq8Vmz7xkxcXaOLsIac6k12A/6AzroW3H9mo5zXcbSlw==',key_name='tempest-keypair-1832201527',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f601b29e4ec41cba8048a7c999ccdce',ramdisk_id='',reservation_id='r-u3pdo3rv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-861206412',owner_user_name='tempest-SnapshotDataIntegrityTests-861206412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:12:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fc9474087534d659beef3cd9f01eb97',uuid=0ab0c115-74aa-4e55-92a3-6fa91ba753e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "030e12c5-9662-4774-a9fc-5073144043f0", "address": "fa:16:3e:f5:29:5f", "network": {"id": "636c0eca-05bf-45a8-a587-9f9a43f430e8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-52821118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f601b29e4ec41cba8048a7c999ccdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030e12c5-96", "ovs_interfaceid": "030e12c5-9662-4774-a9fc-5073144043f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Converting VIF {"id": "030e12c5-9662-4774-a9fc-5073144043f0", "address": "fa:16:3e:f5:29:5f", "network": {"id": "636c0eca-05bf-45a8-a587-9f9a43f430e8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-52821118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f601b29e4ec41cba8048a7c999ccdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030e12c5-96", "ovs_interfaceid": "030e12c5-9662-4774-a9fc-5073144043f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:29:5f,bridge_name='br-int',has_traffic_filtering=True,id=030e12c5-9662-4774-a9fc-5073144043f0,network=Network(636c0eca-05bf-45a8-a587-9f9a43f430e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap030e12c5-96') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.objects.instance [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ab0c115-74aa-4e55-92a3-6fa91ba753e3 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0ff8a4-4a29-46e9-95f2-7960c09cb996]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e, portal: 172.16.0.220,3260]
Dec 01 17:12:36 user nova-compute[75745]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e, portal: 172.16.0.220,3260] successful.
Dec 01 17:12:36 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:12:36 user nova-compute[75745]:   <uuid>0ab0c115-74aa-4e55-92a3-6fa91ba753e3</uuid>
Dec 01 17:12:36 user nova-compute[75745]:   <name>instance-00000014</name>
Dec 01 17:12:36 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:12:36 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:12:36 user nova-compute[75745]:   <metadata>
Dec 01 17:12:36 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:12:36 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:12:36 user nova-compute[75745]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1559268353</nova:name>
Dec 01 17:12:36 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:12:36</nova:creationTime>
Dec 01 17:12:36 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:12:36 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:12:36 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:12:36 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:12:36 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:12:36 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:12:36 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:12:36 user nova-compute[75745]:       <nova:owner>
Dec 01 17:12:36 user nova-compute[75745]:         <nova:user uuid="5fc9474087534d659beef3cd9f01eb97">tempest-SnapshotDataIntegrityTests-861206412-project-member</nova:user>
Dec 01 17:12:36 user nova-compute[75745]:         <nova:project uuid="5f601b29e4ec41cba8048a7c999ccdce">tempest-SnapshotDataIntegrityTests-861206412</nova:project>
Dec 01 17:12:36 user nova-compute[75745]:       </nova:owner>
Dec 01 17:12:36 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:12:36 user nova-compute[75745]:       <nova:ports>
Dec 01 17:12:36 user nova-compute[75745]:         <nova:port uuid="030e12c5-9662-4774-a9fc-5073144043f0">
Dec 01 17:12:36 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 01 17:12:36 user nova-compute[75745]:         </nova:port>
Dec 01 17:12:36 user nova-compute[75745]:       </nova:ports>
Dec 01 17:12:36 user nova-compute[75745]:     </nova:instance>
Dec 01 17:12:36 user nova-compute[75745]:   </metadata>
Dec 01 17:12:36 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:12:36 user nova-compute[75745]:     <system>
Dec 01 17:12:36 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:12:36 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:12:36 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:12:36 user nova-compute[75745]:       <entry name="serial">0ab0c115-74aa-4e55-92a3-6fa91ba753e3</entry>
Dec 01 17:12:36 user nova-compute[75745]:       <entry name="uuid">0ab0c115-74aa-4e55-92a3-6fa91ba753e3</entry>
Dec 01 17:12:36 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:12:36 user nova-compute[75745]:     </system>
Dec 01 17:12:36 user nova-compute[75745]:   </sysinfo>
Dec 01 17:12:36 user nova-compute[75745]:   <os>
Dec 01 17:12:36 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:12:36 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:12:36 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:12:36 user nova-compute[75745]:   </os>
Dec 01 17:12:36 user nova-compute[75745]:   <features>
Dec 01 17:12:36 user nova-compute[75745]:     <acpi/>
Dec 01 17:12:36 user nova-compute[75745]:     <apic/>
Dec 01 17:12:36 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:12:36 user nova-compute[75745]:   </features>
Dec 01 17:12:36 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:12:36 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:12:36 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:12:36 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:12:36 user nova-compute[75745]:   </clock>
Dec 01 17:12:36 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:12:36 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:12:36 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:12:36 user nova-compute[75745]:   </cpu>
Dec 01 17:12:36 user nova-compute[75745]:   <devices>
Dec 01 17:12:36 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:12:36 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:12:36 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk"/>
Dec 01 17:12:36 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:12:36 user nova-compute[75745]:     </disk>
Dec 01 17:12:36 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:12:36 user nova-compute[75745]:       <mac address="fa:16:3e:f5:29:5f"/>
Dec 01 17:12:36 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:12:36 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:12:36 user nova-compute[75745]:       <target dev="tap030e12c5-96"/>
Dec 01 17:12:36 user nova-compute[75745]:     </interface>
Dec 01 17:12:36 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:12:36 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/console.log" append="off"/>
Dec 01 17:12:36 user nova-compute[75745]:     </serial>
Dec 01 17:12:36 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:12:36 user nova-compute[75745]:     <video>
Dec 01 17:12:36 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:12:36 user nova-compute[75745]:     </video>
Dec 01 17:12:36 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:12:36 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:12:36 user nova-compute[75745]:     </rng>
Dec 01 17:12:36 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:12:36 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:12:36 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:12:36 user nova-compute[75745]:     </memballoon>
Dec 01 17:12:36 user nova-compute[75745]:   </devices>
Dec 01 17:12:36 user nova-compute[75745]: </domain>
Dec 01 17:12:36 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:12:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1559268353',display_name='tempest-SnapshotDataIntegrityTests-server-1559268353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1559268353',id=20,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPW2was/W2oV0+Sgn8jzsmfWovebpnmqxoGcbK2sMDQnoW/A2AYcsFBLMhqYOM3Cat20E1mXQf4X4FL1PRDJGYAq8Vmz7xkxcXaOLsIac6k12A/6AzroW3H9mo5zXcbSlw==',key_name='tempest-keypair-1832201527',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f601b29e4ec41cba8048a7c999ccdce',ramdisk_id='',reservation_id='r-u3pdo3rv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-861206412',owner_user_name='tempest-SnapshotDataIntegrityTests-861206412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:12:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fc9474087534d659beef3cd9f01eb97',uuid=0ab0c115-74aa-4e55-92a3-6fa91ba753e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "030e12c5-9662-4774-a9fc-5073144043f0", "address": "fa:16:3e:f5:29:5f", "network": {"id": "636c0eca-05bf-45a8-a587-9f9a43f430e8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-52821118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f601b29e4ec41cba8048a7c999ccdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030e12c5-96", "ovs_interfaceid": "030e12c5-9662-4774-a9fc-5073144043f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Converting VIF {"id": "030e12c5-9662-4774-a9fc-5073144043f0", "address": "fa:16:3e:f5:29:5f", "network": {"id": "636c0eca-05bf-45a8-a587-9f9a43f430e8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-52821118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f601b29e4ec41cba8048a7c999ccdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030e12c5-96", "ovs_interfaceid": "030e12c5-9662-4774-a9fc-5073144043f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:29:5f,bridge_name='br-int',has_traffic_filtering=True,id=030e12c5-9662-4774-a9fc-5073144043f0,network=Network(636c0eca-05bf-45a8-a587-9f9a43f430e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap030e12c5-96') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG os_vif [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:29:5f,bridge_name='br-int',has_traffic_filtering=True,id=030e12c5-9662-4774-a9fc-5073144043f0,network=Network(636c0eca-05bf-45a8-a587-9f9a43f430e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap030e12c5-96') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0fcd586f-6ea6-5829-b614-6d8e42145d42', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcd8549e-610f-4ede-841e-88c1b93df25e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5897b708-b074-4378-b757-b7e874f7558b]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] <== disconnect_volume: return (376ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap030e12c5-96, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap030e12c5-96, col_values=(('qos', UUID('28df9a16-4e99-47e3-b102-b9ca8193cb96')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap030e12c5-96, col_values=(('external_ids', {'iface-id': '030e12c5-9662-4774-a9fc-5073144043f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:29:5f', 'vm-uuid': '0ab0c115-74aa-4e55-92a3-6fa91ba753e3'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:36 user nova-compute[75745]: INFO os_vif [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:29:5f,bridge_name='br-int',has_traffic_filtering=True,id=030e12c5-9662-4774-a9fc-5073144043f0,network=Network(636c0eca-05bf-45a8-a587-9f9a43f430e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap030e12c5-96')
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:12:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] No VIF found with MAC fa:16:3e:f5:29:5f, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:12:37 user nova-compute[75745]: DEBUG nova.network.neutron [req-1bda723c-8908-4816-ba0f-0a0349ff91c2 req-b537bad8-7313-4ae5-a249-e611a94834d9 service nova] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Updated VIF entry in instance network info cache for port 030e12c5-9662-4774-a9fc-5073144043f0. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:12:37 user nova-compute[75745]: DEBUG nova.network.neutron [req-1bda723c-8908-4816-ba0f-0a0349ff91c2 req-b537bad8-7313-4ae5-a249-e611a94834d9 service nova] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Updating instance_info_cache with network_info: [{"id": "030e12c5-9662-4774-a9fc-5073144043f0", "address": "fa:16:3e:f5:29:5f", "network": {"id": "636c0eca-05bf-45a8-a587-9f9a43f430e8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-52821118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f601b29e4ec41cba8048a7c999ccdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030e12c5-96", "ovs_interfaceid": "030e12c5-9662-4774-a9fc-5073144043f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:12:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1bda723c-8908-4816-ba0f-0a0349ff91c2 req-b537bad8-7313-4ae5-a249-e611a94834d9 service nova] Releasing lock "refresh_cache-0ab0c115-74aa-4e55-92a3-6fa91ba753e3" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:12:37 user nova-compute[75745]: DEBUG nova.objects.instance [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lazy-loading 'flavor' on Instance uuid 2abc6436-bf45-497a-acd2-47d43d5e158c {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:12:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a2b192b9-fd45-42c7-a55d-9e761e9978da tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.963s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:12:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 19.481s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:12:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:12:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:38 user nova-compute[75745]: DEBUG nova.compute.manager [req-d1978c7e-78ba-4ec9-a3e4-4d86a914c6de req-4e4ec00b-1d50-409a-b23f-b73b41d94ce7 service nova] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Received event network-vif-plugged-030e12c5-9662-4774-a9fc-5073144043f0 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:12:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d1978c7e-78ba-4ec9-a3e4-4d86a914c6de req-4e4ec00b-1d50-409a-b23f-b73b41d94ce7 service nova] Acquiring lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:12:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d1978c7e-78ba-4ec9-a3e4-4d86a914c6de req-4e4ec00b-1d50-409a-b23f-b73b41d94ce7 service nova] Lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:12:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d1978c7e-78ba-4ec9-a3e4-4d86a914c6de req-4e4ec00b-1d50-409a-b23f-b73b41d94ce7 service nova] Lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:12:38 user nova-compute[75745]: DEBUG nova.compute.manager [req-d1978c7e-78ba-4ec9-a3e4-4d86a914c6de req-4e4ec00b-1d50-409a-b23f-b73b41d94ce7 service nova] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] No waiting events found dispatching network-vif-plugged-030e12c5-9662-4774-a9fc-5073144043f0 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:12:38 user nova-compute[75745]: WARNING nova.compute.manager [req-d1978c7e-78ba-4ec9-a3e4-4d86a914c6de req-4e4ec00b-1d50-409a-b23f-b73b41d94ce7 service nova] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Received unexpected event network-vif-plugged-030e12c5-9662-4774-a9fc-5073144043f0 for instance with vm_state building and task_state spawning.
Dec 01 17:12:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:39 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:12:39 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:12:39 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:12:40 user nova-compute[75745]: DEBUG nova.compute.manager [req-cff45aac-6893-4337-834d-40f12615563e req-808d55ba-9b05-4a2d-b7ff-f58f9d2b9f5c service nova] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Received event network-vif-plugged-030e12c5-9662-4774-a9fc-5073144043f0 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:12:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-cff45aac-6893-4337-834d-40f12615563e req-808d55ba-9b05-4a2d-b7ff-f58f9d2b9f5c service nova] Acquiring lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:12:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-cff45aac-6893-4337-834d-40f12615563e req-808d55ba-9b05-4a2d-b7ff-f58f9d2b9f5c service nova] Lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:12:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-cff45aac-6893-4337-834d-40f12615563e req-808d55ba-9b05-4a2d-b7ff-f58f9d2b9f5c service nova] Lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:12:40 user nova-compute[75745]: DEBUG nova.compute.manager [req-cff45aac-6893-4337-834d-40f12615563e req-808d55ba-9b05-4a2d-b7ff-f58f9d2b9f5c service nova] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] No waiting events found dispatching network-vif-plugged-030e12c5-9662-4774-a9fc-5073144043f0 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:12:40 user nova-compute[75745]: WARNING nova.compute.manager [req-cff45aac-6893-4337-834d-40f12615563e req-808d55ba-9b05-4a2d-b7ff-f58f9d2b9f5c service nova] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Received unexpected event network-vif-plugged-030e12c5-9662-4774-a9fc-5073144043f0 for instance with vm_state building and task_state spawning.
Dec 01 17:12:40 user nova-compute[75745]: DEBUG nova.compute.manager [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:12:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:12:40 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Instance spawned successfully.
Dec 01 17:12:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:12:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:12:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:12:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:12:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:12:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:12:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:12:40 user nova-compute[75745]: INFO nova.compute.manager [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Took 6.00 seconds to spawn the instance on the hypervisor.
Dec 01 17:12:40 user nova-compute[75745]: DEBUG nova.compute.manager [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:12:40 user nova-compute[75745]: INFO nova.compute.manager [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Took 6.86 seconds to build instance.
Dec 01 17:12:40 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:12:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f8ae345a-f402-4f47-8cde-c6f6effd09fb tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.979s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:12:41 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:41 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:12:41 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:12:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:12:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:12:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:12:41 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:12:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdd70405-389f-4121-81e9-bfe317d33746/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdd70405-389f-4121-81e9-bfe317d33746/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdd70405-389f-4121-81e9-bfe317d33746/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdd70405-389f-4121-81e9-bfe317d33746/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-86e9738b-1834-4635-a863-e6a3706fb39a tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Acquiring lock "bdd70405-389f-4121-81e9-bfe317d33746" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:12:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-86e9738b-1834-4635-a863-e6a3706fb39a tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Lock "bdd70405-389f-4121-81e9-bfe317d33746" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:12:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-86e9738b-1834-4635-a863-e6a3706fb39a tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Acquiring lock "bdd70405-389f-4121-81e9-bfe317d33746-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:12:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-86e9738b-1834-4635-a863-e6a3706fb39a tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Lock "bdd70405-389f-4121-81e9-bfe317d33746-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:12:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-86e9738b-1834-4635-a863-e6a3706fb39a tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Lock "bdd70405-389f-4121-81e9-bfe317d33746-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:12:42 user nova-compute[75745]: INFO nova.compute.manager [None req-86e9738b-1834-4635-a863-e6a3706fb39a tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Terminating instance
Dec 01 17:12:42 user nova-compute[75745]: DEBUG nova.compute.manager [None req-86e9738b-1834-4635-a863-e6a3706fb39a tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:12:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:43 user nova-compute[75745]: DEBUG nova.compute.manager [req-0686fbfa-f946-4602-a893-057521a98896 req-28924ab1-0a34-4228-b2f0-63e2d6f45fdc service nova] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Received event network-vif-unplugged-f03d763d-cd15-4dd4-a82a-dcac1450fe0c {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:12:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0686fbfa-f946-4602-a893-057521a98896 req-28924ab1-0a34-4228-b2f0-63e2d6f45fdc service nova] Acquiring lock "bdd70405-389f-4121-81e9-bfe317d33746-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:12:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0686fbfa-f946-4602-a893-057521a98896 req-28924ab1-0a34-4228-b2f0-63e2d6f45fdc service nova] Lock "bdd70405-389f-4121-81e9-bfe317d33746-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:12:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0686fbfa-f946-4602-a893-057521a98896 req-28924ab1-0a34-4228-b2f0-63e2d6f45fdc service nova] Lock "bdd70405-389f-4121-81e9-bfe317d33746-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:12:43 user nova-compute[75745]: DEBUG nova.compute.manager [req-0686fbfa-f946-4602-a893-057521a98896 req-28924ab1-0a34-4228-b2f0-63e2d6f45fdc service nova] [instance: bdd70405-389f-4121-81e9-bfe317d33746] No waiting events found dispatching network-vif-unplugged-f03d763d-cd15-4dd4-a82a-dcac1450fe0c {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:12:43 user nova-compute[75745]: DEBUG nova.compute.manager [req-0686fbfa-f946-4602-a893-057521a98896 req-28924ab1-0a34-4228-b2f0-63e2d6f45fdc service nova] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Received event network-vif-unplugged-f03d763d-cd15-4dd4-a82a-dcac1450fe0c for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:12:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d50a2d4e-82c3-409d-bc50-12dc1269741b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:43 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:43 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d50a2d4e-82c3-409d-bc50-12dc1269741b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d50a2d4e-82c3-409d-bc50-12dc1269741b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:43 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Instance destroyed successfully.
Dec 01 17:12:43 user nova-compute[75745]: DEBUG nova.objects.instance [None req-86e9738b-1834-4635-a863-e6a3706fb39a tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Lazy-loading 'resources' on Instance uuid bdd70405-389f-4121-81e9-bfe317d33746 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:12:43 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-86e9738b-1834-4635-a863-e6a3706fb39a tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:10:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-487139023',display_name='tempest-VolumesNegativeTest-instance-487139023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-487139023',id=15,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:11:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1f46239d6c4340528ad2d3df2aba37b0',ramdisk_id='',reservation_id='r-ngvotni6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1147934414',owner_user_name='tempest-VolumesNegativeTest-1147934414-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:11:01Z,user_data=None,user_id='6189b38bdde14d68840d6c1e45cc7acb',uuid=bdd70405-389f-4121-81e9-bfe317d33746,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f03d763d-cd15-4dd4-a82a-dcac1450fe0c", "address": "fa:16:3e:1d:16:3d", "network": {"id": "ac8343e9-b21b-4666-b33b-1d7b20ca8514", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "061216e5b9b54621948598ae244101c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03d763d-cd", "ovs_interfaceid": "f03d763d-cd15-4dd4-a82a-dcac1450fe0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:12:43 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-86e9738b-1834-4635-a863-e6a3706fb39a tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Converting VIF {"id": "f03d763d-cd15-4dd4-a82a-dcac1450fe0c", "address": "fa:16:3e:1d:16:3d", "network": {"id": "ac8343e9-b21b-4666-b33b-1d7b20ca8514", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "061216e5b9b54621948598ae244101c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf03d763d-cd", "ovs_interfaceid": "f03d763d-cd15-4dd4-a82a-dcac1450fe0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:12:43 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-86e9738b-1834-4635-a863-e6a3706fb39a tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:16:3d,bridge_name='br-int',has_traffic_filtering=True,id=f03d763d-cd15-4dd4-a82a-dcac1450fe0c,network=Network(ac8343e9-b21b-4666-b33b-1d7b20ca8514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf03d763d-cd') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:12:43 user nova-compute[75745]: DEBUG os_vif [None req-86e9738b-1834-4635-a863-e6a3706fb39a tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:16:3d,bridge_name='br-int',has_traffic_filtering=True,id=f03d763d-cd15-4dd4-a82a-dcac1450fe0c,network=Network(ac8343e9-b21b-4666-b33b-1d7b20ca8514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf03d763d-cd') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:12:43 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:43 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf03d763d-cd, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:12:43 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:43 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:12:43 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:43 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:43 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d604cfec-cae8-4bb0-8a73-f08362e3fed3) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:12:43 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:43 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:12:43 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:43 user nova-compute[75745]: INFO os_vif [None req-86e9738b-1834-4635-a863-e6a3706fb39a tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:16:3d,bridge_name='br-int',has_traffic_filtering=True,id=f03d763d-cd15-4dd4-a82a-dcac1450fe0c,network=Network(ac8343e9-b21b-4666-b33b-1d7b20ca8514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf03d763d-cd')
Dec 01 17:12:43 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-86e9738b-1834-4635-a863-e6a3706fb39a tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Deleting instance files /opt/stack/data/nova/instances/bdd70405-389f-4121-81e9-bfe317d33746_del
Dec 01 17:12:43 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-86e9738b-1834-4635-a863-e6a3706fb39a tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Deletion of /opt/stack/data/nova/instances/bdd70405-389f-4121-81e9-bfe317d33746_del complete
Dec 01 17:12:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d50a2d4e-82c3-409d-bc50-12dc1269741b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06356800-2f67-4c35-9703-a71ca3271693/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:43 user nova-compute[75745]: INFO nova.compute.manager [None req-86e9738b-1834-4635-a863-e6a3706fb39a tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Took 1.08 seconds to destroy the instance on the hypervisor.
Dec 01 17:12:43 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-86e9738b-1834-4635-a863-e6a3706fb39a tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:12:43 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:12:43 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: bdd70405-389f-4121-81e9-bfe317d33746] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:12:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06356800-2f67-4c35-9703-a71ca3271693/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06356800-2f67-4c35-9703-a71ca3271693/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06356800-2f67-4c35-9703-a71ca3271693/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:44 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:12:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:44 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:12:44 user nova-compute[75745]: DEBUG nova.compute.manager [req-f7cc5b20-6351-451f-9f73-77ca13835969 req-099a7537-e839-4fea-868c-9c206d55cc22 service nova] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Received event network-vif-deleted-f03d763d-cd15-4dd4-a82a-dcac1450fe0c {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:12:44 user nova-compute[75745]: INFO nova.compute.manager [req-f7cc5b20-6351-451f-9f73-77ca13835969 req-099a7537-e839-4fea-868c-9c206d55cc22 service nova] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Neutron deleted interface f03d763d-cd15-4dd4-a82a-dcac1450fe0c; detaching it from the instance and deleting it from the info cache
Dec 01 17:12:44 user nova-compute[75745]: DEBUG nova.network.neutron [req-f7cc5b20-6351-451f-9f73-77ca13835969 req-099a7537-e839-4fea-868c-9c206d55cc22 service nova] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:12:44 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Took 0.53 seconds to deallocate network for instance.
Dec 01 17:12:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-86e9738b-1834-4635-a863-e6a3706fb39a tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:12:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-86e9738b-1834-4635-a863-e6a3706fb39a tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:12:44 user nova-compute[75745]: DEBUG nova.compute.manager [req-f7cc5b20-6351-451f-9f73-77ca13835969 req-099a7537-e839-4fea-868c-9c206d55cc22 service nova] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Detach interface failed, port_id=f03d763d-cd15-4dd4-a82a-dcac1450fe0c, reason: Instance bdd70405-389f-4121-81e9-bfe317d33746 could not be found. {{(pid=75745) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 17:12:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:44 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-86e9738b-1834-4635-a863-e6a3706fb39a tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:12:44 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-86e9738b-1834-4635-a863-e6a3706fb39a tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:12:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-86e9738b-1834-4635-a863-e6a3706fb39a tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.609s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:12:45 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-86e9738b-1834-4635-a863-e6a3706fb39a tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Deleted allocations for instance bdd70405-389f-4121-81e9-bfe317d33746
Dec 01 17:12:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c/disk --force-share --output=json" returned: 0 in 0.324s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:45 user nova-compute[75745]: DEBUG nova.compute.manager [req-c2780dca-09db-4bae-96c2-3e5c3b1f0f40 req-882d6b8b-a661-46b0-9914-65d1af95a6c9 service nova] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Received event network-vif-plugged-f03d763d-cd15-4dd4-a82a-dcac1450fe0c {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:12:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c2780dca-09db-4bae-96c2-3e5c3b1f0f40 req-882d6b8b-a661-46b0-9914-65d1af95a6c9 service nova] Acquiring lock "bdd70405-389f-4121-81e9-bfe317d33746-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:12:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c2780dca-09db-4bae-96c2-3e5c3b1f0f40 req-882d6b8b-a661-46b0-9914-65d1af95a6c9 service nova] Lock "bdd70405-389f-4121-81e9-bfe317d33746-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:12:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c2780dca-09db-4bae-96c2-3e5c3b1f0f40 req-882d6b8b-a661-46b0-9914-65d1af95a6c9 service nova] Lock "bdd70405-389f-4121-81e9-bfe317d33746-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:12:45 user nova-compute[75745]: DEBUG nova.compute.manager [req-c2780dca-09db-4bae-96c2-3e5c3b1f0f40 req-882d6b8b-a661-46b0-9914-65d1af95a6c9 service nova] [instance: bdd70405-389f-4121-81e9-bfe317d33746] No waiting events found dispatching network-vif-plugged-f03d763d-cd15-4dd4-a82a-dcac1450fe0c {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:12:45 user nova-compute[75745]: WARNING nova.compute.manager [req-c2780dca-09db-4bae-96c2-3e5c3b1f0f40 req-882d6b8b-a661-46b0-9914-65d1af95a6c9 service nova] [instance: bdd70405-389f-4121-81e9-bfe317d33746] Received unexpected event network-vif-plugged-f03d763d-cd15-4dd4-a82a-dcac1450fe0c for instance with vm_state deleted and task_state None.
Dec 01 17:12:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-86e9738b-1834-4635-a863-e6a3706fb39a tempest-VolumesNegativeTest-1147934414 tempest-VolumesNegativeTest-1147934414-project-member] Lock "bdd70405-389f-4121-81e9-bfe317d33746" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.458s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:12:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:46 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:12:46 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:12:46 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=7604MB free_disk=25.365100860595703GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:12:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:12:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:12:46 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 4ac6f586-cc5b-4a3f-b374-4b2006a48427 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:12:46 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 2abc6436-bf45-497a-acd2-47d43d5e158c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:12:46 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 71504d5d-0999-4960-8782-b454cb407e9f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:12:46 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 98b29ba5-9993-4494-b196-f7eea077df7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:12:46 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance d997cdd6-67c6-4263-814a-17cf9e27bbeb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:12:46 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance d50a2d4e-82c3-409d-bc50-12dc1269741b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:12:46 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 3a56aca8-ffbb-450b-a953-fc2071902486 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:12:46 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 06356800-2f67-4c35-9703-a71ca3271693 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:12:46 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 0ab0c115-74aa-4e55-92a3-6fa91ba753e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:12:46 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:12:46 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:12:47 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:12:47 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:12:47 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:12:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.563s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:12:48 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:12:48 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:12:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-2abc6436-bf45-497a-acd2-47d43d5e158c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:12:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-2abc6436-bf45-497a-acd2-47d43d5e158c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:12:48 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:12:48 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Updating instance_info_cache with network_info: [{"id": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "address": "fa:16:3e:66:74:ba", "network": {"id": "3d78774f-ff2b-4705-b359-7a1fb7fc272f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-234182378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1efefd35d14e03a3eebfff2ac0d335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5897fde5-fe", "ovs_interfaceid": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:12:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-2abc6436-bf45-497a-acd2-47d43d5e158c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:12:48 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:12:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:48 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:12:48 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:12:48 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:12:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-5948310d-bdb8-414b-8bb7-e376b2781ca7 req-c8f0ba6f-e6c2-4ced-b608-08481b1ae5e2 service nova] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Received event network-changed-9d64a643-0dca-4fe1-8734-9778689292bc {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:12:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-5948310d-bdb8-414b-8bb7-e376b2781ca7 req-c8f0ba6f-e6c2-4ced-b608-08481b1ae5e2 service nova] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Refreshing instance network info cache due to event network-changed-9d64a643-0dca-4fe1-8734-9778689292bc. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:12:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5948310d-bdb8-414b-8bb7-e376b2781ca7 req-c8f0ba6f-e6c2-4ced-b608-08481b1ae5e2 service nova] Acquiring lock "refresh_cache-d997cdd6-67c6-4263-814a-17cf9e27bbeb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:12:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5948310d-bdb8-414b-8bb7-e376b2781ca7 req-c8f0ba6f-e6c2-4ced-b608-08481b1ae5e2 service nova] Acquired lock "refresh_cache-d997cdd6-67c6-4263-814a-17cf9e27bbeb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:12:58 user nova-compute[75745]: DEBUG nova.network.neutron [req-5948310d-bdb8-414b-8bb7-e376b2781ca7 req-c8f0ba6f-e6c2-4ced-b608-08481b1ae5e2 service nova] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Refreshing network info cache for port 9d64a643-0dca-4fe1-8734-9778689292bc {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:12:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Acquiring lock "71504d5d-0999-4960-8782-b454cb407e9f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Lock "71504d5d-0999-4960-8782-b454cb407e9f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Acquiring lock "71504d5d-0999-4960-8782-b454cb407e9f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Lock "71504d5d-0999-4960-8782-b454cb407e9f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Lock "71504d5d-0999-4960-8782-b454cb407e9f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:12:59 user nova-compute[75745]: INFO nova.compute.manager [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Terminating instance
Dec 01 17:12:59 user nova-compute[75745]: DEBUG nova.compute.manager [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG nova.network.neutron [req-5948310d-bdb8-414b-8bb7-e376b2781ca7 req-c8f0ba6f-e6c2-4ced-b608-08481b1ae5e2 service nova] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Updated VIF entry in instance network info cache for port 9d64a643-0dca-4fe1-8734-9778689292bc. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG nova.network.neutron [req-5948310d-bdb8-414b-8bb7-e376b2781ca7 req-c8f0ba6f-e6c2-4ced-b608-08481b1ae5e2 service nova] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Updating instance_info_cache with network_info: [{"id": "9d64a643-0dca-4fe1-8734-9778689292bc", "address": "fa:16:3e:e2:0c:90", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d64a643-0d", "ovs_interfaceid": "9d64a643-0dca-4fe1-8734-9778689292bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5948310d-bdb8-414b-8bb7-e376b2781ca7 req-c8f0ba6f-e6c2-4ced-b608-08481b1ae5e2 service nova] Releasing lock "refresh_cache-d997cdd6-67c6-4263-814a-17cf9e27bbeb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG nova.compute.manager [req-2e31d722-56f2-44fa-be17-6c4906470188 req-46b7a14a-2099-4149-8f8b-60ce6c0363c6 service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Received event network-vif-unplugged-d3079bd2-25ea-432b-a601-9bb7502fe9c8 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2e31d722-56f2-44fa-be17-6c4906470188 req-46b7a14a-2099-4149-8f8b-60ce6c0363c6 service nova] Acquiring lock "71504d5d-0999-4960-8782-b454cb407e9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2e31d722-56f2-44fa-be17-6c4906470188 req-46b7a14a-2099-4149-8f8b-60ce6c0363c6 service nova] Lock "71504d5d-0999-4960-8782-b454cb407e9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2e31d722-56f2-44fa-be17-6c4906470188 req-46b7a14a-2099-4149-8f8b-60ce6c0363c6 service nova] Lock "71504d5d-0999-4960-8782-b454cb407e9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG nova.compute.manager [req-2e31d722-56f2-44fa-be17-6c4906470188 req-46b7a14a-2099-4149-8f8b-60ce6c0363c6 service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] No waiting events found dispatching network-vif-unplugged-d3079bd2-25ea-432b-a601-9bb7502fe9c8 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG nova.compute.manager [req-2e31d722-56f2-44fa-be17-6c4906470188 req-46b7a14a-2099-4149-8f8b-60ce6c0363c6 service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Received event network-vif-unplugged-d3079bd2-25ea-432b-a601-9bb7502fe9c8 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:59 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Instance destroyed successfully.
Dec 01 17:12:59 user nova-compute[75745]: DEBUG nova.objects.instance [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Lazy-loading 'resources' on Instance uuid 71504d5d-0999-4960-8782-b454cb407e9f {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T17:09:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1431601205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1079491771',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0vMcRe2hslMIizadcBGZgc30uKaeuXlHDf+WN8kFazoQVdMmpxW2R8vlqGKQfRbVS0qJwaTmeur8bI1mP+n7SfrtPRhzkJ9JoTM17YCGvpITsXmYzQv3QY/h+FSAFt5g==',key_name='tempest-keypair-785211803',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:11:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a2dd2fc4fef47d584dd73c8bf3e42ae',ramdisk_id='',reservation_id='r-3kwsa42n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-861427896',owner_user_name='tempest-ServerActionsV293TestJSON-861427896-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:11:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc2b48b84ebb46ae9b300423b9e225be',uuid=71504d5d-0999-4960-8782-b454cb407e9f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3079bd2-25ea-432b-a601-9bb7502fe9c8", "address": "fa:16:3e:3a:86:18", "network": {"id": "b05bdd5e-502b-4f25-bef1-0b17b23a0765", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1245857440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a2dd2fc4fef47d584dd73c8bf3e42ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3079bd2-25", "ovs_interfaceid": "d3079bd2-25ea-432b-a601-9bb7502fe9c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Converting VIF {"id": "d3079bd2-25ea-432b-a601-9bb7502fe9c8", "address": "fa:16:3e:3a:86:18", "network": {"id": "b05bdd5e-502b-4f25-bef1-0b17b23a0765", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1245857440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a2dd2fc4fef47d584dd73c8bf3e42ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3079bd2-25", "ovs_interfaceid": "d3079bd2-25ea-432b-a601-9bb7502fe9c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:86:18,bridge_name='br-int',has_traffic_filtering=True,id=d3079bd2-25ea-432b-a601-9bb7502fe9c8,network=Network(b05bdd5e-502b-4f25-bef1-0b17b23a0765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3079bd2-25') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG os_vif [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:86:18,bridge_name='br-int',has_traffic_filtering=True,id=d3079bd2-25ea-432b-a601-9bb7502fe9c8,network=Network(b05bdd5e-502b-4f25-bef1-0b17b23a0765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3079bd2-25') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3079bd2-25, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3e896be0-5e13-41a5-9a01-4a0e101891aa) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:12:59 user nova-compute[75745]: INFO os_vif [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:86:18,bridge_name='br-int',has_traffic_filtering=True,id=d3079bd2-25ea-432b-a601-9bb7502fe9c8,network=Network(b05bdd5e-502b-4f25-bef1-0b17b23a0765),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3079bd2-25')
Dec 01 17:12:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vitPIayJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:12:59 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:12:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f711807a-b8e1-4628-9f69-083620d7410a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:12:59 user nova-compute[75745]: No targets found.
Dec 01 17:12:59 user nova-compute[75745]: iSNS:
Dec 01 17:12:59 user nova-compute[75745]: No targets found.
Dec 01 17:12:59 user nova-compute[75745]: STATIC:
Dec 01 17:12:59 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98
Dec 01 17:12:59 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:12:59 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:12:59 user nova-compute[75745]: FIRMWARE:
Dec 01 17:12:59 user nova-compute[75745]: No targets found.
Dec 01 17:12:59 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:12:59 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:12:59 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8044c6-6b91-4516-93a6-b5dfe41fefee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e556e1a-6919-444d-b43c-b06858783ea2]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)
Dec 01 17:12:59 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 (non-flash)
Dec 01 17:12:59 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2498714040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98'): ({'sdb'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Removing single pathed devices sdb {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[345d5846-bb1f-4597-a12a-041ead92a40a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d57cad-9e2f-4fe0-9777-a5fd8b606575]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Flushing IO for device /dev/sdb {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03ee2f9-d804-4cb4-9334-5a77bb45f053]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:12:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1fabed-e18d-406f-a08a-0504b0cce9bb]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:00 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:13:00 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] SCSI volumes sdb have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:13:00 user nova-compute[75745]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_f8fd9e12', '/dev/disk/by-id/scsi-1SCST_BIOf8fd9e12-6dc2d5211c7039c9', '/dev/disk/by-id/scsi-23664633264353231') {{(pid=86714) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 01 17:13:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0729626-1d0e-4bce-be2e-4a8875b8999e]: (4, None) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:13:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c7dd28-8d31-4c7d-9296-de0172816195]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:13:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e181b2d8-2171-4a8e-a2ad-43d6d159f225]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98, portal: 172.16.0.220,3260]
Dec 01 17:13:00 user nova-compute[75745]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98, portal: 172.16.0.220,3260] successful.
Dec 01 17:13:00 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:13:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a3e21c-03d2-4df0-b96b-c78261e91b98 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2802b32e-525d-4267-834c-334aac8f70d1]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:13:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:13:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] <== disconnect_volume: return (271ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:13:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:13:00 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Deleting instance files /opt/stack/data/nova/instances/71504d5d-0999-4960-8782-b454cb407e9f_del
Dec 01 17:13:00 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Deletion of /opt/stack/data/nova/instances/71504d5d-0999-4960-8782-b454cb407e9f_del complete
Dec 01 17:13:00 user nova-compute[75745]: INFO nova.compute.manager [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Took 1.13 seconds to destroy the instance on the hypervisor.
Dec 01 17:13:00 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:13:00 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:13:00 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:13:00 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:13:00 user nova-compute[75745]: DEBUG nova.compute.manager [req-99875664-e509-47e5-997e-9e8bb0857548 req-9c619387-0114-4eff-8525-2d91a9782a7e service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Received event network-vif-deleted-d3079bd2-25ea-432b-a601-9bb7502fe9c8 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:13:00 user nova-compute[75745]: INFO nova.compute.manager [req-99875664-e509-47e5-997e-9e8bb0857548 req-9c619387-0114-4eff-8525-2d91a9782a7e service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Neutron deleted interface d3079bd2-25ea-432b-a601-9bb7502fe9c8; detaching it from the instance and deleting it from the info cache
Dec 01 17:13:00 user nova-compute[75745]: DEBUG nova.network.neutron [req-99875664-e509-47e5-997e-9e8bb0857548 req-9c619387-0114-4eff-8525-2d91a9782a7e service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:13:00 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Took 0.65 seconds to deallocate network for instance.
Dec 01 17:13:00 user nova-compute[75745]: DEBUG nova.compute.manager [req-99875664-e509-47e5-997e-9e8bb0857548 req-9c619387-0114-4eff-8525-2d91a9782a7e service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Detach interface failed, port_id=d3079bd2-25ea-432b-a601-9bb7502fe9c8, reason: Instance 71504d5d-0999-4960-8782-b454cb407e9f could not be found. {{(pid=75745) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 17:13:01 user nova-compute[75745]: DEBUG nova.compute.manager [req-e3c8224e-61b2-488c-931c-bbe979dbc851 req-0c012303-8289-4289-b062-f7b0c1db6bac service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Received event network-vif-plugged-d3079bd2-25ea-432b-a601-9bb7502fe9c8 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:13:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e3c8224e-61b2-488c-931c-bbe979dbc851 req-0c012303-8289-4289-b062-f7b0c1db6bac service nova] Acquiring lock "71504d5d-0999-4960-8782-b454cb407e9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:13:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e3c8224e-61b2-488c-931c-bbe979dbc851 req-0c012303-8289-4289-b062-f7b0c1db6bac service nova] Lock "71504d5d-0999-4960-8782-b454cb407e9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:13:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e3c8224e-61b2-488c-931c-bbe979dbc851 req-0c012303-8289-4289-b062-f7b0c1db6bac service nova] Lock "71504d5d-0999-4960-8782-b454cb407e9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:13:01 user nova-compute[75745]: DEBUG nova.compute.manager [req-e3c8224e-61b2-488c-931c-bbe979dbc851 req-0c012303-8289-4289-b062-f7b0c1db6bac service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] No waiting events found dispatching network-vif-plugged-d3079bd2-25ea-432b-a601-9bb7502fe9c8 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:13:01 user nova-compute[75745]: WARNING nova.compute.manager [req-e3c8224e-61b2-488c-931c-bbe979dbc851 req-0c012303-8289-4289-b062-f7b0c1db6bac service nova] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Received unexpected event network-vif-plugged-d3079bd2-25ea-432b-a601-9bb7502fe9c8 for instance with vm_state active and task_state deleting.
Dec 01 17:13:01 user nova-compute[75745]: INFO nova.compute.manager [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Took 0.85 seconds to detach 1 volumes for instance.
Dec 01 17:13:01 user nova-compute[75745]: DEBUG nova.compute.manager [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] [instance: 71504d5d-0999-4960-8782-b454cb407e9f] Deleting volume: 47a3e21c-03d2-4df0-b96b-c78261e91b98 {{(pid=75745) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 01 17:13:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fb41e8ce-d162-4a4a-bf8a-3def920f6539 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Acquiring lock "d50a2d4e-82c3-409d-bc50-12dc1269741b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:13:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fb41e8ce-d162-4a4a-bf8a-3def920f6539 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Lock "d50a2d4e-82c3-409d-bc50-12dc1269741b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:13:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fb41e8ce-d162-4a4a-bf8a-3def920f6539 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Acquiring lock "d50a2d4e-82c3-409d-bc50-12dc1269741b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:13:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fb41e8ce-d162-4a4a-bf8a-3def920f6539 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Lock "d50a2d4e-82c3-409d-bc50-12dc1269741b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:13:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fb41e8ce-d162-4a4a-bf8a-3def920f6539 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Lock "d50a2d4e-82c3-409d-bc50-12dc1269741b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:13:01 user nova-compute[75745]: INFO nova.compute.manager [None req-fb41e8ce-d162-4a4a-bf8a-3def920f6539 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Terminating instance
Dec 01 17:13:01 user nova-compute[75745]: DEBUG nova.compute.manager [None req-fb41e8ce-d162-4a4a-bf8a-3def920f6539 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:13:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:13:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:13:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:02 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:13:02 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:13:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:13:02 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Deleted allocations for instance 71504d5d-0999-4960-8782-b454cb407e9f
Dec 01 17:13:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ab4cdbfb-2796-491c-8570-d2681517428d tempest-ServerActionsV293TestJSON-861427896 tempest-ServerActionsV293TestJSON-861427896-project-member] Lock "71504d5d-0999-4960-8782-b454cb407e9f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.316s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:13:02 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Instance destroyed successfully.
Dec 01 17:13:02 user nova-compute[75745]: DEBUG nova.objects.instance [None req-fb41e8ce-d162-4a4a-bf8a-3def920f6539 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Lazy-loading 'resources' on Instance uuid d50a2d4e-82c3-409d-bc50-12dc1269741b {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:13:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-fb41e8ce-d162-4a4a-bf8a-3def920f6539 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:11:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1632065389',display_name='tempest-VolumesActionsTest-instance-1632065389',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1632065389',id=17,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:11:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b88dee991f154d659d74d3dd5be6a231',ramdisk_id='',reservation_id='r-3qndl261',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1774873278',owner_user_name='tempest-VolumesActionsTest-1774873278-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:11:19Z,user_data=None,user_id='52fef9da772c4f8ba9f4be1b168ad305',uuid=d50a2d4e-82c3-409d-bc50-12dc1269741b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aacdd979-ea65-4c83-93da-e3127ee4ba2d", "address": "fa:16:3e:a9:2b:d1", "network": {"id": "3bcde777-87d9-442e-a2ff-85106f3b0299", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1741466836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b88dee991f154d659d74d3dd5be6a231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaacdd979-ea", "ovs_interfaceid": "aacdd979-ea65-4c83-93da-e3127ee4ba2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:13:02 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-fb41e8ce-d162-4a4a-bf8a-3def920f6539 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Converting VIF {"id": "aacdd979-ea65-4c83-93da-e3127ee4ba2d", "address": "fa:16:3e:a9:2b:d1", "network": {"id": "3bcde777-87d9-442e-a2ff-85106f3b0299", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1741466836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b88dee991f154d659d74d3dd5be6a231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaacdd979-ea", "ovs_interfaceid": "aacdd979-ea65-4c83-93da-e3127ee4ba2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:13:02 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-fb41e8ce-d162-4a4a-bf8a-3def920f6539 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:2b:d1,bridge_name='br-int',has_traffic_filtering=True,id=aacdd979-ea65-4c83-93da-e3127ee4ba2d,network=Network(3bcde777-87d9-442e-a2ff-85106f3b0299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaacdd979-ea') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:13:02 user nova-compute[75745]: DEBUG os_vif [None req-fb41e8ce-d162-4a4a-bf8a-3def920f6539 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:2b:d1,bridge_name='br-int',has_traffic_filtering=True,id=aacdd979-ea65-4c83-93da-e3127ee4ba2d,network=Network(3bcde777-87d9-442e-a2ff-85106f3b0299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaacdd979-ea') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:13:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaacdd979-ea, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:13:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:13:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6191d066-9f1c-48cb-a595-e4e9cffa7e41) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:13:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:13:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:02 user nova-compute[75745]: INFO os_vif [None req-fb41e8ce-d162-4a4a-bf8a-3def920f6539 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:2b:d1,bridge_name='br-int',has_traffic_filtering=True,id=aacdd979-ea65-4c83-93da-e3127ee4ba2d,network=Network(3bcde777-87d9-442e-a2ff-85106f3b0299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaacdd979-ea')
Dec 01 17:13:02 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-fb41e8ce-d162-4a4a-bf8a-3def920f6539 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Deleting instance files /opt/stack/data/nova/instances/d50a2d4e-82c3-409d-bc50-12dc1269741b_del
Dec 01 17:13:02 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-fb41e8ce-d162-4a4a-bf8a-3def920f6539 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Deletion of /opt/stack/data/nova/instances/d50a2d4e-82c3-409d-bc50-12dc1269741b_del complete
Dec 01 17:13:02 user nova-compute[75745]: INFO nova.compute.manager [None req-fb41e8ce-d162-4a4a-bf8a-3def920f6539 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Took 0.70 seconds to destroy the instance on the hypervisor.
Dec 01 17:13:02 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-fb41e8ce-d162-4a4a-bf8a-3def920f6539 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:13:02 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:13:02 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:13:02 user nova-compute[75745]: DEBUG nova.compute.manager [req-01f04f40-a3cf-428d-b527-462cd0a03a40 req-d6e068b6-3e9b-485a-a90d-057febfa8773 service nova] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Received event network-vif-unplugged-aacdd979-ea65-4c83-93da-e3127ee4ba2d {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:13:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-01f04f40-a3cf-428d-b527-462cd0a03a40 req-d6e068b6-3e9b-485a-a90d-057febfa8773 service nova] Acquiring lock "d50a2d4e-82c3-409d-bc50-12dc1269741b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:13:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-01f04f40-a3cf-428d-b527-462cd0a03a40 req-d6e068b6-3e9b-485a-a90d-057febfa8773 service nova] Lock "d50a2d4e-82c3-409d-bc50-12dc1269741b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:13:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-01f04f40-a3cf-428d-b527-462cd0a03a40 req-d6e068b6-3e9b-485a-a90d-057febfa8773 service nova] Lock "d50a2d4e-82c3-409d-bc50-12dc1269741b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:13:02 user nova-compute[75745]: DEBUG nova.compute.manager [req-01f04f40-a3cf-428d-b527-462cd0a03a40 req-d6e068b6-3e9b-485a-a90d-057febfa8773 service nova] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] No waiting events found dispatching network-vif-unplugged-aacdd979-ea65-4c83-93da-e3127ee4ba2d {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:13:02 user nova-compute[75745]: DEBUG nova.compute.manager [req-01f04f40-a3cf-428d-b527-462cd0a03a40 req-d6e068b6-3e9b-485a-a90d-057febfa8773 service nova] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Received event network-vif-unplugged-aacdd979-ea65-4c83-93da-e3127ee4ba2d for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:13:02 user nova-compute[75745]: DEBUG nova.compute.manager [req-01f04f40-a3cf-428d-b527-462cd0a03a40 req-d6e068b6-3e9b-485a-a90d-057febfa8773 service nova] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Received event network-vif-plugged-aacdd979-ea65-4c83-93da-e3127ee4ba2d {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:13:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-01f04f40-a3cf-428d-b527-462cd0a03a40 req-d6e068b6-3e9b-485a-a90d-057febfa8773 service nova] Acquiring lock "d50a2d4e-82c3-409d-bc50-12dc1269741b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:13:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-01f04f40-a3cf-428d-b527-462cd0a03a40 req-d6e068b6-3e9b-485a-a90d-057febfa8773 service nova] Lock "d50a2d4e-82c3-409d-bc50-12dc1269741b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:13:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-01f04f40-a3cf-428d-b527-462cd0a03a40 req-d6e068b6-3e9b-485a-a90d-057febfa8773 service nova] Lock "d50a2d4e-82c3-409d-bc50-12dc1269741b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:13:02 user nova-compute[75745]: DEBUG nova.compute.manager [req-01f04f40-a3cf-428d-b527-462cd0a03a40 req-d6e068b6-3e9b-485a-a90d-057febfa8773 service nova] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] No waiting events found dispatching network-vif-plugged-aacdd979-ea65-4c83-93da-e3127ee4ba2d {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:13:02 user nova-compute[75745]: WARNING nova.compute.manager [req-01f04f40-a3cf-428d-b527-462cd0a03a40 req-d6e068b6-3e9b-485a-a90d-057febfa8773 service nova] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Received unexpected event network-vif-plugged-aacdd979-ea65-4c83-93da-e3127ee4ba2d for instance with vm_state active and task_state deleting.
Dec 01 17:13:02 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:13:03 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Took 0.50 seconds to deallocate network for instance.
Dec 01 17:13:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fb41e8ce-d162-4a4a-bf8a-3def920f6539 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:13:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fb41e8ce-d162-4a4a-bf8a-3def920f6539 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:13:03 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-fb41e8ce-d162-4a4a-bf8a-3def920f6539 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:13:03 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-fb41e8ce-d162-4a4a-bf8a-3def920f6539 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:13:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fb41e8ce-d162-4a4a-bf8a-3def920f6539 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.257s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:13:03 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-fb41e8ce-d162-4a4a-bf8a-3def920f6539 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Deleted allocations for instance d50a2d4e-82c3-409d-bc50-12dc1269741b
Dec 01 17:13:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fb41e8ce-d162-4a4a-bf8a-3def920f6539 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Lock "d50a2d4e-82c3-409d-bc50-12dc1269741b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.626s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:13:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:04 user nova-compute[75745]: DEBUG nova.compute.manager [req-1c9acdf0-e2ff-4dfd-8ad6-033e01c32ad5 req-6cd7e072-37fc-454f-ba72-5f3805e4e51a service nova] [instance: d50a2d4e-82c3-409d-bc50-12dc1269741b] Received event network-vif-deleted-aacdd979-ea65-4c83-93da-e3127ee4ba2d {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:13:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8eac3b33-1e6b-4726-93a7-e94f8985ba99 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Acquiring lock "2abc6436-bf45-497a-acd2-47d43d5e158c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:13:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8eac3b33-1e6b-4726-93a7-e94f8985ba99 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:13:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8eac3b33-1e6b-4726-93a7-e94f8985ba99 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Acquiring lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:13:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8eac3b33-1e6b-4726-93a7-e94f8985ba99 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:13:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8eac3b33-1e6b-4726-93a7-e94f8985ba99 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:13:06 user nova-compute[75745]: INFO nova.compute.manager [None req-8eac3b33-1e6b-4726-93a7-e94f8985ba99 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Terminating instance
Dec 01 17:13:06 user nova-compute[75745]: DEBUG nova.compute.manager [None req-8eac3b33-1e6b-4726-93a7-e94f8985ba99 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:13:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:06 user nova-compute[75745]: DEBUG nova.compute.manager [req-d9e37a34-1fa7-4cbc-b178-d71a6f487870 req-5ccecd9d-e3f8-4f2f-bd13-01e9b4c8944e service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Received event network-vif-unplugged-5897fde5-fea9-4ff3-98b8-db1020cf5127 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:13:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d9e37a34-1fa7-4cbc-b178-d71a6f487870 req-5ccecd9d-e3f8-4f2f-bd13-01e9b4c8944e service nova] Acquiring lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:13:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d9e37a34-1fa7-4cbc-b178-d71a6f487870 req-5ccecd9d-e3f8-4f2f-bd13-01e9b4c8944e service nova] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:13:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d9e37a34-1fa7-4cbc-b178-d71a6f487870 req-5ccecd9d-e3f8-4f2f-bd13-01e9b4c8944e service nova] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:13:06 user nova-compute[75745]: DEBUG nova.compute.manager [req-d9e37a34-1fa7-4cbc-b178-d71a6f487870 req-5ccecd9d-e3f8-4f2f-bd13-01e9b4c8944e service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] No waiting events found dispatching network-vif-unplugged-5897fde5-fea9-4ff3-98b8-db1020cf5127 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:13:06 user nova-compute[75745]: DEBUG nova.compute.manager [req-d9e37a34-1fa7-4cbc-b178-d71a6f487870 req-5ccecd9d-e3f8-4f2f-bd13-01e9b4c8944e service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Received event network-vif-unplugged-5897fde5-fea9-4ff3-98b8-db1020cf5127 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:13:07 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Instance destroyed successfully.
Dec 01 17:13:07 user nova-compute[75745]: DEBUG nova.objects.instance [None req-8eac3b33-1e6b-4726-93a7-e94f8985ba99 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lazy-loading 'resources' on Instance uuid 2abc6436-bf45-497a-acd2-47d43d5e158c {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:13:07 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-8eac3b33-1e6b-4726-93a7-e94f8985ba99 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:05:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1767622081',display_name='tempest-ServerStableDeviceRescueTest-server-1767622081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1767622081',id=4,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDp6Xk0Jeq39zNj7o2b3I/4McvYNabWuSHGIAAfwXUIskcvOUTL7Ihwn85mCvmRB2rKQsuxT0meUWSqSSoPSMQuH6KX6uS91/fBFZ5QCBCit5t+fzh+i6OT0756vLnrQNQ==',key_name='tempest-keypair-274950354',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:10:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c1efefd35d14e03a3eebfff2ac0d335',ramdisk_id='',reservation_id='r-s1zydaxk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1685174732',owner_user_name='tempest-ServerStableDeviceRescueTest-1685174732-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:11:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='683fd305fb0b4c978a762e79e901fa36',uuid=2abc6436-bf45-497a-acd2-47d43d5e158c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "address": "fa:16:3e:66:74:ba", "network": {"id": "3d78774f-ff2b-4705-b359-7a1fb7fc272f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-234182378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1efefd35d14e03a3eebfff2ac0d335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5897fde5-fe", "ovs_interfaceid": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:13:07 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-8eac3b33-1e6b-4726-93a7-e94f8985ba99 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Converting VIF {"id": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "address": "fa:16:3e:66:74:ba", "network": {"id": "3d78774f-ff2b-4705-b359-7a1fb7fc272f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-234182378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1efefd35d14e03a3eebfff2ac0d335", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5897fde5-fe", "ovs_interfaceid": "5897fde5-fea9-4ff3-98b8-db1020cf5127", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:13:07 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-8eac3b33-1e6b-4726-93a7-e94f8985ba99 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:74:ba,bridge_name='br-int',has_traffic_filtering=True,id=5897fde5-fea9-4ff3-98b8-db1020cf5127,network=Network(3d78774f-ff2b-4705-b359-7a1fb7fc272f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5897fde5-fe') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:13:07 user nova-compute[75745]: DEBUG os_vif [None req-8eac3b33-1e6b-4726-93a7-e94f8985ba99 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:74:ba,bridge_name='br-int',has_traffic_filtering=True,id=5897fde5-fea9-4ff3-98b8-db1020cf5127,network=Network(3d78774f-ff2b-4705-b359-7a1fb7fc272f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5897fde5-fe') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:13:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5897fde5-fe, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:13:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:13:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e027bfb7-3228-47b6-8acd-e13dc4371e6f) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:13:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:13:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:07 user nova-compute[75745]: INFO os_vif [None req-8eac3b33-1e6b-4726-93a7-e94f8985ba99 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:74:ba,bridge_name='br-int',has_traffic_filtering=True,id=5897fde5-fea9-4ff3-98b8-db1020cf5127,network=Network(3d78774f-ff2b-4705-b359-7a1fb7fc272f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5897fde5-fe')
Dec 01 17:13:07 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-8eac3b33-1e6b-4726-93a7-e94f8985ba99 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Deleting instance files /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c_del
Dec 01 17:13:07 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-8eac3b33-1e6b-4726-93a7-e94f8985ba99 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Deletion of /opt/stack/data/nova/instances/2abc6436-bf45-497a-acd2-47d43d5e158c_del complete
Dec 01 17:13:07 user nova-compute[75745]: INFO nova.compute.manager [None req-8eac3b33-1e6b-4726-93a7-e94f8985ba99 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Took 0.87 seconds to destroy the instance on the hypervisor.
Dec 01 17:13:07 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-8eac3b33-1e6b-4726-93a7-e94f8985ba99 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:13:07 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:13:07 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:13:07 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:13:07 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Took 0.67 seconds to deallocate network for instance.
Dec 01 17:13:07 user nova-compute[75745]: DEBUG nova.compute.manager [req-1407ef5c-d15f-4a84-a02b-95880a27f03b req-288948f2-cf72-405b-89af-debd52c6adb6 service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Received event network-vif-deleted-5897fde5-fea9-4ff3-98b8-db1020cf5127 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:13:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8eac3b33-1e6b-4726-93a7-e94f8985ba99 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:13:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8eac3b33-1e6b-4726-93a7-e94f8985ba99 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:13:08 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-8eac3b33-1e6b-4726-93a7-e94f8985ba99 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:13:08 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-8eac3b33-1e6b-4726-93a7-e94f8985ba99 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:13:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8eac3b33-1e6b-4726-93a7-e94f8985ba99 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.244s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:13:08 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-8eac3b33-1e6b-4726-93a7-e94f8985ba99 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Deleted allocations for instance 2abc6436-bf45-497a-acd2-47d43d5e158c
Dec 01 17:13:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8eac3b33-1e6b-4726-93a7-e94f8985ba99 tempest-ServerStableDeviceRescueTest-1685174732 tempest-ServerStableDeviceRescueTest-1685174732-project-member] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.960s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:13:08 user nova-compute[75745]: DEBUG nova.compute.manager [req-b49e9bfc-54c4-4f48-8270-82aa41cc2517 req-0eb984b6-05a3-4e95-8009-04e5e3102fbb service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Received event network-vif-plugged-5897fde5-fea9-4ff3-98b8-db1020cf5127 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:13:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b49e9bfc-54c4-4f48-8270-82aa41cc2517 req-0eb984b6-05a3-4e95-8009-04e5e3102fbb service nova] Acquiring lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:13:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b49e9bfc-54c4-4f48-8270-82aa41cc2517 req-0eb984b6-05a3-4e95-8009-04e5e3102fbb service nova] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:13:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b49e9bfc-54c4-4f48-8270-82aa41cc2517 req-0eb984b6-05a3-4e95-8009-04e5e3102fbb service nova] Lock "2abc6436-bf45-497a-acd2-47d43d5e158c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:13:08 user nova-compute[75745]: DEBUG nova.compute.manager [req-b49e9bfc-54c4-4f48-8270-82aa41cc2517 req-0eb984b6-05a3-4e95-8009-04e5e3102fbb service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] No waiting events found dispatching network-vif-plugged-5897fde5-fea9-4ff3-98b8-db1020cf5127 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:13:08 user nova-compute[75745]: WARNING nova.compute.manager [req-b49e9bfc-54c4-4f48-8270-82aa41cc2517 req-0eb984b6-05a3-4e95-8009-04e5e3102fbb service nova] [instance: 2abc6436-bf45-497a-acd2-47d43d5e158c] Received unexpected event network-vif-plugged-5897fde5-fea9-4ff3-98b8-db1020cf5127 for instance with vm_state deleted and task_state None.
Dec 01 17:13:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:13 user nova-compute[75745]: DEBUG nova.compute.manager [req-2fa2b30a-2888-420c-a0b0-4e1b7d5be544 req-b26b65ea-e000-4927-8f9b-58d8c95435aa service nova] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Received event network-changed-0bfa2344-df4f-4c3a-9b5d-97b85e4b2515 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:13:13 user nova-compute[75745]: DEBUG nova.compute.manager [req-2fa2b30a-2888-420c-a0b0-4e1b7d5be544 req-b26b65ea-e000-4927-8f9b-58d8c95435aa service nova] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Refreshing instance network info cache due to event network-changed-0bfa2344-df4f-4c3a-9b5d-97b85e4b2515. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:13:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2fa2b30a-2888-420c-a0b0-4e1b7d5be544 req-b26b65ea-e000-4927-8f9b-58d8c95435aa service nova] Acquiring lock "refresh_cache-3a56aca8-ffbb-450b-a953-fc2071902486" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:13:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2fa2b30a-2888-420c-a0b0-4e1b7d5be544 req-b26b65ea-e000-4927-8f9b-58d8c95435aa service nova] Acquired lock "refresh_cache-3a56aca8-ffbb-450b-a953-fc2071902486" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:13:13 user nova-compute[75745]: DEBUG nova.network.neutron [req-2fa2b30a-2888-420c-a0b0-4e1b7d5be544 req-b26b65ea-e000-4927-8f9b-58d8c95435aa service nova] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Refreshing network info cache for port 0bfa2344-df4f-4c3a-9b5d-97b85e4b2515 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:13:13 user nova-compute[75745]: DEBUG nova.network.neutron [req-2fa2b30a-2888-420c-a0b0-4e1b7d5be544 req-b26b65ea-e000-4927-8f9b-58d8c95435aa service nova] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Updated VIF entry in instance network info cache for port 0bfa2344-df4f-4c3a-9b5d-97b85e4b2515. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:13:13 user nova-compute[75745]: DEBUG nova.network.neutron [req-2fa2b30a-2888-420c-a0b0-4e1b7d5be544 req-b26b65ea-e000-4927-8f9b-58d8c95435aa service nova] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Updating instance_info_cache with network_info: [{"id": "0bfa2344-df4f-4c3a-9b5d-97b85e4b2515", "address": "fa:16:3e:3a:4a:12", "network": {"id": "b40e2616-f366-491f-a652-c99fc1c6b989", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-538343107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0919015c0904a8481a5297b6aa9af40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfa2344-df", "ovs_interfaceid": "0bfa2344-df4f-4c3a-9b5d-97b85e4b2515", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:13:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2fa2b30a-2888-420c-a0b0-4e1b7d5be544 req-b26b65ea-e000-4927-8f9b-58d8c95435aa service nova] Releasing lock "refresh_cache-3a56aca8-ffbb-450b-a953-fc2071902486" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:13:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Acquiring lock "3a56aca8-ffbb-450b-a953-fc2071902486" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:13:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "3a56aca8-ffbb-450b-a953-fc2071902486" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:13:15 user nova-compute[75745]: DEBUG nova.objects.instance [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lazy-loading 'flavor' on Instance uuid 3a56aca8-ffbb-450b-a953-fc2071902486 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:13:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "3a56aca8-ffbb-450b-a953-fc2071902486" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:13:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Acquiring lock "3a56aca8-ffbb-450b-a953-fc2071902486" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:13:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "3a56aca8-ffbb-450b-a953-fc2071902486" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:13:15 user nova-compute[75745]: INFO nova.compute.manager [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Attaching volume d36758f0-6731-4c65-8dd6-21c4e666ca01 to /dev/vdb
Dec 01 17:13:16 user nova-compute[75745]: DEBUG os_brick.utils [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:13:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:16 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[75695840-cfe2-414d-aebf-dbcf7e6aaa9a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:16 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6242190e-6dd4-4c04-8f8e-0cdf0a48af0d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:16 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cce12f6-e032-4ab9-8729-34e9a4dd0e40]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:16 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6219c90-7242-4bce-ad11-815a74a177a3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:13:16 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:13:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:13:16 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:13:16 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6de305-de95-4978-91c6-c0efe72fa737]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:16 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:13:16 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:13:16 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:13:16 user nova-compute[75745]: DEBUG os_brick.utils [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:13:16 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Updating existing volume attachment record: d54283ab-fa06-4b4c-8e19-83d4bd50b039 {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:13:17 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Acquiring lock "98b29ba5-9993-4494-b196-f7eea077df7a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:13:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "98b29ba5-9993-4494-b196-f7eea077df7a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:13:19 user nova-compute[75745]: DEBUG nova.objects.instance [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lazy-loading 'flavor' on Instance uuid 98b29ba5-9993-4494-b196-f7eea077df7a {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:13:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "98b29ba5-9993-4494-b196-f7eea077df7a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:13:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Acquiring lock "98b29ba5-9993-4494-b196-f7eea077df7a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:13:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "98b29ba5-9993-4494-b196-f7eea077df7a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:13:19 user nova-compute[75745]: INFO nova.compute.manager [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Attaching volume 2e941299-9596-4969-a82d-e543f40668c0 to /dev/vdb
Dec 01 17:13:19 user nova-compute[75745]: DEBUG os_brick.utils [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:13:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:19 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e7ee04-6054-4b2c-9903-19cefb07620e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:19 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[624d4e7c-b55c-41e4-9e62-0198aa894feb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:19 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e435272-35ab-4085-adac-fb06dad4e214]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:19 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ca3ac5-71d0-4ad3-b2fe-3b9822452587]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:13:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:13:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:13:19 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:13:19 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[976ff5ac-fefc-4fa6-b5b8-167655300378]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:13:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:13:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:13:19 user nova-compute[75745]: DEBUG os_brick.utils [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:13:19 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Updating existing volume attachment record: 19ba45f3-cee8-4686-b1eb-16f11a83eb96 {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:13:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sGJCnrUQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:13:25 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:13:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:13:25 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:13:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:13:25 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:13:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2215d7-049e-4294-892a-f3e1532dbe21]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:13:25 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a139a75-64b1-4f3b-9292-f521391ef0c8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01] added
Dec 01 17:13:25 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f91db01-0df3-445a-b58e-af36d0c5a96e]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5b2ca3-86f4-4fad-b669-935b4f8be412]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sGJCnrUQ {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sGJCnrUQ" returned: 0 in 0.069s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[71590647-fcbd-410b-8d13-5bb9bfe9f431]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sGJCnrUQ'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04aac6e-cc7f-4a19-82dc-7f66df9b821d]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8510cfe1-c4af-44be-b60d-676d3e9f0aab]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 01 17:13:25 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 01 17:13:25 user nova-compute[75745]:  {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:13:25 user nova-compute[75745]: WARNING os_brick.initiator.connectors.iscsi [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 01 17:13:25 user nova-compute[75745]: 
Dec 01 17:13:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[75231990-aaa9-4aca-a65b-4b2d1dbaf207]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01, portal: 172.16.0.220,3260]
Dec 01 17:13:25 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01, portal: 172.16.0.220,3260] successful.
Dec 01 17:13:25 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9aff759-4ee9-4146-b323-9ce4fb1089fc]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4911ddc1-0828-41b6-89ef-c8237f2289b3]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 (non-flash)
Dec 01 17:13:25 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 (non-flash)
Dec 01 17:13:25 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1b62c3-d320-4444-a7f0-76844a8fea90]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:25 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: None {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:13:26 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:13:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sGJCnrUQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:13:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:13:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23264326663393564', 'path': '/dev/sdb'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:13:26 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264326663393564', 'path': '/dev/sdb'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:13:26 user nova-compute[75745]: DEBUG nova.objects.instance [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lazy-loading 'flavor' on Instance uuid 3a56aca8-ffbb-450b-a953-fc2071902486 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:13:26 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 17:13:26 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:13:26 user nova-compute[75745]:   <source dev="/dev/sdb"/>
Dec 01 17:13:26 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:13:26 user nova-compute[75745]:   <serial>d36758f0-6731-4c65-8dd6-21c4e666ca01</serial>
Dec 01 17:13:26 user nova-compute[75745]: </disk>
Dec 01 17:13:26 user nova-compute[75745]:  {{(pid=75745) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 17:13:26 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:13:26 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:13:26 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] No VIF found with MAC fa:16:3e:3a:4a:12, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:13:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4b6dad7a-1b5d-4b28-8695-c03790cfce7b tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "3a56aca8-ffbb-450b-a953-fc2071902486" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.994s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:13:27 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxLBeEqG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:13:28 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:13:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:13:28 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:13:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:13:28 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:13:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[69723839-6f40-4992-a616-43bdada4d827]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:13:28 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a6b4fb-8fd5-4421-9613-c09f7fcedb90]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0] added
Dec 01 17:13:28 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ae0d45-a2af-44ed-b29b-ad2cb5ebe8a6]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a082a01-de4f-4e69-a017-719282ebc45c]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YxLBeEqG {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YxLBeEqG" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebe9b0e-99a7-410e-aea0-6995fdf4e46d]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YxLBeEqG'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b29f69-4b7c-47a2-bee1-95ba1462a7b7]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c5283b-faee-417c-99fc-e53a9d261e23]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 (non-flash)
Dec 01 17:13:28 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 (non-flash)
Dec 01 17:13:28 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1699cdc8-b385-4695-8ddd-3385938a5b41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0, portal: 172.16.0.220,3260]
Dec 01 17:13:28 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0, portal: 172.16.0.220,3260] successful.
Dec 01 17:13:28 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c46405-3a32-4dde-9af6-063d936c50ad]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01810bc-71cb-4232-a7e3-707ca365358a]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 (non-flash)
Dec 01 17:13:28 user nova-compute[75745]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:13:28 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 (non-flash)
Dec 01 17:13:28 user nova-compute[75745]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:13:28 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[343ea70a-e522-444b-9c39-0a1151c83286]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: None {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Acquiring lock "3a56aca8-ffbb-450b-a953-fc2071902486" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "3a56aca8-ffbb-450b-a953-fc2071902486" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:13:28 user nova-compute[75745]: INFO nova.compute.manager [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Detaching volume d36758f0-6731-4c65-8dd6-21c4e666ca01
Dec 01 17:13:28 user nova-compute[75745]: INFO nova.virt.block_device [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Attempting to driver detach volume d36758f0-6731-4c65-8dd6-21c4e666ca01 from mountpoint /dev/vdb
Dec 01 17:13:28 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Attempting to detach device vdb from instance 3a56aca8-ffbb-450b-a953-fc2071902486 from the persistent domain config. {{(pid=75745) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:13:28 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:13:28 user nova-compute[75745]:   <source dev="/dev/sdb"/>
Dec 01 17:13:28 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:13:28 user nova-compute[75745]:   <serial>d36758f0-6731-4c65-8dd6-21c4e666ca01</serial>
Dec 01 17:13:28 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 17:13:28 user nova-compute[75745]: </disk>
Dec 01 17:13:28 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:13:28 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Successfully detached device vdb from instance 3a56aca8-ffbb-450b-a953-fc2071902486 from the persistent domain config.
Dec 01 17:13:28 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3a56aca8-ffbb-450b-a953-fc2071902486 from the live domain config. {{(pid=75745) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:13:28 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:13:28 user nova-compute[75745]:   <source dev="/dev/sdb"/>
Dec 01 17:13:28 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:13:28 user nova-compute[75745]:   <serial>d36758f0-6731-4c65-8dd6-21c4e666ca01</serial>
Dec 01 17:13:28 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 17:13:28 user nova-compute[75745]: </disk>
Dec 01 17:13:28 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:13:28 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3a56aca8-ffbb-450b-a953-fc2071902486 {{(pid=75745) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 17:13:29 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:13:29 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxLBeEqG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:13:29 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:13:29 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23039393336386336', 'path': '/dev/sdc'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:13:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039393336386336', 'path': '/dev/sdc'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:13:29 user nova-compute[75745]: DEBUG nova.objects.instance [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lazy-loading 'flavor' on Instance uuid 98b29ba5-9993-4494-b196-f7eea077df7a {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:13:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 17:13:29 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:13:29 user nova-compute[75745]:   <source dev="/dev/sdc"/>
Dec 01 17:13:29 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:13:29 user nova-compute[75745]:   <serial>2e941299-9596-4969-a82d-e543f40668c0</serial>
Dec 01 17:13:29 user nova-compute[75745]: </disk>
Dec 01 17:13:29 user nova-compute[75745]:  {{(pid=75745) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 17:13:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:13:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:13:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] No VIF found with MAC fa:16:3e:60:67:90, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:13:30 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-df0c9bdf-0965-444b-9d30-efc95a04e4f9 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "98b29ba5-9993-4494-b196-f7eea077df7a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.825s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:13:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:32 user nova-compute[75745]: DEBUG nova.compute.manager [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Stashing vm_state: active {{(pid=75745) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Dec 01 17:13:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:13:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:13:32 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:13:32 user nova-compute[75745]: INFO nova.compute.claims [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Claim successful on node user
Dec 01 17:13:32 user nova-compute[75745]: INFO nova.compute.resource_tracker [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Updating resource usage from migration 2cceade1-2602-4b26-8c1c-27cdb0c24750
Dec 01 17:13:32 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:13:32 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:13:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.357s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:13:32 user nova-compute[75745]: INFO nova.compute.manager [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Migrating
Dec 01 17:13:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:13:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:13:32 user nova-compute[75745]: INFO nova.compute.rpcapi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Dec 01 17:13:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:13:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Acquiring lock "refresh_cache-98b29ba5-9993-4494-b196-f7eea077df7a" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:13:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Acquired lock "refresh_cache-98b29ba5-9993-4494-b196-f7eea077df7a" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:13:32 user nova-compute[75745]: DEBUG nova.network.neutron [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:13:33 user nova-compute[75745]: DEBUG nova.network.neutron [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Updating instance_info_cache with network_info: [{"id": "9c3aade6-4181-435d-aabd-07988112a373", "address": "fa:16:3e:60:67:90", "network": {"id": "9083e0bd-c071-4794-bf87-74bc7ba3898b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-947489426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4f3ec75737429e8834e7d3576ffa69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3aade6-41", "ovs_interfaceid": "9c3aade6-4181-435d-aabd-07988112a373", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:13:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Releasing lock "refresh_cache-98b29ba5-9993-4494-b196-f7eea077df7a" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:13:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Starting migrate_disk_and_power_off {{(pid=75745) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11481}}
Dec 01 17:13:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:33 user nova-compute[75745]: DEBUG nova.compute.manager [req-feebe11e-4f53-440d-a264-abb10e0fee30 req-23d254e6-71e1-4d91-94b6-1bc9bc32023d service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Received event network-vif-unplugged-9c3aade6-4181-435d-aabd-07988112a373 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:13:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-feebe11e-4f53-440d-a264-abb10e0fee30 req-23d254e6-71e1-4d91-94b6-1bc9bc32023d service nova] Acquiring lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:13:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-feebe11e-4f53-440d-a264-abb10e0fee30 req-23d254e6-71e1-4d91-94b6-1bc9bc32023d service nova] Lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:13:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-feebe11e-4f53-440d-a264-abb10e0fee30 req-23d254e6-71e1-4d91-94b6-1bc9bc32023d service nova] Lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:13:33 user nova-compute[75745]: DEBUG nova.compute.manager [req-feebe11e-4f53-440d-a264-abb10e0fee30 req-23d254e6-71e1-4d91-94b6-1bc9bc32023d service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] No waiting events found dispatching network-vif-unplugged-9c3aade6-4181-435d-aabd-07988112a373 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:13:33 user nova-compute[75745]: WARNING nova.compute.manager [req-feebe11e-4f53-440d-a264-abb10e0fee30 req-23d254e6-71e1-4d91-94b6-1bc9bc32023d service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Received unexpected event network-vif-unplugged-9c3aade6-4181-435d-aabd-07988112a373 for instance with vm_state active and task_state resize_migrating.
Dec 01 17:13:34 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Instance destroyed successfully.
Dec 01 17:13:34 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-321906429',display_name='tempest-ServerActionsTestOtherB-server-321906429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-321906429',id=14,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6Xv1Rwscmn/urtTSZP43LfdG03kX+bxRxOhmhIXfcYy1rBNpzO0Q01awhPBxn/6X5VK/oxuGhv1u1yXJ9Fp7a3tqYVzRZF/9QTyYTjIDpNO30GMbJX0Ytk2j/sLZKHuw==',key_name='tempest-keypair-56607333',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:10:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2e4f3ec75737429e8834e7d3576ffa69',ramdisk_id='',reservation_id='r-64j6n0b5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-978518734',owner_user_name='tempest-ServerActionsTestOtherB-978518734-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:13:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad1d09d017314c67b4616642f1108f21',uuid=98b29ba5-9993-4494-b196-f7eea077df7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c3aade6-4181-435d-aabd-07988112a373", "address": "fa:16:3e:60:67:90", "network": {"id": "9083e0bd-c071-4794-bf87-74bc7ba3898b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-947489426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-947489426-network", "vif_mac": "fa:16:3e:60:67:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4f3ec75737429e8834e7d3576ffa69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3aade6-41", "ovs_interfaceid": "9c3aade6-4181-435d-aabd-07988112a373", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Converting VIF {"id": "9c3aade6-4181-435d-aabd-07988112a373", "address": "fa:16:3e:60:67:90", "network": {"id": "9083e0bd-c071-4794-bf87-74bc7ba3898b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-947489426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-947489426-network", "vif_mac": "fa:16:3e:60:67:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4f3ec75737429e8834e7d3576ffa69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3aade6-41", "ovs_interfaceid": "9c3aade6-4181-435d-aabd-07988112a373", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:67:90,bridge_name='br-int',has_traffic_filtering=True,id=9c3aade6-4181-435d-aabd-07988112a373,network=Network(9083e0bd-c071-4794-bf87-74bc7ba3898b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c3aade6-41') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG os_vif [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:67:90,bridge_name='br-int',has_traffic_filtering=True,id=9c3aade6-4181-435d-aabd-07988112a373,network=Network(9083e0bd-c071-4794-bf87-74bc7ba3898b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c3aade6-41') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c3aade6-41, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=18fb1631-0c59-4628-8feb-fab77a22fa0d) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:34 user nova-compute[75745]: INFO os_vif [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:67:90,bridge_name='br-int',has_traffic_filtering=True,id=9c3aade6-4181-435d-aabd-07988112a373,network=Network(9083e0bd-c071-4794-bf87-74bc7ba3898b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c3aade6-41')
Dec 01 17:13:34 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxLBeEqG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:13:34 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:13:34 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c6c80a-a84a-4569-b790-135c9af00d39]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:13:34 user nova-compute[75745]: No targets found.
Dec 01 17:13:34 user nova-compute[75745]: iSNS:
Dec 01 17:13:34 user nova-compute[75745]: No targets found.
Dec 01 17:13:34 user nova-compute[75745]: STATIC:
Dec 01 17:13:34 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0
Dec 01 17:13:34 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:13:34 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:13:34 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01
Dec 01 17:13:34 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:13:34 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:13:34 user nova-compute[75745]: FIRMWARE:
Dec 01 17:13:34 user nova-compute[75745]: No targets found.
Dec 01 17:13:34 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:13:34 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:13:34 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc380ec-1168-45a3-8bd1-63987c59100d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda77415-04ad-4469-9a35-831dfaa52dc2]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 (non-flash)
Dec 01 17:13:34 user nova-compute[75745]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:13:34 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 (non-flash)
Dec 01 17:13:34 user nova-compute[75745]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:13:34 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b81f49d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0'): ({'sdc'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Removing single pathed devices sdc {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b124fbc-ae3c-462c-b6a3-e608730380b9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b463984d-ffad-4bf2-b7f2-aeea6a009185]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Flushing IO for device /dev/sdc {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fa89fa-9a36-4418-9dc5-8b22fe4d0a06]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6809cc4a-3960-485f-8056-69cf613ce9f2]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] SCSI volumes sdc have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[193899a0-304d-479e-a83a-b225f8b1ce05]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecb2f7e-6105-4960-9e5a-1278b2ab453c]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0, portal: 172.16.0.220,3260]
Dec 01 17:13:34 user nova-compute[75745]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0, portal: 172.16.0.220,3260] successful.
Dec 01 17:13:34 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b8e8ff-4448-4d05-9542-88f9c7af61fd]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] <== disconnect_volume: return (271ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:13:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a_resize/disk /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] CMD "cp -r /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a_resize/disk /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk" returned: 0 in 0.366s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a_resize/disk.info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk.info {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] CMD "cp -r /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a_resize/disk.info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk.info" returned: 0 in 0.034s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:35 user nova-compute[75745]: DEBUG nova.compute.manager [req-b515cc2f-42e3-42c7-a47e-efb711d094ae req-142a217a-b567-454d-82cd-2a78a836cd90 service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Received event network-vif-plugged-9c3aade6-4181-435d-aabd-07988112a373 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:13:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b515cc2f-42e3-42c7-a47e-efb711d094ae req-142a217a-b567-454d-82cd-2a78a836cd90 service nova] Acquiring lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:13:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b515cc2f-42e3-42c7-a47e-efb711d094ae req-142a217a-b567-454d-82cd-2a78a836cd90 service nova] Lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:13:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b515cc2f-42e3-42c7-a47e-efb711d094ae req-142a217a-b567-454d-82cd-2a78a836cd90 service nova] Lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:13:35 user nova-compute[75745]: DEBUG nova.compute.manager [req-b515cc2f-42e3-42c7-a47e-efb711d094ae req-142a217a-b567-454d-82cd-2a78a836cd90 service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] No waiting events found dispatching network-vif-plugged-9c3aade6-4181-435d-aabd-07988112a373 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:13:35 user nova-compute[75745]: WARNING nova.compute.manager [req-b515cc2f-42e3-42c7-a47e-efb711d094ae req-142a217a-b567-454d-82cd-2a78a836cd90 service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Received unexpected event network-vif-plugged-9c3aade6-4181-435d-aabd-07988112a373 for instance with vm_state active and task_state resize_migrating.
Dec 01 17:13:36 user nova-compute[75745]: DEBUG nova.network.neutron [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Port 9c3aade6-4181-435d-aabd-07988112a373 binding to destination host user is already ACTIVE {{(pid=75745) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Dec 01 17:13:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Acquiring lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:13:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:13:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:13:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Acquiring lock "refresh_cache-98b29ba5-9993-4494-b196-f7eea077df7a" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:13:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Acquired lock "refresh_cache-98b29ba5-9993-4494-b196-f7eea077df7a" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:13:36 user nova-compute[75745]: DEBUG nova.network.neutron [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:13:37 user nova-compute[75745]: DEBUG nova.network.neutron [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Updating instance_info_cache with network_info: [{"id": "9c3aade6-4181-435d-aabd-07988112a373", "address": "fa:16:3e:60:67:90", "network": {"id": "9083e0bd-c071-4794-bf87-74bc7ba3898b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-947489426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4f3ec75737429e8834e7d3576ffa69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3aade6-41", "ovs_interfaceid": "9c3aade6-4181-435d-aabd-07988112a373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:13:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Releasing lock "refresh_cache-98b29ba5-9993-4494-b196-f7eea077df7a" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:13:37 user nova-compute[75745]: DEBUG os_brick.utils [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:13:37 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:37 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:37 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1303111f-b56a-49ff-b096-c77705b2eff5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:37 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:37 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:37 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bbdb28-8d0f-45bd-a3ac-0c314ccd9cb4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:37 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:37 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:37 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb0e5bc-f140-4c00-8bba-f055e51fa4f2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:37 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fcf7ed-623b-4eea-9bff-a8c9066a170c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:37 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:37 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:13:37 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:13:37 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:37 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:13:37 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:13:37 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac39677-7640-4c9f-b333-6daeb8c61905]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:37 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:13:37 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:13:37 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:13:37 user nova-compute[75745]: DEBUG os_brick.utils [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:13:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:40 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:13:40 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:13:41 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:13:41 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:13:42 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:13:42 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:13:43 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:13:43 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:13:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:13:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:13:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:13:43 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:13:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:13:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06356800-2f67-4c35-9703-a71ca3271693/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06356800-2f67-4c35-9703-a71ca3271693/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06356800-2f67-4c35-9703-a71ca3271693/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06356800-2f67-4c35-9703-a71ca3271693/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:46 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Starting finish_migration {{(pid=75745) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11668}}
Dec 01 17:13:46 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Instance directory exists: not creating {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Dec 01 17:13:46 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Creating image(s)
Dec 01 17:13:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:46 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:13:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.441s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:46 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Checking if we can resize image /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk. size=21474836480 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:13:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:46 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:13:46 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:13:47 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=8241MB free_disk=25.45174789428711GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Applying migration context for instance 98b29ba5-9993-4494-b196-f7eea077df7a as it has an incoming, in-progress migration 2cceade1-2602-4b26-8c1c-27cdb0c24750. Migration status is post-migrating {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Dec 01 17:13:47 user nova-compute[75745]: INFO nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Updating resource usage from migration 2cceade1-2602-4b26-8c1c-27cdb0c24750
Dec 01 17:13:47 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 4ac6f586-cc5b-4a3f-b374-4b2006a48427 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance d997cdd6-67c6-4263-814a-17cf9e27bbeb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 3a56aca8-ffbb-450b-a953-fc2071902486 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 06356800-2f67-4c35-9703-a71ca3271693 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 0ab0c115-74aa-4e55-92a3-6fa91ba753e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Migration 2cceade1-2602-4b26-8c1c-27cdb0c24750 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 98b29ba5-9993-4494-b196-f7eea077df7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=26GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk 21474836480 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk 21474836480" returned: 0 in 0.047s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Did not create local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Ensure instance console log exists: /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Start _get_guest_xml network_info=[{"id": "9c3aade6-4181-435d-aabd-07988112a373", "address": "fa:16:3e:60:67:90", "network": {"id": "9083e0bd-c071-4794-bf87-74bc7ba3898b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-947489426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-947489426-network", "vif_mac": "fa:16:3e:60:67:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4f3ec75737429e8834e7d3576ffa69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3aade6-41", "ovs_interfaceid": "9c3aade6-4181-435d-aabd-07988112a373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': 'fd4cf0f1-757c-4c55-be02-02ffcfbd2c49', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxLBeEqG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '98b29ba5-9993-4494-b196-f7eea077df7a', 'attached_at': '2023-12-01T17:13:46.000000', 'detached_at': '', 'volume_id': '2e941299-9596-4969-a82d-e543f40668c0', 'serial': '2e941299-9596-4969-a82d-e543f40668c0'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:13:47 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:13:47 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:13:47 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxLBeEqG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:13:47 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:13:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:13:47 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:13:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:13:47 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0d52cf-2ef6-45a0-adcf-104a6f35e317]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:13:47 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[761675db-beb2-4cf8-b009-de24652b32c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0] added
Dec 01 17:13:47 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e09866-ca17-4c96-9d49-6011197a002a]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[86584dad-ac50-4054-9ffe-6894a24fbd96]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YxLBeEqG {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YxLBeEqG" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3d08e9-7da5-42dd-b84d-7b9d7b9f3b33]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YxLBeEqG'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4296a0de-9610-47a8-83a2-ade61728f26e]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c37ebfb-865a-43d3-a21a-5bb50fb710a6]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 (non-flash)
Dec 01 17:13:47 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 (non-flash)
Dec 01 17:13:47 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.471s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fe4bf7-55ef-4dc0-963f-6cb469d99869]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0, portal: 172.16.0.220,3260]
Dec 01 17:13:47 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0, portal: 172.16.0.220,3260] successful.
Dec 01 17:13:47 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bca2c9-e500-41a9-9415-020198c88cd5]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23bef07-5826-4151-9e7d-735e16322813]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 (non-flash)
Dec 01 17:13:47 user nova-compute[75745]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:13:47 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 (non-flash)
Dec 01 17:13:47 user nova-compute[75745]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:13:47 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a6408a-d490-4b9e-9f43-9615d10489b6]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:13:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxLBeEqG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:13:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:13:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23039393336386336', 'path': '/dev/sdc'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:13:48 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039393336386336', 'path': '/dev/sdc'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:13:48 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-321906429',display_name='tempest-ServerActionsTestOtherB-server-321906429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-321906429',id=14,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6Xv1Rwscmn/urtTSZP43LfdG03kX+bxRxOhmhIXfcYy1rBNpzO0Q01awhPBxn/6X5VK/oxuGhv1u1yXJ9Fp7a3tqYVzRZF/9QTyYTjIDpNO30GMbJX0Ytk2j/sLZKHuw==',key_name='tempest-keypair-56607333',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:10:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2e4f3ec75737429e8834e7d3576ffa69',ramdisk_id='',reservation_id='r-64j6n0b5',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-978518734',owner_user_name='tempest-ServerActionsTestOtherB-978518734-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:13:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad1d09d017314c67b4616642f1108f21',uuid=98b29ba5-9993-4494-b196-f7eea077df7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c3aade6-4181-435d-aabd-07988112a373", "address": "fa:16:3e:60:67:90", "network": {"id": "9083e0bd-c071-4794-bf87-74bc7ba3898b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-947489426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-947489426-network", "vif_mac": "fa:16:3e:60:67:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4f3ec75737429e8834e7d3576ffa69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3aade6-41", "ovs_interfaceid": "9c3aade6-4181-435d-aabd-07988112a373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:13:48 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Converting VIF {"id": "9c3aade6-4181-435d-aabd-07988112a373", "address": "fa:16:3e:60:67:90", "network": {"id": "9083e0bd-c071-4794-bf87-74bc7ba3898b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-947489426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-947489426-network", "vif_mac": "fa:16:3e:60:67:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4f3ec75737429e8834e7d3576ffa69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3aade6-41", "ovs_interfaceid": "9c3aade6-4181-435d-aabd-07988112a373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:13:48 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:67:90,bridge_name='br-int',has_traffic_filtering=True,id=9c3aade6-4181-435d-aabd-07988112a373,network=Network(9083e0bd-c071-4794-bf87-74bc7ba3898b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c3aade6-41') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:13:48 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:13:48 user nova-compute[75745]:   <uuid>98b29ba5-9993-4494-b196-f7eea077df7a</uuid>
Dec 01 17:13:48 user nova-compute[75745]:   <name>instance-0000000e</name>
Dec 01 17:13:48 user nova-compute[75745]:   <memory>2097152</memory>
Dec 01 17:13:48 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:13:48 user nova-compute[75745]:   <metadata>
Dec 01 17:13:48 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:13:48 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:13:48 user nova-compute[75745]:       <nova:name>tempest-ServerActionsTestOtherB-server-321906429</nova:name>
Dec 01 17:13:48 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:13:47</nova:creationTime>
Dec 01 17:13:48 user nova-compute[75745]:       <nova:flavor name="m1.small">
Dec 01 17:13:48 user nova-compute[75745]:         <nova:memory>2048</nova:memory>
Dec 01 17:13:48 user nova-compute[75745]:         <nova:disk>20</nova:disk>
Dec 01 17:13:48 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:13:48 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:13:48 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:13:48 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:13:48 user nova-compute[75745]:       <nova:owner>
Dec 01 17:13:48 user nova-compute[75745]:         <nova:user uuid="ad1d09d017314c67b4616642f1108f21">tempest-ServerActionsTestOtherB-978518734-project-member</nova:user>
Dec 01 17:13:48 user nova-compute[75745]:         <nova:project uuid="2e4f3ec75737429e8834e7d3576ffa69">tempest-ServerActionsTestOtherB-978518734</nova:project>
Dec 01 17:13:48 user nova-compute[75745]:       </nova:owner>
Dec 01 17:13:48 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:13:48 user nova-compute[75745]:       <nova:ports>
Dec 01 17:13:48 user nova-compute[75745]:         <nova:port uuid="9c3aade6-4181-435d-aabd-07988112a373">
Dec 01 17:13:48 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 01 17:13:48 user nova-compute[75745]:         </nova:port>
Dec 01 17:13:48 user nova-compute[75745]:       </nova:ports>
Dec 01 17:13:48 user nova-compute[75745]:     </nova:instance>
Dec 01 17:13:48 user nova-compute[75745]:   </metadata>
Dec 01 17:13:48 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:13:48 user nova-compute[75745]:     <system>
Dec 01 17:13:48 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:13:48 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:13:48 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:13:48 user nova-compute[75745]:       <entry name="serial">98b29ba5-9993-4494-b196-f7eea077df7a</entry>
Dec 01 17:13:48 user nova-compute[75745]:       <entry name="uuid">98b29ba5-9993-4494-b196-f7eea077df7a</entry>
Dec 01 17:13:48 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:13:48 user nova-compute[75745]:     </system>
Dec 01 17:13:48 user nova-compute[75745]:   </sysinfo>
Dec 01 17:13:48 user nova-compute[75745]:   <os>
Dec 01 17:13:48 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:13:48 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:13:48 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:13:48 user nova-compute[75745]:   </os>
Dec 01 17:13:48 user nova-compute[75745]:   <features>
Dec 01 17:13:48 user nova-compute[75745]:     <acpi/>
Dec 01 17:13:48 user nova-compute[75745]:     <apic/>
Dec 01 17:13:48 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:13:48 user nova-compute[75745]:   </features>
Dec 01 17:13:48 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:13:48 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:13:48 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:13:48 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:13:48 user nova-compute[75745]:   </clock>
Dec 01 17:13:48 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:13:48 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:13:48 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:13:48 user nova-compute[75745]:   </cpu>
Dec 01 17:13:48 user nova-compute[75745]:   <devices>
Dec 01 17:13:48 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:13:48 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:13:48 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk"/>
Dec 01 17:13:48 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:13:48 user nova-compute[75745]:     </disk>
Dec 01 17:13:48 user nova-compute[75745]:     <disk type="block" device="disk">
Dec 01 17:13:48 user nova-compute[75745]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:13:48 user nova-compute[75745]:       <source dev="/dev/sdc"/>
Dec 01 17:13:48 user nova-compute[75745]:       <target dev="vdb" bus="virtio"/>
Dec 01 17:13:48 user nova-compute[75745]:       <serial>2e941299-9596-4969-a82d-e543f40668c0</serial>
Dec 01 17:13:48 user nova-compute[75745]:     </disk>
Dec 01 17:13:48 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:13:48 user nova-compute[75745]:       <mac address="fa:16:3e:60:67:90"/>
Dec 01 17:13:48 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:13:48 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:13:48 user nova-compute[75745]:       <target dev="tap9c3aade6-41"/>
Dec 01 17:13:48 user nova-compute[75745]:     </interface>
Dec 01 17:13:48 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:13:48 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/console.log" append="off"/>
Dec 01 17:13:48 user nova-compute[75745]:     </serial>
Dec 01 17:13:48 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:13:48 user nova-compute[75745]:     <video>
Dec 01 17:13:48 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:13:48 user nova-compute[75745]:     </video>
Dec 01 17:13:48 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:13:48 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:13:48 user nova-compute[75745]:     </rng>
Dec 01 17:13:48 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:13:48 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:13:48 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:13:48 user nova-compute[75745]:     </memballoon>
Dec 01 17:13:48 user nova-compute[75745]:   </devices>
Dec 01 17:13:48 user nova-compute[75745]: </domain>
Dec 01 17:13:48 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:13:48 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-321906429',display_name='tempest-ServerActionsTestOtherB-server-321906429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-321906429',id=14,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6Xv1Rwscmn/urtTSZP43LfdG03kX+bxRxOhmhIXfcYy1rBNpzO0Q01awhPBxn/6X5VK/oxuGhv1u1yXJ9Fp7a3tqYVzRZF/9QTyYTjIDpNO30GMbJX0Ytk2j/sLZKHuw==',key_name='tempest-keypair-56607333',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:10:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2e4f3ec75737429e8834e7d3576ffa69',ramdisk_id='',reservation_id='r-64j6n0b5',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-978518734',owner_user_name='tempest-ServerActionsTestOtherB-978518734-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:13:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad1d09d017314c67b4616642f1108f21',uuid=98b29ba5-9993-4494-b196-f7eea077df7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c3aade6-4181-435d-aabd-07988112a373", "address": "fa:16:3e:60:67:90", "network": {"id": "9083e0bd-c071-4794-bf87-74bc7ba3898b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-947489426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-947489426-network", "vif_mac": "fa:16:3e:60:67:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4f3ec75737429e8834e7d3576ffa69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3aade6-41", "ovs_interfaceid": "9c3aade6-4181-435d-aabd-07988112a373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:13:48 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Converting VIF {"id": "9c3aade6-4181-435d-aabd-07988112a373", "address": "fa:16:3e:60:67:90", "network": {"id": "9083e0bd-c071-4794-bf87-74bc7ba3898b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-947489426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-947489426-network", "vif_mac": "fa:16:3e:60:67:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4f3ec75737429e8834e7d3576ffa69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3aade6-41", "ovs_interfaceid": "9c3aade6-4181-435d-aabd-07988112a373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:13:48 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:67:90,bridge_name='br-int',has_traffic_filtering=True,id=9c3aade6-4181-435d-aabd-07988112a373,network=Network(9083e0bd-c071-4794-bf87-74bc7ba3898b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c3aade6-41') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:13:48 user nova-compute[75745]: DEBUG os_vif [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:67:90,bridge_name='br-int',has_traffic_filtering=True,id=9c3aade6-4181-435d-aabd-07988112a373,network=Network(9083e0bd-c071-4794-bf87-74bc7ba3898b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c3aade6-41') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:13:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:13:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:13:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec1b282c-a7fa-5026-9d11-8f93a071c319', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:13:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:13:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c3aade6-41, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:13:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c3aade6-41, col_values=(('qos', UUID('477635a8-f1e0-4156-9f3e-6acd321d6a5c')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:13:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c3aade6-41, col_values=(('external_ids', {'iface-id': '9c3aade6-4181-435d-aabd-07988112a373', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:67:90', 'vm-uuid': '98b29ba5-9993-4494-b196-f7eea077df7a'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:13:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:13:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:48 user nova-compute[75745]: INFO os_vif [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:67:90,bridge_name='br-int',has_traffic_filtering=True,id=9c3aade6-4181-435d-aabd-07988112a373,network=Network(9083e0bd-c071-4794-bf87-74bc7ba3898b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c3aade6-41')
Dec 01 17:13:48 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:13:48 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:13:48 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] No VIF found with MAC fa:16:3e:60:67:90, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:13:48 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3a56aca8-ffbb-450b-a953-fc2071902486 is timed out.
Dec 01 17:13:48 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Successfully detached device vdb from instance 3a56aca8-ffbb-450b-a953-fc2071902486 from the live domain config.
Dec 01 17:13:48 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:13:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sGJCnrUQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:13:48 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:13:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:13:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:13:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c6880b-5488-4292-8285-0c182527881f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:13:49 user nova-compute[75745]: No targets found.
Dec 01 17:13:49 user nova-compute[75745]: iSNS:
Dec 01 17:13:49 user nova-compute[75745]: No targets found.
Dec 01 17:13:49 user nova-compute[75745]: STATIC:
Dec 01 17:13:49 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0
Dec 01 17:13:49 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:13:49 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:13:49 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01
Dec 01 17:13:49 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:13:49 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:13:49 user nova-compute[75745]: FIRMWARE:
Dec 01 17:13:49 user nova-compute[75745]: No targets found.
Dec 01 17:13:49 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:13:49 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:13:49 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4848732-1ecc-4c23-b59a-1f2e1313ab88]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2888043d-8595-4db6-8094-b12c87cb905e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 (non-flash)
Dec 01 17:13:49 user nova-compute[75745]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:13:49 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 (non-flash)
Dec 01 17:13:49 user nova-compute[75745]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:13:49 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b85f5e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01'): ({'sdb'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Removing single pathed devices sdb {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a03f29-3179-4978-8e00-de58e3597b92]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5dfd84-0cc9-40dc-b8e6-4bf2d794993a]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Flushing IO for device /dev/sdb {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89358a7-b8ed-430e-9b11-16828f35cf08]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[34aadf0e-01e9-48b0-a76c-4559f0c70a3f]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] SCSI volumes sdb have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3625147d-2a11-4154-8ed5-832151769228]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7387293c-a929-4be8-9fd5-f61bfd878a90]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01, portal: 172.16.0.220,3260]
Dec 01 17:13:49 user nova-compute[75745]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01, portal: 172.16.0.220,3260] successful.
Dec 01 17:13:49 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d36758f0-6731-4c65-8dd6-21c4e666ca01 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e48b99-5978-4c68-9275-3b5f3919dad2]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] <== disconnect_volume: return (288ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-98b29ba5-9993-4494-b196-f7eea077df7a" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-98b29ba5-9993-4494-b196-f7eea077df7a" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:13:49 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:13:50 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Updating instance_info_cache with network_info: [{"id": "9c3aade6-4181-435d-aabd-07988112a373", "address": "fa:16:3e:60:67:90", "network": {"id": "9083e0bd-c071-4794-bf87-74bc7ba3898b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-947489426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4f3ec75737429e8834e7d3576ffa69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3aade6-41", "ovs_interfaceid": "9c3aade6-4181-435d-aabd-07988112a373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:13:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-98b29ba5-9993-4494-b196-f7eea077df7a" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:13:50 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:13:50 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:13:50 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:13:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:50 user nova-compute[75745]: DEBUG nova.objects.instance [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lazy-loading 'flavor' on Instance uuid 3a56aca8-ffbb-450b-a953-fc2071902486 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:13:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d1b3dad6-4d93-44c0-9b14-fb899b0e45e9 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "3a56aca8-ffbb-450b-a953-fc2071902486" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.762s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:13:50 user nova-compute[75745]: DEBUG nova.compute.manager [req-862ae4d0-4ece-4999-870c-745d7e20e403 req-50b26763-9c4d-435e-89c1-30d0a622ff40 service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Received event network-vif-plugged-9c3aade6-4181-435d-aabd-07988112a373 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:13:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-862ae4d0-4ece-4999-870c-745d7e20e403 req-50b26763-9c4d-435e-89c1-30d0a622ff40 service nova] Acquiring lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:13:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-862ae4d0-4ece-4999-870c-745d7e20e403 req-50b26763-9c4d-435e-89c1-30d0a622ff40 service nova] Lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:13:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-862ae4d0-4ece-4999-870c-745d7e20e403 req-50b26763-9c4d-435e-89c1-30d0a622ff40 service nova] Lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:13:50 user nova-compute[75745]: DEBUG nova.compute.manager [req-862ae4d0-4ece-4999-870c-745d7e20e403 req-50b26763-9c4d-435e-89c1-30d0a622ff40 service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] No waiting events found dispatching network-vif-plugged-9c3aade6-4181-435d-aabd-07988112a373 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:13:50 user nova-compute[75745]: WARNING nova.compute.manager [req-862ae4d0-4ece-4999-870c-745d7e20e403 req-50b26763-9c4d-435e-89c1-30d0a622ff40 service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Received unexpected event network-vif-plugged-9c3aade6-4181-435d-aabd-07988112a373 for instance with vm_state active and task_state resize_finish.
Dec 01 17:13:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:52 user nova-compute[75745]: DEBUG nova.compute.manager [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:13:52 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Instance running successfully.
Dec 01 17:13:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Failed to set time: agent not configured {{(pid=75745) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Dec 01 17:13:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-da56137c-5ca3-4b64-867a-9b65f24a80b3 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] finish_migration finished successfully. {{(pid=75745) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11763}}
Dec 01 17:13:52 user nova-compute[75745]: DEBUG nova.compute.manager [req-a5d194ab-4da2-4f73-a73b-f01dd45b6375 req-067509e8-0675-4278-b856-e328aa11ac99 service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Received event network-vif-plugged-9c3aade6-4181-435d-aabd-07988112a373 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:13:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a5d194ab-4da2-4f73-a73b-f01dd45b6375 req-067509e8-0675-4278-b856-e328aa11ac99 service nova] Acquiring lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:13:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a5d194ab-4da2-4f73-a73b-f01dd45b6375 req-067509e8-0675-4278-b856-e328aa11ac99 service nova] Lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:13:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a5d194ab-4da2-4f73-a73b-f01dd45b6375 req-067509e8-0675-4278-b856-e328aa11ac99 service nova] Lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:13:52 user nova-compute[75745]: DEBUG nova.compute.manager [req-a5d194ab-4da2-4f73-a73b-f01dd45b6375 req-067509e8-0675-4278-b856-e328aa11ac99 service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] No waiting events found dispatching network-vif-plugged-9c3aade6-4181-435d-aabd-07988112a373 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:13:52 user nova-compute[75745]: WARNING nova.compute.manager [req-a5d194ab-4da2-4f73-a73b-f01dd45b6375 req-067509e8-0675-4278-b856-e328aa11ac99 service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Received unexpected event network-vif-plugged-9c3aade6-4181-435d-aabd-07988112a373 for instance with vm_state active and task_state resize_finish.
Dec 01 17:13:52 user nova-compute[75745]: DEBUG nova.objects.instance [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lazy-loading 'flavor' on Instance uuid 4ac6f586-cc5b-4a3f-b374-4b2006a48427 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:13:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "refresh_cache-4ac6f586-cc5b-4a3f-b374-4b2006a48427" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:13:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquired lock "refresh_cache-4ac6f586-cc5b-4a3f-b374-4b2006a48427" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:13:52 user nova-compute[75745]: DEBUG nova.network.neutron [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:13:52 user nova-compute[75745]: DEBUG nova.objects.instance [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lazy-loading 'info_cache' on Instance uuid 4ac6f586-cc5b-4a3f-b374-4b2006a48427 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:13:52 user nova-compute[75745]: DEBUG nova.objects.base [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Object Instance<4ac6f586-cc5b-4a3f-b374-4b2006a48427> lazy-loaded attributes: flavor,info_cache {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG nova.network.neutron [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Updating instance_info_cache with network_info: [{"id": "b4990a3b-371a-44eb-98d8-685dc63590da", "address": "fa:16:3e:d3:4e:b4", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4990a3b-37", "ovs_interfaceid": "b4990a3b-371a-44eb-98d8-685dc63590da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Releasing lock "refresh_cache-4ac6f586-cc5b-4a3f-b374-4b2006a48427" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:13:53 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Instance destroyed successfully.
Dec 01 17:13:53 user nova-compute[75745]: DEBUG nova.objects.instance [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lazy-loading 'resources' on Instance uuid 4ac6f586-cc5b-4a3f-b374-4b2006a48427 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG nova.objects.base [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Object Instance<4ac6f586-cc5b-4a3f-b374-4b2006a48427> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:05:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2091565177',display_name='tempest-AttachVolumeTestJSON-server-2091565177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2091565177',id=3,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3XjkUwzRZSzJkFVK8CajxZrqSjgRTlHxxeyK14q4pHPTuyqvoLAZM+Yf8NfQQKwzsK8V31lsj4YBhMGkfSH1VtWc/GskdhpcUVvoTFK+eiPPk/qO2e2As1y2z8e2iGKw==',key_name='tempest-keypair-811365711',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:06:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7c4e507763844b67b588fa2509ec3aff',ramdisk_id='',reservation_id='r-38xwk32b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-712829532',owner_user_name='tempest-AttachVolumeTestJSON-712829532-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:12:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e92e1fa18cc4bdaa17afd2b2db97259',uuid=4ac6f586-cc5b-4a3f-b374-4b2006a48427,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b4990a3b-371a-44eb-98d8-685dc63590da", "address": "fa:16:3e:d3:4e:b4", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4990a3b-37", "ovs_interfaceid": "b4990a3b-371a-44eb-98d8-685dc63590da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Converting VIF {"id": "b4990a3b-371a-44eb-98d8-685dc63590da", "address": "fa:16:3e:d3:4e:b4", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4990a3b-37", "ovs_interfaceid": "b4990a3b-371a-44eb-98d8-685dc63590da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:4e:b4,bridge_name='br-int',has_traffic_filtering=True,id=b4990a3b-371a-44eb-98d8-685dc63590da,network=Network(b2b1c054-5370-4c64-9fb7-b98791c8f5ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4990a3b-37') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG os_vif [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:4e:b4,bridge_name='br-int',has_traffic_filtering=True,id=b4990a3b-371a-44eb-98d8-685dc63590da,network=Network(b2b1c054-5370-4c64-9fb7-b98791c8f5ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4990a3b-37') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4990a3b-37, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f29475b8-cc92-4a8c-985a-bd9aed826989) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:53 user nova-compute[75745]: INFO os_vif [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:4e:b4,bridge_name='br-int',has_traffic_filtering=True,id=b4990a3b-371a-44eb-98d8-685dc63590da,network=Network(b2b1c054-5370-4c64-9fb7-b98791c8f5ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4990a3b-37')
Dec 01 17:13:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Start _get_guest_xml network_info=[{"id": "b4990a3b-371a-44eb-98d8-685dc63590da", "address": "fa:16:3e:d3:4e:b4", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4990a3b-37", "ovs_interfaceid": "b4990a3b-371a-44eb-98d8-685dc63590da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG nova.objects.instance [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lazy-loading 'numa_topology' on Instance uuid 4ac6f586-cc5b-4a3f-b374-4b2006a48427 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG nova.objects.base [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Object Instance<4ac6f586-cc5b-4a3f-b374-4b2006a48427> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:13:53 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:13:53 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:13:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG nova.objects.instance [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4ac6f586-cc5b-4a3f-b374-4b2006a48427 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG nova.objects.base [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Object Instance<4ac6f586-cc5b-4a3f-b374-4b2006a48427> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:05:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2091565177',display_name='tempest-AttachVolumeTestJSON-server-2091565177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2091565177',id=3,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3XjkUwzRZSzJkFVK8CajxZrqSjgRTlHxxeyK14q4pHPTuyqvoLAZM+Yf8NfQQKwzsK8V31lsj4YBhMGkfSH1VtWc/GskdhpcUVvoTFK+eiPPk/qO2e2As1y2z8e2iGKw==',key_name='tempest-keypair-811365711',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:06:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7c4e507763844b67b588fa2509ec3aff',ramdisk_id='',reservation_id='r-38xwk32b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-712829532',owner_user_name='tempest-AttachVolumeTestJSON-712829532-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:12:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e92e1fa18cc4bdaa17afd2b2db97259',uuid=4ac6f586-cc5b-4a3f-b374-4b2006a48427,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b4990a3b-371a-44eb-98d8-685dc63590da", "address": "fa:16:3e:d3:4e:b4", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4990a3b-37", "ovs_interfaceid": "b4990a3b-371a-44eb-98d8-685dc63590da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Converting VIF {"id": "b4990a3b-371a-44eb-98d8-685dc63590da", "address": "fa:16:3e:d3:4e:b4", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4990a3b-37", "ovs_interfaceid": "b4990a3b-371a-44eb-98d8-685dc63590da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:4e:b4,bridge_name='br-int',has_traffic_filtering=True,id=b4990a3b-371a-44eb-98d8-685dc63590da,network=Network(b2b1c054-5370-4c64-9fb7-b98791c8f5ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4990a3b-37') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG nova.objects.instance [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ac6f586-cc5b-4a3f-b374-4b2006a48427 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG nova.objects.base [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Object Instance<4ac6f586-cc5b-4a3f-b374-4b2006a48427> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:13:53 user nova-compute[75745]:   <uuid>4ac6f586-cc5b-4a3f-b374-4b2006a48427</uuid>
Dec 01 17:13:53 user nova-compute[75745]:   <name>instance-00000003</name>
Dec 01 17:13:53 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:13:53 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:13:53 user nova-compute[75745]:   <metadata>
Dec 01 17:13:53 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:13:53 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:13:53 user nova-compute[75745]:       <nova:name>tempest-AttachVolumeTestJSON-server-2091565177</nova:name>
Dec 01 17:13:53 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:13:53</nova:creationTime>
Dec 01 17:13:53 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:13:53 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:13:53 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:13:53 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:13:53 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:13:53 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:13:53 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:13:53 user nova-compute[75745]:       <nova:owner>
Dec 01 17:13:53 user nova-compute[75745]:         <nova:user uuid="7e92e1fa18cc4bdaa17afd2b2db97259">tempest-AttachVolumeTestJSON-712829532-project-member</nova:user>
Dec 01 17:13:53 user nova-compute[75745]:         <nova:project uuid="7c4e507763844b67b588fa2509ec3aff">tempest-AttachVolumeTestJSON-712829532</nova:project>
Dec 01 17:13:53 user nova-compute[75745]:       </nova:owner>
Dec 01 17:13:53 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:13:53 user nova-compute[75745]:       <nova:ports>
Dec 01 17:13:53 user nova-compute[75745]:         <nova:port uuid="b4990a3b-371a-44eb-98d8-685dc63590da">
Dec 01 17:13:53 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 01 17:13:53 user nova-compute[75745]:         </nova:port>
Dec 01 17:13:53 user nova-compute[75745]:       </nova:ports>
Dec 01 17:13:53 user nova-compute[75745]:     </nova:instance>
Dec 01 17:13:53 user nova-compute[75745]:   </metadata>
Dec 01 17:13:53 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:13:53 user nova-compute[75745]:     <system>
Dec 01 17:13:53 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:13:53 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:13:53 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:13:53 user nova-compute[75745]:       <entry name="serial">4ac6f586-cc5b-4a3f-b374-4b2006a48427</entry>
Dec 01 17:13:53 user nova-compute[75745]:       <entry name="uuid">4ac6f586-cc5b-4a3f-b374-4b2006a48427</entry>
Dec 01 17:13:53 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:13:53 user nova-compute[75745]:     </system>
Dec 01 17:13:53 user nova-compute[75745]:   </sysinfo>
Dec 01 17:13:53 user nova-compute[75745]:   <os>
Dec 01 17:13:53 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:13:53 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:13:53 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:13:53 user nova-compute[75745]:   </os>
Dec 01 17:13:53 user nova-compute[75745]:   <features>
Dec 01 17:13:53 user nova-compute[75745]:     <acpi/>
Dec 01 17:13:53 user nova-compute[75745]:     <apic/>
Dec 01 17:13:53 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:13:53 user nova-compute[75745]:   </features>
Dec 01 17:13:53 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:13:53 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:13:53 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:13:53 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:13:53 user nova-compute[75745]:   </clock>
Dec 01 17:13:53 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:13:53 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:13:53 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:13:53 user nova-compute[75745]:   </cpu>
Dec 01 17:13:53 user nova-compute[75745]:   <devices>
Dec 01 17:13:53 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:13:53 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:13:53 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk"/>
Dec 01 17:13:53 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:13:53 user nova-compute[75745]:     </disk>
Dec 01 17:13:53 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:13:53 user nova-compute[75745]:       <mac address="fa:16:3e:d3:4e:b4"/>
Dec 01 17:13:53 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:13:53 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:13:53 user nova-compute[75745]:       <target dev="tapb4990a3b-37"/>
Dec 01 17:13:53 user nova-compute[75745]:     </interface>
Dec 01 17:13:53 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:13:53 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/console.log" append="off"/>
Dec 01 17:13:53 user nova-compute[75745]:     </serial>
Dec 01 17:13:53 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:13:53 user nova-compute[75745]:     <video>
Dec 01 17:13:53 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:13:53 user nova-compute[75745]:     </video>
Dec 01 17:13:53 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:13:53 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:13:53 user nova-compute[75745]:     </rng>
Dec 01 17:13:53 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:13:53 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:13:53 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:13:53 user nova-compute[75745]:     </memballoon>
Dec 01 17:13:53 user nova-compute[75745]:   </devices>
Dec 01 17:13:53 user nova-compute[75745]: </domain>
Dec 01 17:13:53 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Acquiring lock "e122638a-a52a-445b-a79e-91c76dc94a64" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Lock "e122638a-a52a-445b-a79e-91c76dc94a64" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG nova.compute.manager [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG nova.objects.instance [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4ac6f586-cc5b-4a3f-b374-4b2006a48427 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG nova.objects.base [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Object Instance<4ac6f586-cc5b-4a3f-b374-4b2006a48427> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:13:54 user nova-compute[75745]: INFO nova.compute.claims [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Claim successful on node user
Dec 01 17:13:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.202s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Cannot resize image /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG nova.objects.instance [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lazy-loading 'migration_context' on Instance uuid 4ac6f586-cc5b-4a3f-b374-4b2006a48427 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG nova.objects.base [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Object Instance<4ac6f586-cc5b-4a3f-b374-4b2006a48427> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:05:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2091565177',display_name='tempest-AttachVolumeTestJSON-server-2091565177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2091565177',id=3,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3XjkUwzRZSzJkFVK8CajxZrqSjgRTlHxxeyK14q4pHPTuyqvoLAZM+Yf8NfQQKwzsK8V31lsj4YBhMGkfSH1VtWc/GskdhpcUVvoTFK+eiPPk/qO2e2As1y2z8e2iGKw==',key_name='tempest-keypair-811365711',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:06:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='7c4e507763844b67b588fa2509ec3aff',ramdisk_id='',reservation_id='r-38xwk32b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-712829532',owner_user_name='tempest-AttachVolumeTestJSON-712829532-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:12:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e92e1fa18cc4bdaa17afd2b2db97259',uuid=4ac6f586-cc5b-4a3f-b374-4b2006a48427,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b4990a3b-371a-44eb-98d8-685dc63590da", "address": "fa:16:3e:d3:4e:b4", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4990a3b-37", "ovs_interfaceid": "b4990a3b-371a-44eb-98d8-685dc63590da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Converting VIF {"id": "b4990a3b-371a-44eb-98d8-685dc63590da", "address": "fa:16:3e:d3:4e:b4", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4990a3b-37", "ovs_interfaceid": "b4990a3b-371a-44eb-98d8-685dc63590da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:4e:b4,bridge_name='br-int',has_traffic_filtering=True,id=b4990a3b-371a-44eb-98d8-685dc63590da,network=Network(b2b1c054-5370-4c64-9fb7-b98791c8f5ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4990a3b-37') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG os_vif [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:4e:b4,bridge_name='br-int',has_traffic_filtering=True,id=b4990a3b-371a-44eb-98d8-685dc63590da,network=Network(b2b1c054-5370-4c64-9fb7-b98791c8f5ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4990a3b-37') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '84adab1e-4b86-5406-9964-83fef1e265db', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4990a3b-37, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb4990a3b-37, col_values=(('qos', UUID('43c8d8a2-ad14-49df-90c4-27653410bd2e')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb4990a3b-37, col_values=(('external_ids', {'iface-id': 'b4990a3b-371a-44eb-98d8-685dc63590da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:4e:b4', 'vm-uuid': '4ac6f586-cc5b-4a3f-b374-4b2006a48427'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:54 user nova-compute[75745]: INFO os_vif [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:4e:b4,bridge_name='br-int',has_traffic_filtering=True,id=b4990a3b-371a-44eb-98d8-685dc63590da,network=Network(b2b1c054-5370-4c64-9fb7-b98791c8f5ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4990a3b-37')
Dec 01 17:13:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.447s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG nova.compute.manager [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG nova.compute.manager [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG nova.network.neutron [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:13:54 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:13:54 user nova-compute[75745]: DEBUG nova.compute.manager [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG nova.policy [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '52fef9da772c4f8ba9f4be1b168ad305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88dee991f154d659d74d3dd5be6a231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG nova.compute.manager [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:13:54 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Creating image(s)
Dec 01 17:13:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Acquiring lock "/opt/stack/data/nova/instances/e122638a-a52a-445b-a79e-91c76dc94a64/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Lock "/opt/stack/data/nova/instances/e122638a-a52a-445b-a79e-91c76dc94a64/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Lock "/opt/stack/data/nova/instances/e122638a-a52a-445b-a79e-91c76dc94a64/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:13:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.195s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:13:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:13:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.203s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/e122638a-a52a-445b-a79e-91c76dc94a64/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/e122638a-a52a-445b-a79e-91c76dc94a64/disk 1073741824" returned: 0 in 0.064s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:13:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:55 user nova-compute[75745]: DEBUG nova.network.neutron [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Successfully created port: 1713fd8b-927a-4698-9013-7eebf0815bf8 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:13:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.179s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:55 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e122638a-a52a-445b-a79e-91c76dc94a64/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:13:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e122638a-a52a-445b-a79e-91c76dc94a64/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:13:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e122638a-a52a-445b-a79e-91c76dc94a64/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:13:55 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Cannot resize image /opt/stack/data/nova/instances/e122638a-a52a-445b-a79e-91c76dc94a64/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:13:55 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:13:55 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Ensure instance console log exists: /opt/stack/data/nova/instances/e122638a-a52a-445b-a79e-91c76dc94a64/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:13:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:13:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:13:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:13:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.network.neutron [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Successfully updated port: 1713fd8b-927a-4698-9013-7eebf0815bf8 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Acquiring lock "refresh_cache-e122638a-a52a-445b-a79e-91c76dc94a64" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Acquired lock "refresh_cache-e122638a-a52a-445b-a79e-91c76dc94a64" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.network.neutron [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-8a095954-2d91-4ff4-94e6-5327ce5a2667 req-31648599-a15d-49bf-95df-90dd960aadee service nova] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Received event network-changed-1713fd8b-927a-4698-9013-7eebf0815bf8 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-8a095954-2d91-4ff4-94e6-5327ce5a2667 req-31648599-a15d-49bf-95df-90dd960aadee service nova] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Refreshing instance network info cache due to event network-changed-1713fd8b-927a-4698-9013-7eebf0815bf8. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8a095954-2d91-4ff4-94e6-5327ce5a2667 req-31648599-a15d-49bf-95df-90dd960aadee service nova] Acquiring lock "refresh_cache-e122638a-a52a-445b-a79e-91c76dc94a64" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.network.neutron [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-929e8845-9c1a-4fff-90e1-a3e0596afbbd req-f2f62713-df3a-4d73-94da-e0c0528b7d94 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Received event network-vif-plugged-b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-929e8845-9c1a-4fff-90e1-a3e0596afbbd req-f2f62713-df3a-4d73-94da-e0c0528b7d94 service nova] Acquiring lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-929e8845-9c1a-4fff-90e1-a3e0596afbbd req-f2f62713-df3a-4d73-94da-e0c0528b7d94 service nova] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-929e8845-9c1a-4fff-90e1-a3e0596afbbd req-f2f62713-df3a-4d73-94da-e0c0528b7d94 service nova] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-929e8845-9c1a-4fff-90e1-a3e0596afbbd req-f2f62713-df3a-4d73-94da-e0c0528b7d94 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] No waiting events found dispatching network-vif-plugged-b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:13:56 user nova-compute[75745]: WARNING nova.compute.manager [req-929e8845-9c1a-4fff-90e1-a3e0596afbbd req-f2f62713-df3a-4d73-94da-e0c0528b7d94 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Received unexpected event network-vif-plugged-b4990a3b-371a-44eb-98d8-685dc63590da for instance with vm_state stopped and task_state powering-on.
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.network.neutron [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Updating instance_info_cache with network_info: [{"id": "1713fd8b-927a-4698-9013-7eebf0815bf8", "address": "fa:16:3e:10:c8:a2", "network": {"id": "3bcde777-87d9-442e-a2ff-85106f3b0299", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1741466836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b88dee991f154d659d74d3dd5be6a231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1713fd8b-92", "ovs_interfaceid": "1713fd8b-927a-4698-9013-7eebf0815bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Releasing lock "refresh_cache-e122638a-a52a-445b-a79e-91c76dc94a64" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.compute.manager [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Instance network_info: |[{"id": "1713fd8b-927a-4698-9013-7eebf0815bf8", "address": "fa:16:3e:10:c8:a2", "network": {"id": "3bcde777-87d9-442e-a2ff-85106f3b0299", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1741466836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b88dee991f154d659d74d3dd5be6a231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1713fd8b-92", "ovs_interfaceid": "1713fd8b-927a-4698-9013-7eebf0815bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8a095954-2d91-4ff4-94e6-5327ce5a2667 req-31648599-a15d-49bf-95df-90dd960aadee service nova] Acquired lock "refresh_cache-e122638a-a52a-445b-a79e-91c76dc94a64" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.network.neutron [req-8a095954-2d91-4ff4-94e6-5327ce5a2667 req-31648599-a15d-49bf-95df-90dd960aadee service nova] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Refreshing network info cache for port 1713fd8b-927a-4698-9013-7eebf0815bf8 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Start _get_guest_xml network_info=[{"id": "1713fd8b-927a-4698-9013-7eebf0815bf8", "address": "fa:16:3e:10:c8:a2", "network": {"id": "3bcde777-87d9-442e-a2ff-85106f3b0299", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1741466836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b88dee991f154d659d74d3dd5be6a231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1713fd8b-92", "ovs_interfaceid": "1713fd8b-927a-4698-9013-7eebf0815bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:13:56 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:13:56 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:13:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-251859014',display_name='tempest-VolumesActionsTest-instance-251859014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-251859014',id=21,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b88dee991f154d659d74d3dd5be6a231',ramdisk_id='',reservation_id='r-3ccxqozt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1774873278',owner_user_name='tempest-VolumesActionsTest-1774873278-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:13:55Z,user_data=None,user_id='52fef9da772c4f8ba9f4be1b168ad305',uuid=e122638a-a52a-445b-a79e-91c76dc94a64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1713fd8b-927a-4698-9013-7eebf0815bf8", "address": "fa:16:3e:10:c8:a2", "network": {"id": "3bcde777-87d9-442e-a2ff-85106f3b0299", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1741466836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b88dee991f154d659d74d3dd5be6a231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1713fd8b-92", "ovs_interfaceid": "1713fd8b-927a-4698-9013-7eebf0815bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Converting VIF {"id": "1713fd8b-927a-4698-9013-7eebf0815bf8", "address": "fa:16:3e:10:c8:a2", "network": {"id": "3bcde777-87d9-442e-a2ff-85106f3b0299", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1741466836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b88dee991f154d659d74d3dd5be6a231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1713fd8b-92", "ovs_interfaceid": "1713fd8b-927a-4698-9013-7eebf0815bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:c8:a2,bridge_name='br-int',has_traffic_filtering=True,id=1713fd8b-927a-4698-9013-7eebf0815bf8,network=Network(3bcde777-87d9-442e-a2ff-85106f3b0299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1713fd8b-92') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.objects.instance [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Lazy-loading 'pci_devices' on Instance uuid e122638a-a52a-445b-a79e-91c76dc94a64 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:13:56 user nova-compute[75745]:   <uuid>e122638a-a52a-445b-a79e-91c76dc94a64</uuid>
Dec 01 17:13:56 user nova-compute[75745]:   <name>instance-00000015</name>
Dec 01 17:13:56 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:13:56 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:13:56 user nova-compute[75745]:   <metadata>
Dec 01 17:13:56 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:13:56 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:13:56 user nova-compute[75745]:       <nova:name>tempest-VolumesActionsTest-instance-251859014</nova:name>
Dec 01 17:13:56 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:13:56</nova:creationTime>
Dec 01 17:13:56 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:13:56 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:13:56 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:13:56 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:13:56 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:13:56 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:13:56 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:13:56 user nova-compute[75745]:       <nova:owner>
Dec 01 17:13:56 user nova-compute[75745]:         <nova:user uuid="52fef9da772c4f8ba9f4be1b168ad305">tempest-VolumesActionsTest-1774873278-project-member</nova:user>
Dec 01 17:13:56 user nova-compute[75745]:         <nova:project uuid="b88dee991f154d659d74d3dd5be6a231">tempest-VolumesActionsTest-1774873278</nova:project>
Dec 01 17:13:56 user nova-compute[75745]:       </nova:owner>
Dec 01 17:13:56 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:13:56 user nova-compute[75745]:       <nova:ports>
Dec 01 17:13:56 user nova-compute[75745]:         <nova:port uuid="1713fd8b-927a-4698-9013-7eebf0815bf8">
Dec 01 17:13:56 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 01 17:13:56 user nova-compute[75745]:         </nova:port>
Dec 01 17:13:56 user nova-compute[75745]:       </nova:ports>
Dec 01 17:13:56 user nova-compute[75745]:     </nova:instance>
Dec 01 17:13:56 user nova-compute[75745]:   </metadata>
Dec 01 17:13:56 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:13:56 user nova-compute[75745]:     <system>
Dec 01 17:13:56 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:13:56 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:13:56 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:13:56 user nova-compute[75745]:       <entry name="serial">e122638a-a52a-445b-a79e-91c76dc94a64</entry>
Dec 01 17:13:56 user nova-compute[75745]:       <entry name="uuid">e122638a-a52a-445b-a79e-91c76dc94a64</entry>
Dec 01 17:13:56 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:13:56 user nova-compute[75745]:     </system>
Dec 01 17:13:56 user nova-compute[75745]:   </sysinfo>
Dec 01 17:13:56 user nova-compute[75745]:   <os>
Dec 01 17:13:56 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:13:56 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:13:56 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:13:56 user nova-compute[75745]:   </os>
Dec 01 17:13:56 user nova-compute[75745]:   <features>
Dec 01 17:13:56 user nova-compute[75745]:     <acpi/>
Dec 01 17:13:56 user nova-compute[75745]:     <apic/>
Dec 01 17:13:56 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:13:56 user nova-compute[75745]:   </features>
Dec 01 17:13:56 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:13:56 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:13:56 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:13:56 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:13:56 user nova-compute[75745]:   </clock>
Dec 01 17:13:56 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:13:56 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:13:56 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:13:56 user nova-compute[75745]:   </cpu>
Dec 01 17:13:56 user nova-compute[75745]:   <devices>
Dec 01 17:13:56 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:13:56 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:13:56 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/e122638a-a52a-445b-a79e-91c76dc94a64/disk"/>
Dec 01 17:13:56 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:13:56 user nova-compute[75745]:     </disk>
Dec 01 17:13:56 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:13:56 user nova-compute[75745]:       <mac address="fa:16:3e:10:c8:a2"/>
Dec 01 17:13:56 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:13:56 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:13:56 user nova-compute[75745]:       <target dev="tap1713fd8b-92"/>
Dec 01 17:13:56 user nova-compute[75745]:     </interface>
Dec 01 17:13:56 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:13:56 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/e122638a-a52a-445b-a79e-91c76dc94a64/console.log" append="off"/>
Dec 01 17:13:56 user nova-compute[75745]:     </serial>
Dec 01 17:13:56 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:13:56 user nova-compute[75745]:     <video>
Dec 01 17:13:56 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:13:56 user nova-compute[75745]:     </video>
Dec 01 17:13:56 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:13:56 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:13:56 user nova-compute[75745]:     </rng>
Dec 01 17:13:56 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:13:56 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:13:56 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:13:56 user nova-compute[75745]:     </memballoon>
Dec 01 17:13:56 user nova-compute[75745]:   </devices>
Dec 01 17:13:56 user nova-compute[75745]: </domain>
Dec 01 17:13:56 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:13:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-251859014',display_name='tempest-VolumesActionsTest-instance-251859014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-251859014',id=21,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b88dee991f154d659d74d3dd5be6a231',ramdisk_id='',reservation_id='r-3ccxqozt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1774873278',owner_user_name='tempest-VolumesActionsTest-1774873278-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:13:55Z,user_data=None,user_id='52fef9da772c4f8ba9f4be1b168ad305',uuid=e122638a-a52a-445b-a79e-91c76dc94a64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1713fd8b-927a-4698-9013-7eebf0815bf8", "address": "fa:16:3e:10:c8:a2", "network": {"id": "3bcde777-87d9-442e-a2ff-85106f3b0299", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1741466836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b88dee991f154d659d74d3dd5be6a231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1713fd8b-92", "ovs_interfaceid": "1713fd8b-927a-4698-9013-7eebf0815bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Converting VIF {"id": "1713fd8b-927a-4698-9013-7eebf0815bf8", "address": "fa:16:3e:10:c8:a2", "network": {"id": "3bcde777-87d9-442e-a2ff-85106f3b0299", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1741466836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b88dee991f154d659d74d3dd5be6a231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1713fd8b-92", "ovs_interfaceid": "1713fd8b-927a-4698-9013-7eebf0815bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:c8:a2,bridge_name='br-int',has_traffic_filtering=True,id=1713fd8b-927a-4698-9013-7eebf0815bf8,network=Network(3bcde777-87d9-442e-a2ff-85106f3b0299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1713fd8b-92') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG os_vif [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:c8:a2,bridge_name='br-int',has_traffic_filtering=True,id=1713fd8b-927a-4698-9013-7eebf0815bf8,network=Network(3bcde777-87d9-442e-a2ff-85106f3b0299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1713fd8b-92') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9c96d839-b0c4-5388-95cf-dbcb214ddbc9', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1713fd8b-92, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1713fd8b-92, col_values=(('qos', UUID('76588ac2-ee0b-4348-86c1-7d4160d6a18e')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1713fd8b-92, col_values=(('external_ids', {'iface-id': '1713fd8b-927a-4698-9013-7eebf0815bf8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:c8:a2', 'vm-uuid': 'e122638a-a52a-445b-a79e-91c76dc94a64'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:56 user nova-compute[75745]: INFO os_vif [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:c8:a2,bridge_name='br-int',has_traffic_filtering=True,id=1713fd8b-927a-4698-9013-7eebf0815bf8,network=Network(3bcde777-87d9-442e-a2ff-85106f3b0299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1713fd8b-92')
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:13:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] No VIF found with MAC fa:16:3e:10:c8:a2, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:13:57 user nova-compute[75745]: DEBUG nova.network.neutron [req-8a095954-2d91-4ff4-94e6-5327ce5a2667 req-31648599-a15d-49bf-95df-90dd960aadee service nova] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Updated VIF entry in instance network info cache for port 1713fd8b-927a-4698-9013-7eebf0815bf8. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:13:57 user nova-compute[75745]: DEBUG nova.network.neutron [req-8a095954-2d91-4ff4-94e6-5327ce5a2667 req-31648599-a15d-49bf-95df-90dd960aadee service nova] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Updating instance_info_cache with network_info: [{"id": "1713fd8b-927a-4698-9013-7eebf0815bf8", "address": "fa:16:3e:10:c8:a2", "network": {"id": "3bcde777-87d9-442e-a2ff-85106f3b0299", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1741466836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b88dee991f154d659d74d3dd5be6a231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1713fd8b-92", "ovs_interfaceid": "1713fd8b-927a-4698-9013-7eebf0815bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:13:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8a095954-2d91-4ff4-94e6-5327ce5a2667 req-31648599-a15d-49bf-95df-90dd960aadee service nova] Releasing lock "refresh_cache-e122638a-a52a-445b-a79e-91c76dc94a64" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:13:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-a555fbca-627e-4e0f-a1f3-3e85fd841a1c req-9bbca609-5104-4028-82bc-12f106a92cdf service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Received event network-vif-plugged-b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:13:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a555fbca-627e-4e0f-a1f3-3e85fd841a1c req-9bbca609-5104-4028-82bc-12f106a92cdf service nova] Acquiring lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:13:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a555fbca-627e-4e0f-a1f3-3e85fd841a1c req-9bbca609-5104-4028-82bc-12f106a92cdf service nova] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:13:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a555fbca-627e-4e0f-a1f3-3e85fd841a1c req-9bbca609-5104-4028-82bc-12f106a92cdf service nova] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:13:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-a555fbca-627e-4e0f-a1f3-3e85fd841a1c req-9bbca609-5104-4028-82bc-12f106a92cdf service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] No waiting events found dispatching network-vif-plugged-b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:13:58 user nova-compute[75745]: WARNING nova.compute.manager [req-a555fbca-627e-4e0f-a1f3-3e85fd841a1c req-9bbca609-5104-4028-82bc-12f106a92cdf service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Received unexpected event network-vif-plugged-b4990a3b-371a-44eb-98d8-685dc63590da for instance with vm_state stopped and task_state powering-on.
Dec 01 17:13:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-6fd086f0-beea-4c7b-b252-1d269c7e479f req-9784441e-5811-49c5-a1a4-8e263bc17cbd service nova] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Received event network-vif-plugged-1713fd8b-927a-4698-9013-7eebf0815bf8 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:13:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6fd086f0-beea-4c7b-b252-1d269c7e479f req-9784441e-5811-49c5-a1a4-8e263bc17cbd service nova] Acquiring lock "e122638a-a52a-445b-a79e-91c76dc94a64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:13:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6fd086f0-beea-4c7b-b252-1d269c7e479f req-9784441e-5811-49c5-a1a4-8e263bc17cbd service nova] Lock "e122638a-a52a-445b-a79e-91c76dc94a64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:13:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6fd086f0-beea-4c7b-b252-1d269c7e479f req-9784441e-5811-49c5-a1a4-8e263bc17cbd service nova] Lock "e122638a-a52a-445b-a79e-91c76dc94a64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:13:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-6fd086f0-beea-4c7b-b252-1d269c7e479f req-9784441e-5811-49c5-a1a4-8e263bc17cbd service nova] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] No waiting events found dispatching network-vif-plugged-1713fd8b-927a-4698-9013-7eebf0815bf8 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:13:58 user nova-compute[75745]: WARNING nova.compute.manager [req-6fd086f0-beea-4c7b-b252-1d269c7e479f req-9784441e-5811-49c5-a1a4-8e263bc17cbd service nova] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Received unexpected event network-vif-plugged-1713fd8b-927a-4698-9013-7eebf0815bf8 for instance with vm_state building and task_state spawning.
Dec 01 17:13:58 user nova-compute[75745]: DEBUG nova.compute.manager [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:13:58 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Instance rebooted successfully.
Dec 01 17:13:58 user nova-compute[75745]: DEBUG nova.compute.manager [None req-cc9d4f5a-a6d3-450b-82f6-6008f0f2a166 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:13:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:13:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:00 user nova-compute[75745]: DEBUG nova.compute.manager [req-1f2e35e4-558d-466a-9c93-5c01b99f053d req-9fb09c9a-1745-4aa1-ace2-8801215297ad service nova] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Received event network-vif-plugged-1713fd8b-927a-4698-9013-7eebf0815bf8 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:14:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1f2e35e4-558d-466a-9c93-5c01b99f053d req-9fb09c9a-1745-4aa1-ace2-8801215297ad service nova] Acquiring lock "e122638a-a52a-445b-a79e-91c76dc94a64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1f2e35e4-558d-466a-9c93-5c01b99f053d req-9fb09c9a-1745-4aa1-ace2-8801215297ad service nova] Lock "e122638a-a52a-445b-a79e-91c76dc94a64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1f2e35e4-558d-466a-9c93-5c01b99f053d req-9fb09c9a-1745-4aa1-ace2-8801215297ad service nova] Lock "e122638a-a52a-445b-a79e-91c76dc94a64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:00 user nova-compute[75745]: DEBUG nova.compute.manager [req-1f2e35e4-558d-466a-9c93-5c01b99f053d req-9fb09c9a-1745-4aa1-ace2-8801215297ad service nova] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] No waiting events found dispatching network-vif-plugged-1713fd8b-927a-4698-9013-7eebf0815bf8 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:14:00 user nova-compute[75745]: WARNING nova.compute.manager [req-1f2e35e4-558d-466a-9c93-5c01b99f053d req-9fb09c9a-1745-4aa1-ace2-8801215297ad service nova] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Received unexpected event network-vif-plugged-1713fd8b-927a-4698-9013-7eebf0815bf8 for instance with vm_state building and task_state spawning.
Dec 01 17:14:00 user nova-compute[75745]: DEBUG nova.compute.manager [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:14:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:14:00 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Instance spawned successfully.
Dec 01 17:14:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:14:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:14:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:14:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:14:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:14:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:14:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:14:01 user nova-compute[75745]: INFO nova.compute.manager [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Took 6.10 seconds to spawn the instance on the hypervisor.
Dec 01 17:14:01 user nova-compute[75745]: DEBUG nova.compute.manager [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:14:01 user nova-compute[75745]: INFO nova.compute.manager [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Took 7.00 seconds to build instance.
Dec 01 17:14:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a80e7994-cdcc-4ab6-a0ce-c4b4d82af8ee tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Lock "e122638a-a52a-445b-a79e-91c76dc94a64" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.122s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:03 user nova-compute[75745]: DEBUG nova.compute.manager [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:14:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:04 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:14:04 user nova-compute[75745]: INFO nova.compute.claims [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Claim successful on node user
Dec 01 17:14:04 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:14:04 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:14:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.507s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:04 user nova-compute[75745]: DEBUG nova.compute.manager [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:14:04 user nova-compute[75745]: DEBUG nova.compute.manager [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:14:04 user nova-compute[75745]: DEBUG nova.network.neutron [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:14:04 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:14:04 user nova-compute[75745]: DEBUG nova.compute.manager [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:14:04 user nova-compute[75745]: DEBUG nova.policy [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7bd90117cc3c433d953b7e0de3718f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542114c14774241bb138dfafe3441ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:14:05 user nova-compute[75745]: DEBUG nova.compute.manager [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:14:05 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:14:05 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Creating image(s)
Dec 01 17:14:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "/opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "/opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "80962f79-dbb2-4380-b2c8-791642cfa86b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "80962f79-dbb2-4380-b2c8-791642cfa86b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:05 user nova-compute[75745]: DEBUG nova.compute.manager [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:14:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.286s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:05 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:14:05 user nova-compute[75745]: INFO nova.compute.claims [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Claim successful on node user
Dec 01 17:14:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.222s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:05 user nova-compute[75745]: DEBUG nova.network.neutron [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Successfully created port: ebf45b7a-1ee5-43d6-9940-0ca049c95d71 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:14:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk 1073741824" returned: 0 in 0.088s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.243s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:05 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:14:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:06 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:06 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Cannot resize image /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:14:06 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:14:06 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Ensure instance console log exists: /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:14:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:06 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:14:06 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:14:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.894s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:06 user nova-compute[75745]: DEBUG nova.compute.manager [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:14:06 user nova-compute[75745]: DEBUG nova.compute.manager [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:14:06 user nova-compute[75745]: DEBUG nova.network.neutron [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:14:06 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:14:06 user nova-compute[75745]: DEBUG nova.compute.manager [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:14:06 user nova-compute[75745]: DEBUG nova.policy [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7bd90117cc3c433d953b7e0de3718f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542114c14774241bb138dfafe3441ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:14:06 user nova-compute[75745]: DEBUG nova.network.neutron [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Successfully updated port: ebf45b7a-1ee5-43d6-9940-0ca049c95d71 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:14:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "refresh_cache-e4ffb96e-456c-4fb9-9850-9e98310d63e5" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:14:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquired lock "refresh_cache-e4ffb96e-456c-4fb9-9850-9e98310d63e5" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:14:06 user nova-compute[75745]: DEBUG nova.network.neutron [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:14:06 user nova-compute[75745]: DEBUG nova.compute.manager [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:14:06 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:14:06 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Creating image(s)
Dec 01 17:14:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "/opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "/opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "/opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:06 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:06 user nova-compute[75745]: DEBUG nova.compute.manager [req-7825ac08-bbe4-4783-86ad-f06c9e828f66 req-6ee5acd5-fbe8-40eb-b44a-68c3cbbc8f22 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Received event network-changed-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:14:06 user nova-compute[75745]: DEBUG nova.compute.manager [req-7825ac08-bbe4-4783-86ad-f06c9e828f66 req-6ee5acd5-fbe8-40eb-b44a-68c3cbbc8f22 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Refreshing instance network info cache due to event network-changed-ebf45b7a-1ee5-43d6-9940-0ca049c95d71. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:14:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7825ac08-bbe4-4783-86ad-f06c9e828f66 req-6ee5acd5-fbe8-40eb-b44a-68c3cbbc8f22 service nova] Acquiring lock "refresh_cache-e4ffb96e-456c-4fb9-9850-9e98310d63e5" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:14:06 user nova-compute[75745]: DEBUG nova.network.neutron [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:14:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:06 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.185s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:06 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.220s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.network.neutron [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Updating instance_info_cache with network_info: [{"id": "ebf45b7a-1ee5-43d6-9940-0ca049c95d71", "address": "fa:16:3e:39:c0:e3", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf45b7a-1e", "ovs_interfaceid": "ebf45b7a-1ee5-43d6-9940-0ca049c95d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk 1073741824" returned: 0 in 0.064s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Releasing lock "refresh_cache-e4ffb96e-456c-4fb9-9850-9e98310d63e5" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.compute.manager [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Instance network_info: |[{"id": "ebf45b7a-1ee5-43d6-9940-0ca049c95d71", "address": "fa:16:3e:39:c0:e3", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf45b7a-1e", "ovs_interfaceid": "ebf45b7a-1ee5-43d6-9940-0ca049c95d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7825ac08-bbe4-4783-86ad-f06c9e828f66 req-6ee5acd5-fbe8-40eb-b44a-68c3cbbc8f22 service nova] Acquired lock "refresh_cache-e4ffb96e-456c-4fb9-9850-9e98310d63e5" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.network.neutron [req-7825ac08-bbe4-4783-86ad-f06c9e828f66 req-6ee5acd5-fbe8-40eb-b44a-68c3cbbc8f22 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Refreshing network info cache for port ebf45b7a-1ee5-43d6-9940-0ca049c95d71 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Start _get_guest_xml network_info=[{"id": "ebf45b7a-1ee5-43d6-9940-0ca049c95d71", "address": "fa:16:3e:39:c0:e3", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf45b7a-1e", "ovs_interfaceid": "ebf45b7a-1ee5-43d6-9940-0ca049c95d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:14:07 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:14:07 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:14:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-910276691',display_name='tempest-ServerRescueNegativeTestJSON-server-910276691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-910276691',id=22,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4542114c14774241bb138dfafe3441ad',ramdisk_id='',reservation_id='r-px22dfxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1719994145',owner_user_name='tempest-ServerRescueNegativeTestJSON-1719994145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:14:05Z,user_data=None,user_id='7bd90117cc3c433d953b7e0de3718f0d',uuid=e4ffb96e-456c-4fb9-9850-9e98310d63e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebf45b7a-1ee5-43d6-9940-0ca049c95d71", "address": "fa:16:3e:39:c0:e3", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf45b7a-1e", "ovs_interfaceid": "ebf45b7a-1ee5-43d6-9940-0ca049c95d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Converting VIF {"id": "ebf45b7a-1ee5-43d6-9940-0ca049c95d71", "address": "fa:16:3e:39:c0:e3", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf45b7a-1e", "ovs_interfaceid": "ebf45b7a-1ee5-43d6-9940-0ca049c95d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:c0:e3,bridge_name='br-int',has_traffic_filtering=True,id=ebf45b7a-1ee5-43d6-9940-0ca049c95d71,network=Network(fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf45b7a-1e') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.objects.instance [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lazy-loading 'pci_devices' on Instance uuid e4ffb96e-456c-4fb9-9850-9e98310d63e5 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:14:07 user nova-compute[75745]:   <uuid>e4ffb96e-456c-4fb9-9850-9e98310d63e5</uuid>
Dec 01 17:14:07 user nova-compute[75745]:   <name>instance-00000016</name>
Dec 01 17:14:07 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:14:07 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:14:07 user nova-compute[75745]:   <metadata>
Dec 01 17:14:07 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:14:07 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:14:07 user nova-compute[75745]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-910276691</nova:name>
Dec 01 17:14:07 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:14:07</nova:creationTime>
Dec 01 17:14:07 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:14:07 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:14:07 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:14:07 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:14:07 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:14:07 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:14:07 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:14:07 user nova-compute[75745]:       <nova:owner>
Dec 01 17:14:07 user nova-compute[75745]:         <nova:user uuid="7bd90117cc3c433d953b7e0de3718f0d">tempest-ServerRescueNegativeTestJSON-1719994145-project-member</nova:user>
Dec 01 17:14:07 user nova-compute[75745]:         <nova:project uuid="4542114c14774241bb138dfafe3441ad">tempest-ServerRescueNegativeTestJSON-1719994145</nova:project>
Dec 01 17:14:07 user nova-compute[75745]:       </nova:owner>
Dec 01 17:14:07 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:14:07 user nova-compute[75745]:       <nova:ports>
Dec 01 17:14:07 user nova-compute[75745]:         <nova:port uuid="ebf45b7a-1ee5-43d6-9940-0ca049c95d71">
Dec 01 17:14:07 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 01 17:14:07 user nova-compute[75745]:         </nova:port>
Dec 01 17:14:07 user nova-compute[75745]:       </nova:ports>
Dec 01 17:14:07 user nova-compute[75745]:     </nova:instance>
Dec 01 17:14:07 user nova-compute[75745]:   </metadata>
Dec 01 17:14:07 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:14:07 user nova-compute[75745]:     <system>
Dec 01 17:14:07 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:14:07 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:14:07 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:14:07 user nova-compute[75745]:       <entry name="serial">e4ffb96e-456c-4fb9-9850-9e98310d63e5</entry>
Dec 01 17:14:07 user nova-compute[75745]:       <entry name="uuid">e4ffb96e-456c-4fb9-9850-9e98310d63e5</entry>
Dec 01 17:14:07 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:14:07 user nova-compute[75745]:     </system>
Dec 01 17:14:07 user nova-compute[75745]:   </sysinfo>
Dec 01 17:14:07 user nova-compute[75745]:   <os>
Dec 01 17:14:07 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:14:07 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:14:07 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:14:07 user nova-compute[75745]:   </os>
Dec 01 17:14:07 user nova-compute[75745]:   <features>
Dec 01 17:14:07 user nova-compute[75745]:     <acpi/>
Dec 01 17:14:07 user nova-compute[75745]:     <apic/>
Dec 01 17:14:07 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:14:07 user nova-compute[75745]:   </features>
Dec 01 17:14:07 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:14:07 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:14:07 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:14:07 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:14:07 user nova-compute[75745]:   </clock>
Dec 01 17:14:07 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:14:07 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:14:07 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:14:07 user nova-compute[75745]:   </cpu>
Dec 01 17:14:07 user nova-compute[75745]:   <devices>
Dec 01 17:14:07 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:14:07 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:14:07 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk"/>
Dec 01 17:14:07 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:14:07 user nova-compute[75745]:     </disk>
Dec 01 17:14:07 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:14:07 user nova-compute[75745]:       <mac address="fa:16:3e:39:c0:e3"/>
Dec 01 17:14:07 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:14:07 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:14:07 user nova-compute[75745]:       <target dev="tapebf45b7a-1e"/>
Dec 01 17:14:07 user nova-compute[75745]:     </interface>
Dec 01 17:14:07 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:14:07 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/console.log" append="off"/>
Dec 01 17:14:07 user nova-compute[75745]:     </serial>
Dec 01 17:14:07 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:14:07 user nova-compute[75745]:     <video>
Dec 01 17:14:07 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:14:07 user nova-compute[75745]:     </video>
Dec 01 17:14:07 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:14:07 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:14:07 user nova-compute[75745]:     </rng>
Dec 01 17:14:07 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:14:07 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:14:07 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:14:07 user nova-compute[75745]:     </memballoon>
Dec 01 17:14:07 user nova-compute[75745]:   </devices>
Dec 01 17:14:07 user nova-compute[75745]: </domain>
Dec 01 17:14:07 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:14:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-910276691',display_name='tempest-ServerRescueNegativeTestJSON-server-910276691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-910276691',id=22,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4542114c14774241bb138dfafe3441ad',ramdisk_id='',reservation_id='r-px22dfxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1719994145',owner_user_name='tempest-ServerRescueNegativeTestJSON-1719994145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:14:05Z,user_data=None,user_id='7bd90117cc3c433d953b7e0de3718f0d',uuid=e4ffb96e-456c-4fb9-9850-9e98310d63e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebf45b7a-1ee5-43d6-9940-0ca049c95d71", "address": "fa:16:3e:39:c0:e3", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf45b7a-1e", "ovs_interfaceid": "ebf45b7a-1ee5-43d6-9940-0ca049c95d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Converting VIF {"id": "ebf45b7a-1ee5-43d6-9940-0ca049c95d71", "address": "fa:16:3e:39:c0:e3", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf45b7a-1e", "ovs_interfaceid": "ebf45b7a-1ee5-43d6-9940-0ca049c95d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:c0:e3,bridge_name='br-int',has_traffic_filtering=True,id=ebf45b7a-1ee5-43d6-9940-0ca049c95d71,network=Network(fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf45b7a-1e') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG os_vif [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:c0:e3,bridge_name='br-int',has_traffic_filtering=True,id=ebf45b7a-1ee5-43d6-9940-0ca049c95d71,network=Network(fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf45b7a-1e') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '96710c7f-d300-58a4-9125-22381168a7f4', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebf45b7a-1e, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebf45b7a-1e, col_values=(('qos', UUID('8a8911a4-7985-49eb-975d-1502e11f90cb')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebf45b7a-1e, col_values=(('external_ids', {'iface-id': 'ebf45b7a-1ee5-43d6-9940-0ca049c95d71', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:c0:e3', 'vm-uuid': 'e4ffb96e-456c-4fb9-9850-9e98310d63e5'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.199s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Checking if we can resize image /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:14:07 user nova-compute[75745]: INFO os_vif [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:c0:e3,bridge_name='br-int',has_traffic_filtering=True,id=ebf45b7a-1ee5-43d6-9940-0ca049c95d71,network=Network(fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf45b7a-1e')
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] No VIF found with MAC fa:16:3e:39:c0:e3, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.network.neutron [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Successfully created port: 68718048-8e77-438b-a7e0-15675cc9e543 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Cannot resize image /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Ensure instance console log exists: /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.005s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.network.neutron [req-7825ac08-bbe4-4783-86ad-f06c9e828f66 req-6ee5acd5-fbe8-40eb-b44a-68c3cbbc8f22 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Updated VIF entry in instance network info cache for port ebf45b7a-1ee5-43d6-9940-0ca049c95d71. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG nova.network.neutron [req-7825ac08-bbe4-4783-86ad-f06c9e828f66 req-6ee5acd5-fbe8-40eb-b44a-68c3cbbc8f22 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Updating instance_info_cache with network_info: [{"id": "ebf45b7a-1ee5-43d6-9940-0ca049c95d71", "address": "fa:16:3e:39:c0:e3", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf45b7a-1e", "ovs_interfaceid": "ebf45b7a-1ee5-43d6-9940-0ca049c95d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:14:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7825ac08-bbe4-4783-86ad-f06c9e828f66 req-6ee5acd5-fbe8-40eb-b44a-68c3cbbc8f22 service nova] Releasing lock "refresh_cache-e4ffb96e-456c-4fb9-9850-9e98310d63e5" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG nova.network.neutron [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Successfully updated port: 68718048-8e77-438b-a7e0-15675cc9e543 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "refresh_cache-80962f79-dbb2-4380-b2c8-791642cfa86b" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquired lock "refresh_cache-80962f79-dbb2-4380-b2c8-791642cfa86b" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG nova.network.neutron [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG nova.compute.manager [req-bc09e242-71db-4334-b197-28bbaa1d0212 req-9f4a03ce-252f-4778-a8f9-cd3ad07750ef service nova] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Received event network-changed-68718048-8e77-438b-a7e0-15675cc9e543 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG nova.compute.manager [req-bc09e242-71db-4334-b197-28bbaa1d0212 req-9f4a03ce-252f-4778-a8f9-cd3ad07750ef service nova] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Refreshing instance network info cache due to event network-changed-68718048-8e77-438b-a7e0-15675cc9e543. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-bc09e242-71db-4334-b197-28bbaa1d0212 req-9f4a03ce-252f-4778-a8f9-cd3ad07750ef service nova] Acquiring lock "refresh_cache-80962f79-dbb2-4380-b2c8-791642cfa86b" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG nova.network.neutron [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG nova.network.neutron [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Updating instance_info_cache with network_info: [{"id": "68718048-8e77-438b-a7e0-15675cc9e543", "address": "fa:16:3e:bf:09:08", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68718048-8e", "ovs_interfaceid": "68718048-8e77-438b-a7e0-15675cc9e543", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Releasing lock "refresh_cache-80962f79-dbb2-4380-b2c8-791642cfa86b" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG nova.compute.manager [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Instance network_info: |[{"id": "68718048-8e77-438b-a7e0-15675cc9e543", "address": "fa:16:3e:bf:09:08", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68718048-8e", "ovs_interfaceid": "68718048-8e77-438b-a7e0-15675cc9e543", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-bc09e242-71db-4334-b197-28bbaa1d0212 req-9f4a03ce-252f-4778-a8f9-cd3ad07750ef service nova] Acquired lock "refresh_cache-80962f79-dbb2-4380-b2c8-791642cfa86b" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG nova.network.neutron [req-bc09e242-71db-4334-b197-28bbaa1d0212 req-9f4a03ce-252f-4778-a8f9-cd3ad07750ef service nova] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Refreshing network info cache for port 68718048-8e77-438b-a7e0-15675cc9e543 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Start _get_guest_xml network_info=[{"id": "68718048-8e77-438b-a7e0-15675cc9e543", "address": "fa:16:3e:bf:09:08", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68718048-8e", "ovs_interfaceid": "68718048-8e77-438b-a7e0-15675cc9e543", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:14:08 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:14:08 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:14:08 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:14:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1242750524',display_name='tempest-ServerRescueNegativeTestJSON-server-1242750524',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1242750524',id=23,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4542114c14774241bb138dfafe3441ad',ramdisk_id='',reservation_id='r-6q139kig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1719994145',owner_user_name='tempest-ServerRescueNegativeTestJSON-1719994145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:14:06Z,user_data=None,user_id='7bd90117cc3c433d953b7e0de3718f0d',uuid=80962f79-dbb2-4380-b2c8-791642cfa86b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68718048-8e77-438b-a7e0-15675cc9e543", "address": "fa:16:3e:bf:09:08", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68718048-8e", "ovs_interfaceid": "68718048-8e77-438b-a7e0-15675cc9e543", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Converting VIF {"id": "68718048-8e77-438b-a7e0-15675cc9e543", "address": "fa:16:3e:bf:09:08", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68718048-8e", "ovs_interfaceid": "68718048-8e77-438b-a7e0-15675cc9e543", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:09:08,bridge_name='br-int',has_traffic_filtering=True,id=68718048-8e77-438b-a7e0-15675cc9e543,network=Network(fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68718048-8e') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG nova.objects.instance [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lazy-loading 'pci_devices' on Instance uuid 80962f79-dbb2-4380-b2c8-791642cfa86b {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:14:08 user nova-compute[75745]:   <uuid>80962f79-dbb2-4380-b2c8-791642cfa86b</uuid>
Dec 01 17:14:08 user nova-compute[75745]:   <name>instance-00000017</name>
Dec 01 17:14:08 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:14:08 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:14:08 user nova-compute[75745]:   <metadata>
Dec 01 17:14:08 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:14:08 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:14:08 user nova-compute[75745]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1242750524</nova:name>
Dec 01 17:14:08 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:14:08</nova:creationTime>
Dec 01 17:14:08 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:14:08 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:14:08 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:14:08 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:14:08 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:14:08 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:14:08 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:14:08 user nova-compute[75745]:       <nova:owner>
Dec 01 17:14:08 user nova-compute[75745]:         <nova:user uuid="7bd90117cc3c433d953b7e0de3718f0d">tempest-ServerRescueNegativeTestJSON-1719994145-project-member</nova:user>
Dec 01 17:14:08 user nova-compute[75745]:         <nova:project uuid="4542114c14774241bb138dfafe3441ad">tempest-ServerRescueNegativeTestJSON-1719994145</nova:project>
Dec 01 17:14:08 user nova-compute[75745]:       </nova:owner>
Dec 01 17:14:08 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:14:08 user nova-compute[75745]:       <nova:ports>
Dec 01 17:14:08 user nova-compute[75745]:         <nova:port uuid="68718048-8e77-438b-a7e0-15675cc9e543">
Dec 01 17:14:08 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 01 17:14:08 user nova-compute[75745]:         </nova:port>
Dec 01 17:14:08 user nova-compute[75745]:       </nova:ports>
Dec 01 17:14:08 user nova-compute[75745]:     </nova:instance>
Dec 01 17:14:08 user nova-compute[75745]:   </metadata>
Dec 01 17:14:08 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:14:08 user nova-compute[75745]:     <system>
Dec 01 17:14:08 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:14:08 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:14:08 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:14:08 user nova-compute[75745]:       <entry name="serial">80962f79-dbb2-4380-b2c8-791642cfa86b</entry>
Dec 01 17:14:08 user nova-compute[75745]:       <entry name="uuid">80962f79-dbb2-4380-b2c8-791642cfa86b</entry>
Dec 01 17:14:08 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:14:08 user nova-compute[75745]:     </system>
Dec 01 17:14:08 user nova-compute[75745]:   </sysinfo>
Dec 01 17:14:08 user nova-compute[75745]:   <os>
Dec 01 17:14:08 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:14:08 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:14:08 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:14:08 user nova-compute[75745]:   </os>
Dec 01 17:14:08 user nova-compute[75745]:   <features>
Dec 01 17:14:08 user nova-compute[75745]:     <acpi/>
Dec 01 17:14:08 user nova-compute[75745]:     <apic/>
Dec 01 17:14:08 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:14:08 user nova-compute[75745]:   </features>
Dec 01 17:14:08 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:14:08 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:14:08 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:14:08 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:14:08 user nova-compute[75745]:   </clock>
Dec 01 17:14:08 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:14:08 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:14:08 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:14:08 user nova-compute[75745]:   </cpu>
Dec 01 17:14:08 user nova-compute[75745]:   <devices>
Dec 01 17:14:08 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:14:08 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:14:08 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk"/>
Dec 01 17:14:08 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:14:08 user nova-compute[75745]:     </disk>
Dec 01 17:14:08 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:14:08 user nova-compute[75745]:       <mac address="fa:16:3e:bf:09:08"/>
Dec 01 17:14:08 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:14:08 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:14:08 user nova-compute[75745]:       <target dev="tap68718048-8e"/>
Dec 01 17:14:08 user nova-compute[75745]:     </interface>
Dec 01 17:14:08 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:14:08 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/console.log" append="off"/>
Dec 01 17:14:08 user nova-compute[75745]:     </serial>
Dec 01 17:14:08 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:14:08 user nova-compute[75745]:     <video>
Dec 01 17:14:08 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:14:08 user nova-compute[75745]:     </video>
Dec 01 17:14:08 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:14:08 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:14:08 user nova-compute[75745]:     </rng>
Dec 01 17:14:08 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:14:08 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:14:08 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:14:08 user nova-compute[75745]:     </memballoon>
Dec 01 17:14:08 user nova-compute[75745]:   </devices>
Dec 01 17:14:08 user nova-compute[75745]: </domain>
Dec 01 17:14:08 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:14:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1242750524',display_name='tempest-ServerRescueNegativeTestJSON-server-1242750524',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1242750524',id=23,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4542114c14774241bb138dfafe3441ad',ramdisk_id='',reservation_id='r-6q139kig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1719994145',owner_user_name='tempest-ServerRescueNegativeTestJSON-1719994145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:14:06Z,user_data=None,user_id='7bd90117cc3c433d953b7e0de3718f0d',uuid=80962f79-dbb2-4380-b2c8-791642cfa86b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68718048-8e77-438b-a7e0-15675cc9e543", "address": "fa:16:3e:bf:09:08", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68718048-8e", "ovs_interfaceid": "68718048-8e77-438b-a7e0-15675cc9e543", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Converting VIF {"id": "68718048-8e77-438b-a7e0-15675cc9e543", "address": "fa:16:3e:bf:09:08", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68718048-8e", "ovs_interfaceid": "68718048-8e77-438b-a7e0-15675cc9e543", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:09:08,bridge_name='br-int',has_traffic_filtering=True,id=68718048-8e77-438b-a7e0-15675cc9e543,network=Network(fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68718048-8e') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG os_vif [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:09:08,bridge_name='br-int',has_traffic_filtering=True,id=68718048-8e77-438b-a7e0-15675cc9e543,network=Network(fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68718048-8e') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3c946e40-571d-5b1c-9f63-6b3ae83867ed', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68718048-8e, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap68718048-8e, col_values=(('qos', UUID('fe63ba27-1e53-48a6-a4c6-361156613011')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap68718048-8e, col_values=(('external_ids', {'iface-id': '68718048-8e77-438b-a7e0-15675cc9e543', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:09:08', 'vm-uuid': '80962f79-dbb2-4380-b2c8-791642cfa86b'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:14:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:14:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:09 user nova-compute[75745]: INFO os_vif [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:09:08,bridge_name='br-int',has_traffic_filtering=True,id=68718048-8e77-438b-a7e0-15675cc9e543,network=Network(fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68718048-8e')
Dec 01 17:14:09 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:14:09 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] No VIF found with MAC fa:16:3e:bf:09:08, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:14:09 user nova-compute[75745]: DEBUG nova.network.neutron [req-bc09e242-71db-4334-b197-28bbaa1d0212 req-9f4a03ce-252f-4778-a8f9-cd3ad07750ef service nova] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Updated VIF entry in instance network info cache for port 68718048-8e77-438b-a7e0-15675cc9e543. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:14:09 user nova-compute[75745]: DEBUG nova.network.neutron [req-bc09e242-71db-4334-b197-28bbaa1d0212 req-9f4a03ce-252f-4778-a8f9-cd3ad07750ef service nova] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Updating instance_info_cache with network_info: [{"id": "68718048-8e77-438b-a7e0-15675cc9e543", "address": "fa:16:3e:bf:09:08", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68718048-8e", "ovs_interfaceid": "68718048-8e77-438b-a7e0-15675cc9e543", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:14:09 user nova-compute[75745]: DEBUG nova.compute.manager [req-1c881955-6dc6-4640-9382-0ea12fb970d4 req-d0ebaefb-a95b-4bb2-9003-fcb9570cce52 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Received event network-vif-plugged-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:14:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1c881955-6dc6-4640-9382-0ea12fb970d4 req-d0ebaefb-a95b-4bb2-9003-fcb9570cce52 service nova] Acquiring lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1c881955-6dc6-4640-9382-0ea12fb970d4 req-d0ebaefb-a95b-4bb2-9003-fcb9570cce52 service nova] Lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1c881955-6dc6-4640-9382-0ea12fb970d4 req-d0ebaefb-a95b-4bb2-9003-fcb9570cce52 service nova] Lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:09 user nova-compute[75745]: DEBUG nova.compute.manager [req-1c881955-6dc6-4640-9382-0ea12fb970d4 req-d0ebaefb-a95b-4bb2-9003-fcb9570cce52 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] No waiting events found dispatching network-vif-plugged-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:14:09 user nova-compute[75745]: WARNING nova.compute.manager [req-1c881955-6dc6-4640-9382-0ea12fb970d4 req-d0ebaefb-a95b-4bb2-9003-fcb9570cce52 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Received unexpected event network-vif-plugged-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 for instance with vm_state building and task_state spawning.
Dec 01 17:14:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-bc09e242-71db-4334-b197-28bbaa1d0212 req-9f4a03ce-252f-4778-a8f9-cd3ad07750ef service nova] Releasing lock "refresh_cache-80962f79-dbb2-4380-b2c8-791642cfa86b" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:14:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:10 user nova-compute[75745]: DEBUG nova.compute.manager [req-a1fa16b4-9bd3-4311-ad5d-77c06fd5b13b req-6991d6bf-af76-417b-b7a2-7cf0edf47927 service nova] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Received event network-vif-plugged-68718048-8e77-438b-a7e0-15675cc9e543 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:14:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a1fa16b4-9bd3-4311-ad5d-77c06fd5b13b req-6991d6bf-af76-417b-b7a2-7cf0edf47927 service nova] Acquiring lock "80962f79-dbb2-4380-b2c8-791642cfa86b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a1fa16b4-9bd3-4311-ad5d-77c06fd5b13b req-6991d6bf-af76-417b-b7a2-7cf0edf47927 service nova] Lock "80962f79-dbb2-4380-b2c8-791642cfa86b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a1fa16b4-9bd3-4311-ad5d-77c06fd5b13b req-6991d6bf-af76-417b-b7a2-7cf0edf47927 service nova] Lock "80962f79-dbb2-4380-b2c8-791642cfa86b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:10 user nova-compute[75745]: DEBUG nova.compute.manager [req-a1fa16b4-9bd3-4311-ad5d-77c06fd5b13b req-6991d6bf-af76-417b-b7a2-7cf0edf47927 service nova] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] No waiting events found dispatching network-vif-plugged-68718048-8e77-438b-a7e0-15675cc9e543 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:14:10 user nova-compute[75745]: WARNING nova.compute.manager [req-a1fa16b4-9bd3-4311-ad5d-77c06fd5b13b req-6991d6bf-af76-417b-b7a2-7cf0edf47927 service nova] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Received unexpected event network-vif-plugged-68718048-8e77-438b-a7e0-15675cc9e543 for instance with vm_state building and task_state spawning.
Dec 01 17:14:11 user nova-compute[75745]: DEBUG nova.compute.manager [req-835298f3-9319-4c4a-844b-8b2d11e9e7a5 req-ce5db08c-7c3b-4df6-b3c6-4ebb5bf788ec service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Received event network-vif-plugged-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:14:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-835298f3-9319-4c4a-844b-8b2d11e9e7a5 req-ce5db08c-7c3b-4df6-b3c6-4ebb5bf788ec service nova] Acquiring lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-835298f3-9319-4c4a-844b-8b2d11e9e7a5 req-ce5db08c-7c3b-4df6-b3c6-4ebb5bf788ec service nova] Lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-835298f3-9319-4c4a-844b-8b2d11e9e7a5 req-ce5db08c-7c3b-4df6-b3c6-4ebb5bf788ec service nova] Lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:11 user nova-compute[75745]: DEBUG nova.compute.manager [req-835298f3-9319-4c4a-844b-8b2d11e9e7a5 req-ce5db08c-7c3b-4df6-b3c6-4ebb5bf788ec service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] No waiting events found dispatching network-vif-plugged-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:14:11 user nova-compute[75745]: WARNING nova.compute.manager [req-835298f3-9319-4c4a-844b-8b2d11e9e7a5 req-ce5db08c-7c3b-4df6-b3c6-4ebb5bf788ec service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Received unexpected event network-vif-plugged-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 for instance with vm_state building and task_state spawning.
Dec 01 17:14:12 user nova-compute[75745]: DEBUG nova.compute.manager [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:14:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:14:12 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Instance spawned successfully.
Dec 01 17:14:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:14:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:14:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:14:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:14:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:14:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:14:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:14:12 user nova-compute[75745]: INFO nova.compute.manager [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Took 7.53 seconds to spawn the instance on the hypervisor.
Dec 01 17:14:12 user nova-compute[75745]: DEBUG nova.compute.manager [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:14:12 user nova-compute[75745]: INFO nova.compute.manager [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Took 8.65 seconds to build instance.
Dec 01 17:14:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-756ccaab-6ef4-41db-a8ad-13e32e2a58d0 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.828s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:12 user nova-compute[75745]: DEBUG nova.compute.manager [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:14:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:14:12 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Instance spawned successfully.
Dec 01 17:14:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:14:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:14:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:14:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:14:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:14:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:14:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:14:12 user nova-compute[75745]: INFO nova.compute.manager [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Took 6.24 seconds to spawn the instance on the hypervisor.
Dec 01 17:14:12 user nova-compute[75745]: DEBUG nova.compute.manager [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:14:12 user nova-compute[75745]: DEBUG nova.compute.manager [req-8e2674a7-7cac-4826-a613-6b83de86613e req-4c5d19d2-2f34-482f-ac0e-3247234c0730 service nova] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Received event network-vif-plugged-68718048-8e77-438b-a7e0-15675cc9e543 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:14:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8e2674a7-7cac-4826-a613-6b83de86613e req-4c5d19d2-2f34-482f-ac0e-3247234c0730 service nova] Acquiring lock "80962f79-dbb2-4380-b2c8-791642cfa86b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8e2674a7-7cac-4826-a613-6b83de86613e req-4c5d19d2-2f34-482f-ac0e-3247234c0730 service nova] Lock "80962f79-dbb2-4380-b2c8-791642cfa86b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8e2674a7-7cac-4826-a613-6b83de86613e req-4c5d19d2-2f34-482f-ac0e-3247234c0730 service nova] Lock "80962f79-dbb2-4380-b2c8-791642cfa86b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:12 user nova-compute[75745]: DEBUG nova.compute.manager [req-8e2674a7-7cac-4826-a613-6b83de86613e req-4c5d19d2-2f34-482f-ac0e-3247234c0730 service nova] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] No waiting events found dispatching network-vif-plugged-68718048-8e77-438b-a7e0-15675cc9e543 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:14:12 user nova-compute[75745]: WARNING nova.compute.manager [req-8e2674a7-7cac-4826-a613-6b83de86613e req-4c5d19d2-2f34-482f-ac0e-3247234c0730 service nova] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Received unexpected event network-vif-plugged-68718048-8e77-438b-a7e0-15675cc9e543 for instance with vm_state building and task_state spawning.
Dec 01 17:14:12 user nova-compute[75745]: INFO nova.compute.manager [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Took 7.67 seconds to build instance.
Dec 01 17:14:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-eb5e9810-b6ff-4781-b8ec-a740b803381c tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "80962f79-dbb2-4380-b2c8-791642cfa86b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.800s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:17 user nova-compute[75745]: DEBUG nova.compute.manager [req-67a8c7d9-7c69-45b6-b66b-4400d8285f47 req-bfa3c51b-7f72-4086-91f7-17a9c592e07f service nova] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Received event network-changed-9b2916b4-ab61-436b-b0a1-1fecb6bee4fa {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:14:17 user nova-compute[75745]: DEBUG nova.compute.manager [req-67a8c7d9-7c69-45b6-b66b-4400d8285f47 req-bfa3c51b-7f72-4086-91f7-17a9c592e07f service nova] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Refreshing instance network info cache due to event network-changed-9b2916b4-ab61-436b-b0a1-1fecb6bee4fa. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:14:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-67a8c7d9-7c69-45b6-b66b-4400d8285f47 req-bfa3c51b-7f72-4086-91f7-17a9c592e07f service nova] Acquiring lock "refresh_cache-06356800-2f67-4c35-9703-a71ca3271693" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:14:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-67a8c7d9-7c69-45b6-b66b-4400d8285f47 req-bfa3c51b-7f72-4086-91f7-17a9c592e07f service nova] Acquired lock "refresh_cache-06356800-2f67-4c35-9703-a71ca3271693" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:14:17 user nova-compute[75745]: DEBUG nova.network.neutron [req-67a8c7d9-7c69-45b6-b66b-4400d8285f47 req-bfa3c51b-7f72-4086-91f7-17a9c592e07f service nova] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Refreshing network info cache for port 9b2916b4-ab61-436b-b0a1-1fecb6bee4fa {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:14:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Acquiring lock "a690fa65-078d-4ffd-bc62-3366aaa3d681" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Lock "a690fa65-078d-4ffd-bc62-3366aaa3d681" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:17 user nova-compute[75745]: DEBUG nova.compute.manager [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:14:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:17 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:14:17 user nova-compute[75745]: INFO nova.compute.claims [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Claim successful on node user
Dec 01 17:14:17 user nova-compute[75745]: DEBUG nova.network.neutron [req-67a8c7d9-7c69-45b6-b66b-4400d8285f47 req-bfa3c51b-7f72-4086-91f7-17a9c592e07f service nova] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Updated VIF entry in instance network info cache for port 9b2916b4-ab61-436b-b0a1-1fecb6bee4fa. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:14:17 user nova-compute[75745]: DEBUG nova.network.neutron [req-67a8c7d9-7c69-45b6-b66b-4400d8285f47 req-bfa3c51b-7f72-4086-91f7-17a9c592e07f service nova] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Updating instance_info_cache with network_info: [{"id": "9b2916b4-ab61-436b-b0a1-1fecb6bee4fa", "address": "fa:16:3e:e1:90:4e", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2916b4-ab", "ovs_interfaceid": "9b2916b4-ab61-436b-b0a1-1fecb6bee4fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:14:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-67a8c7d9-7c69-45b6-b66b-4400d8285f47 req-bfa3c51b-7f72-4086-91f7-17a9c592e07f service nova] Releasing lock "refresh_cache-06356800-2f67-4c35-9703-a71ca3271693" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:14:17 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:14:17 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:14:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:18 user nova-compute[75745]: DEBUG nova.compute.manager [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:14:18 user nova-compute[75745]: DEBUG nova.compute.manager [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:14:18 user nova-compute[75745]: DEBUG nova.network.neutron [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:14:18 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:14:18 user nova-compute[75745]: DEBUG nova.compute.manager [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:14:18 user nova-compute[75745]: DEBUG nova.policy [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8b524e70f3794e81a2111cd12cab9abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0d8924495d400d978d7107a78b3167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:14:18 user nova-compute[75745]: DEBUG nova.compute.manager [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:14:18 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:14:18 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Creating image(s)
Dec 01 17:14:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Acquiring lock "/opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Lock "/opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Lock "/opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.201s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.205s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk 1073741824" returned: 0 in 0.067s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:18 user nova-compute[75745]: DEBUG nova.network.neutron [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Successfully created port: 09c7de0f-2e4a-4fda-993c-bd5f781692eb {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:14:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.213s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:19 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:14:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:19 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Cannot resize image /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:14:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:14:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Ensure instance console log exists: /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:14:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:19 user nova-compute[75745]: DEBUG nova.network.neutron [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Successfully updated port: 09c7de0f-2e4a-4fda-993c-bd5f781692eb {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:14:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Acquiring lock "refresh_cache-a690fa65-078d-4ffd-bc62-3366aaa3d681" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:14:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Acquired lock "refresh_cache-a690fa65-078d-4ffd-bc62-3366aaa3d681" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:14:19 user nova-compute[75745]: DEBUG nova.network.neutron [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:14:19 user nova-compute[75745]: DEBUG nova.compute.manager [req-bf5caad9-f74b-48c6-9024-4a3f9e110dff req-16eef778-ffd1-4e97-9aa6-e32c93366f39 service nova] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Received event network-changed-09c7de0f-2e4a-4fda-993c-bd5f781692eb {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:14:19 user nova-compute[75745]: DEBUG nova.compute.manager [req-bf5caad9-f74b-48c6-9024-4a3f9e110dff req-16eef778-ffd1-4e97-9aa6-e32c93366f39 service nova] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Refreshing instance network info cache due to event network-changed-09c7de0f-2e4a-4fda-993c-bd5f781692eb. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:14:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-bf5caad9-f74b-48c6-9024-4a3f9e110dff req-16eef778-ffd1-4e97-9aa6-e32c93366f39 service nova] Acquiring lock "refresh_cache-a690fa65-078d-4ffd-bc62-3366aaa3d681" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:14:19 user nova-compute[75745]: DEBUG nova.network.neutron [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:14:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Acquiring lock "308f5fad-3a32-4104-b9ec-c51ed08f2a3c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "308f5fad-3a32-4104-b9ec-c51ed08f2a3c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:19 user nova-compute[75745]: DEBUG nova.compute.manager [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.network.neutron [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Updating instance_info_cache with network_info: [{"id": "09c7de0f-2e4a-4fda-993c-bd5f781692eb", "address": "fa:16:3e:38:8b:25", "network": {"id": "3b2feb84-7495-4ea1-8eb4-6fcb4763a75a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1599091175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0d8924495d400d978d7107a78b3167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c7de0f-2e", "ovs_interfaceid": "09c7de0f-2e4a-4fda-993c-bd5f781692eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Releasing lock "refresh_cache-a690fa65-078d-4ffd-bc62-3366aaa3d681" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.compute.manager [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Instance network_info: |[{"id": "09c7de0f-2e4a-4fda-993c-bd5f781692eb", "address": "fa:16:3e:38:8b:25", "network": {"id": "3b2feb84-7495-4ea1-8eb4-6fcb4763a75a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1599091175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0d8924495d400d978d7107a78b3167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c7de0f-2e", "ovs_interfaceid": "09c7de0f-2e4a-4fda-993c-bd5f781692eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-bf5caad9-f74b-48c6-9024-4a3f9e110dff req-16eef778-ffd1-4e97-9aa6-e32c93366f39 service nova] Acquired lock "refresh_cache-a690fa65-078d-4ffd-bc62-3366aaa3d681" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.network.neutron [req-bf5caad9-f74b-48c6-9024-4a3f9e110dff req-16eef778-ffd1-4e97-9aa6-e32c93366f39 service nova] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Refreshing network info cache for port 09c7de0f-2e4a-4fda-993c-bd5f781692eb {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Start _get_guest_xml network_info=[{"id": "09c7de0f-2e4a-4fda-993c-bd5f781692eb", "address": "fa:16:3e:38:8b:25", "network": {"id": "3b2feb84-7495-4ea1-8eb4-6fcb4763a75a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1599091175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0d8924495d400d978d7107a78b3167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c7de0f-2e", "ovs_interfaceid": "09c7de0f-2e4a-4fda-993c-bd5f781692eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:14:20 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:14:20 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:14:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:14:20 user nova-compute[75745]: INFO nova.compute.claims [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Claim successful on node user
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:14:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1430692133',display_name='tempest-ServersNegativeTestJSON-server-1430692133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1430692133',id=24,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d0d8924495d400d978d7107a78b3167',ramdisk_id='',reservation_id='r-lid8m60t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-67621407',owner_user_name='tempest-ServersNegativeTestJSON-67621407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:14:18Z,user_data=None,user_id='8b524e70f3794e81a2111cd12cab9abc',uuid=a690fa65-078d-4ffd-bc62-3366aaa3d681,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09c7de0f-2e4a-4fda-993c-bd5f781692eb", "address": "fa:16:3e:38:8b:25", "network": {"id": "3b2feb84-7495-4ea1-8eb4-6fcb4763a75a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1599091175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0d8924495d400d978d7107a78b3167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c7de0f-2e", "ovs_interfaceid": "09c7de0f-2e4a-4fda-993c-bd5f781692eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Converting VIF {"id": "09c7de0f-2e4a-4fda-993c-bd5f781692eb", "address": "fa:16:3e:38:8b:25", "network": {"id": "3b2feb84-7495-4ea1-8eb4-6fcb4763a75a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1599091175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0d8924495d400d978d7107a78b3167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c7de0f-2e", "ovs_interfaceid": "09c7de0f-2e4a-4fda-993c-bd5f781692eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:8b:25,bridge_name='br-int',has_traffic_filtering=True,id=09c7de0f-2e4a-4fda-993c-bd5f781692eb,network=Network(3b2feb84-7495-4ea1-8eb4-6fcb4763a75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09c7de0f-2e') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.objects.instance [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Lazy-loading 'pci_devices' on Instance uuid a690fa65-078d-4ffd-bc62-3366aaa3d681 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:14:20 user nova-compute[75745]:   <uuid>a690fa65-078d-4ffd-bc62-3366aaa3d681</uuid>
Dec 01 17:14:20 user nova-compute[75745]:   <name>instance-00000018</name>
Dec 01 17:14:20 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:14:20 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:14:20 user nova-compute[75745]:   <metadata>
Dec 01 17:14:20 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:14:20 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:14:20 user nova-compute[75745]:       <nova:name>tempest-ServersNegativeTestJSON-server-1430692133</nova:name>
Dec 01 17:14:20 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:14:20</nova:creationTime>
Dec 01 17:14:20 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:14:20 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:14:20 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:14:20 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:14:20 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:14:20 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:14:20 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:14:20 user nova-compute[75745]:       <nova:owner>
Dec 01 17:14:20 user nova-compute[75745]:         <nova:user uuid="8b524e70f3794e81a2111cd12cab9abc">tempest-ServersNegativeTestJSON-67621407-project-member</nova:user>
Dec 01 17:14:20 user nova-compute[75745]:         <nova:project uuid="8d0d8924495d400d978d7107a78b3167">tempest-ServersNegativeTestJSON-67621407</nova:project>
Dec 01 17:14:20 user nova-compute[75745]:       </nova:owner>
Dec 01 17:14:20 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:14:20 user nova-compute[75745]:       <nova:ports>
Dec 01 17:14:20 user nova-compute[75745]:         <nova:port uuid="09c7de0f-2e4a-4fda-993c-bd5f781692eb">
Dec 01 17:14:20 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 01 17:14:20 user nova-compute[75745]:         </nova:port>
Dec 01 17:14:20 user nova-compute[75745]:       </nova:ports>
Dec 01 17:14:20 user nova-compute[75745]:     </nova:instance>
Dec 01 17:14:20 user nova-compute[75745]:   </metadata>
Dec 01 17:14:20 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:14:20 user nova-compute[75745]:     <system>
Dec 01 17:14:20 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:14:20 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:14:20 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:14:20 user nova-compute[75745]:       <entry name="serial">a690fa65-078d-4ffd-bc62-3366aaa3d681</entry>
Dec 01 17:14:20 user nova-compute[75745]:       <entry name="uuid">a690fa65-078d-4ffd-bc62-3366aaa3d681</entry>
Dec 01 17:14:20 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:14:20 user nova-compute[75745]:     </system>
Dec 01 17:14:20 user nova-compute[75745]:   </sysinfo>
Dec 01 17:14:20 user nova-compute[75745]:   <os>
Dec 01 17:14:20 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:14:20 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:14:20 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:14:20 user nova-compute[75745]:   </os>
Dec 01 17:14:20 user nova-compute[75745]:   <features>
Dec 01 17:14:20 user nova-compute[75745]:     <acpi/>
Dec 01 17:14:20 user nova-compute[75745]:     <apic/>
Dec 01 17:14:20 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:14:20 user nova-compute[75745]:   </features>
Dec 01 17:14:20 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:14:20 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:14:20 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:14:20 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:14:20 user nova-compute[75745]:   </clock>
Dec 01 17:14:20 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:14:20 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:14:20 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:14:20 user nova-compute[75745]:   </cpu>
Dec 01 17:14:20 user nova-compute[75745]:   <devices>
Dec 01 17:14:20 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:14:20 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:14:20 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk"/>
Dec 01 17:14:20 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:14:20 user nova-compute[75745]:     </disk>
Dec 01 17:14:20 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:14:20 user nova-compute[75745]:       <mac address="fa:16:3e:38:8b:25"/>
Dec 01 17:14:20 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:14:20 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:14:20 user nova-compute[75745]:       <target dev="tap09c7de0f-2e"/>
Dec 01 17:14:20 user nova-compute[75745]:     </interface>
Dec 01 17:14:20 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:14:20 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/console.log" append="off"/>
Dec 01 17:14:20 user nova-compute[75745]:     </serial>
Dec 01 17:14:20 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:14:20 user nova-compute[75745]:     <video>
Dec 01 17:14:20 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:14:20 user nova-compute[75745]:     </video>
Dec 01 17:14:20 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:14:20 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:14:20 user nova-compute[75745]:     </rng>
Dec 01 17:14:20 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:14:20 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:14:20 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:14:20 user nova-compute[75745]:     </memballoon>
Dec 01 17:14:20 user nova-compute[75745]:   </devices>
Dec 01 17:14:20 user nova-compute[75745]: </domain>
Dec 01 17:14:20 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:14:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1430692133',display_name='tempest-ServersNegativeTestJSON-server-1430692133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1430692133',id=24,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d0d8924495d400d978d7107a78b3167',ramdisk_id='',reservation_id='r-lid8m60t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-67621407',owner_user_name='tempest-ServersNegativeTestJSON-67621407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:14:18Z,user_data=None,user_id='8b524e70f3794e81a2111cd12cab9abc',uuid=a690fa65-078d-4ffd-bc62-3366aaa3d681,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09c7de0f-2e4a-4fda-993c-bd5f781692eb", "address": "fa:16:3e:38:8b:25", "network": {"id": "3b2feb84-7495-4ea1-8eb4-6fcb4763a75a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1599091175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0d8924495d400d978d7107a78b3167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c7de0f-2e", "ovs_interfaceid": "09c7de0f-2e4a-4fda-993c-bd5f781692eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Converting VIF {"id": "09c7de0f-2e4a-4fda-993c-bd5f781692eb", "address": "fa:16:3e:38:8b:25", "network": {"id": "3b2feb84-7495-4ea1-8eb4-6fcb4763a75a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1599091175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0d8924495d400d978d7107a78b3167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c7de0f-2e", "ovs_interfaceid": "09c7de0f-2e4a-4fda-993c-bd5f781692eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:8b:25,bridge_name='br-int',has_traffic_filtering=True,id=09c7de0f-2e4a-4fda-993c-bd5f781692eb,network=Network(3b2feb84-7495-4ea1-8eb4-6fcb4763a75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09c7de0f-2e') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG os_vif [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:8b:25,bridge_name='br-int',has_traffic_filtering=True,id=09c7de0f-2e4a-4fda-993c-bd5f781692eb,network=Network(3b2feb84-7495-4ea1-8eb4-6fcb4763a75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09c7de0f-2e') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f4db1492-d0c9-553a-907f-b553fd55a2ba', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09c7de0f-2e, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap09c7de0f-2e, col_values=(('qos', UUID('90cb2e6e-1eb1-4b55-a240-31d199273026')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap09c7de0f-2e, col_values=(('external_ids', {'iface-id': '09c7de0f-2e4a-4fda-993c-bd5f781692eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:8b:25', 'vm-uuid': 'a690fa65-078d-4ffd-bc62-3366aaa3d681'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:20 user nova-compute[75745]: INFO os_vif [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:8b:25,bridge_name='br-int',has_traffic_filtering=True,id=09c7de0f-2e4a-4fda-993c-bd5f781692eb,network=Network(3b2feb84-7495-4ea1-8eb4-6fcb4763a75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09c7de0f-2e')
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] No VIF found with MAC fa:16:3e:38:8b:25, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.network.neutron [req-bf5caad9-f74b-48c6-9024-4a3f9e110dff req-16eef778-ffd1-4e97-9aa6-e32c93366f39 service nova] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Updated VIF entry in instance network info cache for port 09c7de0f-2e4a-4fda-993c-bd5f781692eb. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.network.neutron [req-bf5caad9-f74b-48c6-9024-4a3f9e110dff req-16eef778-ffd1-4e97-9aa6-e32c93366f39 service nova] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Updating instance_info_cache with network_info: [{"id": "09c7de0f-2e4a-4fda-993c-bd5f781692eb", "address": "fa:16:3e:38:8b:25", "network": {"id": "3b2feb84-7495-4ea1-8eb4-6fcb4763a75a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1599091175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0d8924495d400d978d7107a78b3167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c7de0f-2e", "ovs_interfaceid": "09c7de0f-2e4a-4fda-993c-bd5f781692eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-bf5caad9-f74b-48c6-9024-4a3f9e110dff req-16eef778-ffd1-4e97-9aa6-e32c93366f39 service nova] Releasing lock "refresh_cache-a690fa65-078d-4ffd-bc62-3366aaa3d681" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.505s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.compute.manager [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.compute.manager [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.network.neutron [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:14:20 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.compute.manager [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.policy [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c4522c1762bd4fea8ee7190642b63e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0919015c0904a8481a5297b6aa9af40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.compute.manager [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:14:20 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Creating image(s)
Dec 01 17:14:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Acquiring lock "/opt/stack/data/nova/instances/308f5fad-3a32-4104-b9ec-c51ed08f2a3c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "/opt/stack/data/nova/instances/308f5fad-3a32-4104-b9ec-c51ed08f2a3c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "/opt/stack/data/nova/instances/308f5fad-3a32-4104-b9ec-c51ed08f2a3c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.191s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "06356800-2f67-4c35-9703-a71ca3271693" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "06356800-2f67-4c35-9703-a71ca3271693" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG nova.objects.instance [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lazy-loading 'flavor' on Instance uuid 06356800-2f67-4c35-9703-a71ca3271693 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "06356800-2f67-4c35-9703-a71ca3271693" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.180s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/308f5fad-3a32-4104-b9ec-c51ed08f2a3c/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/308f5fad-3a32-4104-b9ec-c51ed08f2a3c/disk 1073741824" returned: 0 in 0.058s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "06356800-2f67-4c35-9703-a71ca3271693" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "06356800-2f67-4c35-9703-a71ca3271693" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:21 user nova-compute[75745]: INFO nova.compute.manager [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Attaching volume 012883a4-d818-43ca-a597-38af6683cef0 to /dev/vdb
Dec 01 17:14:21 user nova-compute[75745]: DEBUG nova.network.neutron [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Successfully created port: 2e05fcb5-20a6-4606-8b27-a1592a9ea51c {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG os_brick.utils [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.182s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Checking if we can resize image /opt/stack/data/nova/instances/308f5fad-3a32-4104-b9ec-c51ed08f2a3c/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/308f5fad-3a32-4104-b9ec-c51ed08f2a3c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[da20e4d0-d2d5-48dd-a604-b3d45911549c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9511ea4f-9ac4-4705-9c07-54074446973c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5823bbcb-8c1d-4fa3-81d5-bf1fdf588f8f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a90174-e0ee-4064-91ae-294d72066626]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:14:21 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:14:21 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f8f7bc-c766-4c23-bc34-4252a99e0e14]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG os_brick.utils [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] <== get_connector_properties: return (197ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Updating existing volume attachment record: f8c2485e-67e1-4009-bc3d-e5a1f21111b8 {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/308f5fad-3a32-4104-b9ec-c51ed08f2a3c/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Cannot resize image /opt/stack/data/nova/instances/308f5fad-3a32-4104-b9ec-c51ed08f2a3c/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Ensure instance console log exists: /opt/stack/data/nova/instances/308f5fad-3a32-4104-b9ec-c51ed08f2a3c/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG nova.compute.manager [req-c1fc6b67-5fe9-4fd8-8882-94db382ad2f3 req-9f051c0c-d95b-494f-89c0-588151bbe5d4 service nova] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Received event network-vif-plugged-09c7de0f-2e4a-4fda-993c-bd5f781692eb {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c1fc6b67-5fe9-4fd8-8882-94db382ad2f3 req-9f051c0c-d95b-494f-89c0-588151bbe5d4 service nova] Acquiring lock "a690fa65-078d-4ffd-bc62-3366aaa3d681-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c1fc6b67-5fe9-4fd8-8882-94db382ad2f3 req-9f051c0c-d95b-494f-89c0-588151bbe5d4 service nova] Lock "a690fa65-078d-4ffd-bc62-3366aaa3d681-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c1fc6b67-5fe9-4fd8-8882-94db382ad2f3 req-9f051c0c-d95b-494f-89c0-588151bbe5d4 service nova] Lock "a690fa65-078d-4ffd-bc62-3366aaa3d681-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG nova.compute.manager [req-c1fc6b67-5fe9-4fd8-8882-94db382ad2f3 req-9f051c0c-d95b-494f-89c0-588151bbe5d4 service nova] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] No waiting events found dispatching network-vif-plugged-09c7de0f-2e4a-4fda-993c-bd5f781692eb {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:14:22 user nova-compute[75745]: WARNING nova.compute.manager [req-c1fc6b67-5fe9-4fd8-8882-94db382ad2f3 req-9f051c0c-d95b-494f-89c0-588151bbe5d4 service nova] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Received unexpected event network-vif-plugged-09c7de0f-2e4a-4fda-993c-bd5f781692eb for instance with vm_state building and task_state spawning.
Dec 01 17:14:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG nova.network.neutron [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Successfully updated port: 2e05fcb5-20a6-4606-8b27-a1592a9ea51c {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Acquiring lock "refresh_cache-308f5fad-3a32-4104-b9ec-c51ed08f2a3c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Acquired lock "refresh_cache-308f5fad-3a32-4104-b9ec-c51ed08f2a3c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG nova.network.neutron [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG nova.network.neutron [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG nova.network.neutron [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Updating instance_info_cache with network_info: [{"id": "2e05fcb5-20a6-4606-8b27-a1592a9ea51c", "address": "fa:16:3e:7c:6d:45", "network": {"id": "b40e2616-f366-491f-a652-c99fc1c6b989", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-538343107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0919015c0904a8481a5297b6aa9af40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e05fcb5-20", "ovs_interfaceid": "2e05fcb5-20a6-4606-8b27-a1592a9ea51c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Releasing lock "refresh_cache-308f5fad-3a32-4104-b9ec-c51ed08f2a3c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG nova.compute.manager [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Instance network_info: |[{"id": "2e05fcb5-20a6-4606-8b27-a1592a9ea51c", "address": "fa:16:3e:7c:6d:45", "network": {"id": "b40e2616-f366-491f-a652-c99fc1c6b989", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-538343107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0919015c0904a8481a5297b6aa9af40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e05fcb5-20", "ovs_interfaceid": "2e05fcb5-20a6-4606-8b27-a1592a9ea51c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Start _get_guest_xml network_info=[{"id": "2e05fcb5-20a6-4606-8b27-a1592a9ea51c", "address": "fa:16:3e:7c:6d:45", "network": {"id": "b40e2616-f366-491f-a652-c99fc1c6b989", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-538343107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0919015c0904a8481a5297b6aa9af40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e05fcb5-20", "ovs_interfaceid": "2e05fcb5-20a6-4606-8b27-a1592a9ea51c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:14:22 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:14:22 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:14:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:14:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1857569411',display_name='tempest-VolumesAdminNegativeTest-server-1857569411',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1857569411',id=25,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0919015c0904a8481a5297b6aa9af40',ramdisk_id='',reservation_id='r-91o1j5n2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-483419746',owner_user_name='tempest-VolumesAdminNegativeTest-483419746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:14:21Z,user_data=None,user_id='c4522c1762bd4fea8ee7190642b63e06',uuid=308f5fad-3a32-4104-b9ec-c51ed08f2a3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e05fcb5-20a6-4606-8b27-a1592a9ea51c", "address": "fa:16:3e:7c:6d:45", "network": {"id": "b40e2616-f366-491f-a652-c99fc1c6b989", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-538343107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0919015c0904a8481a5297b6aa9af40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e05fcb5-20", "ovs_interfaceid": "2e05fcb5-20a6-4606-8b27-a1592a9ea51c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Converting VIF {"id": "2e05fcb5-20a6-4606-8b27-a1592a9ea51c", "address": "fa:16:3e:7c:6d:45", "network": {"id": "b40e2616-f366-491f-a652-c99fc1c6b989", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-538343107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0919015c0904a8481a5297b6aa9af40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e05fcb5-20", "ovs_interfaceid": "2e05fcb5-20a6-4606-8b27-a1592a9ea51c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:6d:45,bridge_name='br-int',has_traffic_filtering=True,id=2e05fcb5-20a6-4606-8b27-a1592a9ea51c,network=Network(b40e2616-f366-491f-a652-c99fc1c6b989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e05fcb5-20') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG nova.objects.instance [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lazy-loading 'pci_devices' on Instance uuid 308f5fad-3a32-4104-b9ec-c51ed08f2a3c {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:14:22 user nova-compute[75745]:   <uuid>308f5fad-3a32-4104-b9ec-c51ed08f2a3c</uuid>
Dec 01 17:14:22 user nova-compute[75745]:   <name>instance-00000019</name>
Dec 01 17:14:22 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:14:22 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:14:22 user nova-compute[75745]:   <metadata>
Dec 01 17:14:22 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:14:22 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:14:22 user nova-compute[75745]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1857569411</nova:name>
Dec 01 17:14:22 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:14:22</nova:creationTime>
Dec 01 17:14:22 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:14:22 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:14:22 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:14:22 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:14:22 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:14:22 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:14:22 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:14:22 user nova-compute[75745]:       <nova:owner>
Dec 01 17:14:22 user nova-compute[75745]:         <nova:user uuid="c4522c1762bd4fea8ee7190642b63e06">tempest-VolumesAdminNegativeTest-483419746-project-member</nova:user>
Dec 01 17:14:22 user nova-compute[75745]:         <nova:project uuid="b0919015c0904a8481a5297b6aa9af40">tempest-VolumesAdminNegativeTest-483419746</nova:project>
Dec 01 17:14:22 user nova-compute[75745]:       </nova:owner>
Dec 01 17:14:22 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:14:22 user nova-compute[75745]:       <nova:ports>
Dec 01 17:14:22 user nova-compute[75745]:         <nova:port uuid="2e05fcb5-20a6-4606-8b27-a1592a9ea51c">
Dec 01 17:14:22 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 01 17:14:22 user nova-compute[75745]:         </nova:port>
Dec 01 17:14:22 user nova-compute[75745]:       </nova:ports>
Dec 01 17:14:22 user nova-compute[75745]:     </nova:instance>
Dec 01 17:14:22 user nova-compute[75745]:   </metadata>
Dec 01 17:14:22 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:14:22 user nova-compute[75745]:     <system>
Dec 01 17:14:22 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:14:22 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:14:22 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:14:22 user nova-compute[75745]:       <entry name="serial">308f5fad-3a32-4104-b9ec-c51ed08f2a3c</entry>
Dec 01 17:14:22 user nova-compute[75745]:       <entry name="uuid">308f5fad-3a32-4104-b9ec-c51ed08f2a3c</entry>
Dec 01 17:14:22 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:14:22 user nova-compute[75745]:     </system>
Dec 01 17:14:22 user nova-compute[75745]:   </sysinfo>
Dec 01 17:14:22 user nova-compute[75745]:   <os>
Dec 01 17:14:22 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:14:22 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:14:22 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:14:22 user nova-compute[75745]:   </os>
Dec 01 17:14:22 user nova-compute[75745]:   <features>
Dec 01 17:14:22 user nova-compute[75745]:     <acpi/>
Dec 01 17:14:22 user nova-compute[75745]:     <apic/>
Dec 01 17:14:22 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:14:22 user nova-compute[75745]:   </features>
Dec 01 17:14:22 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:14:22 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:14:22 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:14:22 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:14:22 user nova-compute[75745]:   </clock>
Dec 01 17:14:22 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:14:22 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:14:22 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:14:22 user nova-compute[75745]:   </cpu>
Dec 01 17:14:22 user nova-compute[75745]:   <devices>
Dec 01 17:14:22 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:14:22 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:14:22 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/308f5fad-3a32-4104-b9ec-c51ed08f2a3c/disk"/>
Dec 01 17:14:22 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:14:22 user nova-compute[75745]:     </disk>
Dec 01 17:14:22 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:14:22 user nova-compute[75745]:       <mac address="fa:16:3e:7c:6d:45"/>
Dec 01 17:14:22 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:14:22 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:14:22 user nova-compute[75745]:       <target dev="tap2e05fcb5-20"/>
Dec 01 17:14:22 user nova-compute[75745]:     </interface>
Dec 01 17:14:22 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:14:22 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/308f5fad-3a32-4104-b9ec-c51ed08f2a3c/console.log" append="off"/>
Dec 01 17:14:22 user nova-compute[75745]:     </serial>
Dec 01 17:14:22 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:14:22 user nova-compute[75745]:     <video>
Dec 01 17:14:22 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:14:22 user nova-compute[75745]:     </video>
Dec 01 17:14:22 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:14:22 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:14:22 user nova-compute[75745]:     </rng>
Dec 01 17:14:22 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:14:22 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:14:22 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:14:22 user nova-compute[75745]:     </memballoon>
Dec 01 17:14:22 user nova-compute[75745]:   </devices>
Dec 01 17:14:22 user nova-compute[75745]: </domain>
Dec 01 17:14:22 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:14:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1857569411',display_name='tempest-VolumesAdminNegativeTest-server-1857569411',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1857569411',id=25,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0919015c0904a8481a5297b6aa9af40',ramdisk_id='',reservation_id='r-91o1j5n2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-483419746',owner_user_name='tempest-VolumesAdminNegativeTest-483419746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:14:21Z,user_data=None,user_id='c4522c1762bd4fea8ee7190642b63e06',uuid=308f5fad-3a32-4104-b9ec-c51ed08f2a3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e05fcb5-20a6-4606-8b27-a1592a9ea51c", "address": "fa:16:3e:7c:6d:45", "network": {"id": "b40e2616-f366-491f-a652-c99fc1c6b989", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-538343107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0919015c0904a8481a5297b6aa9af40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e05fcb5-20", "ovs_interfaceid": "2e05fcb5-20a6-4606-8b27-a1592a9ea51c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Converting VIF {"id": "2e05fcb5-20a6-4606-8b27-a1592a9ea51c", "address": "fa:16:3e:7c:6d:45", "network": {"id": "b40e2616-f366-491f-a652-c99fc1c6b989", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-538343107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0919015c0904a8481a5297b6aa9af40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e05fcb5-20", "ovs_interfaceid": "2e05fcb5-20a6-4606-8b27-a1592a9ea51c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:6d:45,bridge_name='br-int',has_traffic_filtering=True,id=2e05fcb5-20a6-4606-8b27-a1592a9ea51c,network=Network(b40e2616-f366-491f-a652-c99fc1c6b989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e05fcb5-20') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG os_vif [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:6d:45,bridge_name='br-int',has_traffic_filtering=True,id=2e05fcb5-20a6-4606-8b27-a1592a9ea51c,network=Network(b40e2616-f366-491f-a652-c99fc1c6b989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e05fcb5-20') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '55509c8e-638e-5d1e-8654-f12838576a15', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e05fcb5-20, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2e05fcb5-20, col_values=(('qos', UUID('154d4a57-b851-4fba-9523-14c8abc9f87d')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2e05fcb5-20, col_values=(('external_ids', {'iface-id': '2e05fcb5-20a6-4606-8b27-a1592a9ea51c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:6d:45', 'vm-uuid': '308f5fad-3a32-4104-b9ec-c51ed08f2a3c'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:22 user nova-compute[75745]: INFO os_vif [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:6d:45,bridge_name='br-int',has_traffic_filtering=True,id=2e05fcb5-20a6-4606-8b27-a1592a9ea51c,network=Network(b40e2616-f366-491f-a652-c99fc1c6b989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e05fcb5-20')
Dec 01 17:14:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:14:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] No VIF found with MAC fa:16:3e:7c:6d:45, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:14:23 user nova-compute[75745]: DEBUG nova.compute.manager [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:14:23 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:14:23 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Instance spawned successfully.
Dec 01 17:14:23 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:14:23 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:14:23 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:14:23 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:14:23 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:14:23 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:14:23 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:14:24 user nova-compute[75745]: INFO nova.compute.manager [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Took 5.80 seconds to spawn the instance on the hypervisor.
Dec 01 17:14:24 user nova-compute[75745]: DEBUG nova.compute.manager [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:14:24 user nova-compute[75745]: DEBUG nova.compute.manager [req-245844b8-888e-447d-8e9a-d5dfe507bc3e req-7b031d38-266d-4610-9391-95232c3f0d5f service nova] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Received event network-vif-plugged-09c7de0f-2e4a-4fda-993c-bd5f781692eb {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:14:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-245844b8-888e-447d-8e9a-d5dfe507bc3e req-7b031d38-266d-4610-9391-95232c3f0d5f service nova] Acquiring lock "a690fa65-078d-4ffd-bc62-3366aaa3d681-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-245844b8-888e-447d-8e9a-d5dfe507bc3e req-7b031d38-266d-4610-9391-95232c3f0d5f service nova] Lock "a690fa65-078d-4ffd-bc62-3366aaa3d681-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-245844b8-888e-447d-8e9a-d5dfe507bc3e req-7b031d38-266d-4610-9391-95232c3f0d5f service nova] Lock "a690fa65-078d-4ffd-bc62-3366aaa3d681-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:24 user nova-compute[75745]: DEBUG nova.compute.manager [req-245844b8-888e-447d-8e9a-d5dfe507bc3e req-7b031d38-266d-4610-9391-95232c3f0d5f service nova] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] No waiting events found dispatching network-vif-plugged-09c7de0f-2e4a-4fda-993c-bd5f781692eb {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:14:24 user nova-compute[75745]: WARNING nova.compute.manager [req-245844b8-888e-447d-8e9a-d5dfe507bc3e req-7b031d38-266d-4610-9391-95232c3f0d5f service nova] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Received unexpected event network-vif-plugged-09c7de0f-2e4a-4fda-993c-bd5f781692eb for instance with vm_state building and task_state spawning.
Dec 01 17:14:24 user nova-compute[75745]: DEBUG nova.compute.manager [req-245844b8-888e-447d-8e9a-d5dfe507bc3e req-7b031d38-266d-4610-9391-95232c3f0d5f service nova] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Received event network-changed-2e05fcb5-20a6-4606-8b27-a1592a9ea51c {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:14:24 user nova-compute[75745]: DEBUG nova.compute.manager [req-245844b8-888e-447d-8e9a-d5dfe507bc3e req-7b031d38-266d-4610-9391-95232c3f0d5f service nova] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Refreshing instance network info cache due to event network-changed-2e05fcb5-20a6-4606-8b27-a1592a9ea51c. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:14:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-245844b8-888e-447d-8e9a-d5dfe507bc3e req-7b031d38-266d-4610-9391-95232c3f0d5f service nova] Acquiring lock "refresh_cache-308f5fad-3a32-4104-b9ec-c51ed08f2a3c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:14:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-245844b8-888e-447d-8e9a-d5dfe507bc3e req-7b031d38-266d-4610-9391-95232c3f0d5f service nova] Acquired lock "refresh_cache-308f5fad-3a32-4104-b9ec-c51ed08f2a3c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:14:24 user nova-compute[75745]: DEBUG nova.network.neutron [req-245844b8-888e-447d-8e9a-d5dfe507bc3e req-7b031d38-266d-4610-9391-95232c3f0d5f service nova] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Refreshing network info cache for port 2e05fcb5-20a6-4606-8b27-a1592a9ea51c {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:14:24 user nova-compute[75745]: INFO nova.compute.manager [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Took 6.69 seconds to build instance.
Dec 01 17:14:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5dc93866-1403-4783-808b-1c73767e618b tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Lock "a690fa65-078d-4ffd-bc62-3366aaa3d681" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.810s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:24 user nova-compute[75745]: DEBUG nova.compute.manager [req-e6cc8c46-8ca5-49eb-a6c8-44d910639798 req-40249cf4-9663-4dac-9e60-2982983b2ec3 service nova] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Received event network-vif-plugged-2e05fcb5-20a6-4606-8b27-a1592a9ea51c {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:14:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e6cc8c46-8ca5-49eb-a6c8-44d910639798 req-40249cf4-9663-4dac-9e60-2982983b2ec3 service nova] Acquiring lock "308f5fad-3a32-4104-b9ec-c51ed08f2a3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e6cc8c46-8ca5-49eb-a6c8-44d910639798 req-40249cf4-9663-4dac-9e60-2982983b2ec3 service nova] Lock "308f5fad-3a32-4104-b9ec-c51ed08f2a3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e6cc8c46-8ca5-49eb-a6c8-44d910639798 req-40249cf4-9663-4dac-9e60-2982983b2ec3 service nova] Lock "308f5fad-3a32-4104-b9ec-c51ed08f2a3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:24 user nova-compute[75745]: DEBUG nova.compute.manager [req-e6cc8c46-8ca5-49eb-a6c8-44d910639798 req-40249cf4-9663-4dac-9e60-2982983b2ec3 service nova] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] No waiting events found dispatching network-vif-plugged-2e05fcb5-20a6-4606-8b27-a1592a9ea51c {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:14:24 user nova-compute[75745]: WARNING nova.compute.manager [req-e6cc8c46-8ca5-49eb-a6c8-44d910639798 req-40249cf4-9663-4dac-9e60-2982983b2ec3 service nova] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Received unexpected event network-vif-plugged-2e05fcb5-20a6-4606-8b27-a1592a9ea51c for instance with vm_state building and task_state spawning.
Dec 01 17:14:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:24 user nova-compute[75745]: DEBUG nova.network.neutron [req-245844b8-888e-447d-8e9a-d5dfe507bc3e req-7b031d38-266d-4610-9391-95232c3f0d5f service nova] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Updated VIF entry in instance network info cache for port 2e05fcb5-20a6-4606-8b27-a1592a9ea51c. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:14:24 user nova-compute[75745]: DEBUG nova.network.neutron [req-245844b8-888e-447d-8e9a-d5dfe507bc3e req-7b031d38-266d-4610-9391-95232c3f0d5f service nova] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Updating instance_info_cache with network_info: [{"id": "2e05fcb5-20a6-4606-8b27-a1592a9ea51c", "address": "fa:16:3e:7c:6d:45", "network": {"id": "b40e2616-f366-491f-a652-c99fc1c6b989", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-538343107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0919015c0904a8481a5297b6aa9af40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e05fcb5-20", "ovs_interfaceid": "2e05fcb5-20a6-4606-8b27-a1592a9ea51c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:14:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-245844b8-888e-447d-8e9a-d5dfe507bc3e req-7b031d38-266d-4610-9391-95232c3f0d5f service nova] Releasing lock "refresh_cache-308f5fad-3a32-4104-b9ec-c51ed08f2a3c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:14:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:25 user nova-compute[75745]: DEBUG nova.compute.manager [req-fdaf270c-0488-43a6-a407-54e33281c4d4 req-9b02b62e-4325-4cc2-b6d0-e122bb4ee9e9 service nova] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Received event network-changed-030e12c5-9662-4774-a9fc-5073144043f0 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:14:25 user nova-compute[75745]: DEBUG nova.compute.manager [req-fdaf270c-0488-43a6-a407-54e33281c4d4 req-9b02b62e-4325-4cc2-b6d0-e122bb4ee9e9 service nova] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Refreshing instance network info cache due to event network-changed-030e12c5-9662-4774-a9fc-5073144043f0. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:14:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fdaf270c-0488-43a6-a407-54e33281c4d4 req-9b02b62e-4325-4cc2-b6d0-e122bb4ee9e9 service nova] Acquiring lock "refresh_cache-0ab0c115-74aa-4e55-92a3-6fa91ba753e3" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:14:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fdaf270c-0488-43a6-a407-54e33281c4d4 req-9b02b62e-4325-4cc2-b6d0-e122bb4ee9e9 service nova] Acquired lock "refresh_cache-0ab0c115-74aa-4e55-92a3-6fa91ba753e3" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:14:25 user nova-compute[75745]: DEBUG nova.network.neutron [req-fdaf270c-0488-43a6-a407-54e33281c4d4 req-9b02b62e-4325-4cc2-b6d0-e122bb4ee9e9 service nova] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Refreshing network info cache for port 030e12c5-9662-4774-a9fc-5073144043f0 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:14:25 user nova-compute[75745]: DEBUG nova.network.neutron [req-fdaf270c-0488-43a6-a407-54e33281c4d4 req-9b02b62e-4325-4cc2-b6d0-e122bb4ee9e9 service nova] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Updated VIF entry in instance network info cache for port 030e12c5-9662-4774-a9fc-5073144043f0. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:14:25 user nova-compute[75745]: DEBUG nova.network.neutron [req-fdaf270c-0488-43a6-a407-54e33281c4d4 req-9b02b62e-4325-4cc2-b6d0-e122bb4ee9e9 service nova] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Updating instance_info_cache with network_info: [{"id": "030e12c5-9662-4774-a9fc-5073144043f0", "address": "fa:16:3e:f5:29:5f", "network": {"id": "636c0eca-05bf-45a8-a587-9f9a43f430e8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-52821118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f601b29e4ec41cba8048a7c999ccdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030e12c5-96", "ovs_interfaceid": "030e12c5-9662-4774-a9fc-5073144043f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:14:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fdaf270c-0488-43a6-a407-54e33281c4d4 req-9b02b62e-4325-4cc2-b6d0-e122bb4ee9e9 service nova] Releasing lock "refresh_cache-0ab0c115-74aa-4e55-92a3-6fa91ba753e3" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:14:26 user nova-compute[75745]: DEBUG nova.compute.manager [req-2cdc5890-533f-4693-ac82-9c548512031a req-fafb84ce-b4b1-4d22-ad0c-53a395054ac3 service nova] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Received event network-vif-plugged-2e05fcb5-20a6-4606-8b27-a1592a9ea51c {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:14:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2cdc5890-533f-4693-ac82-9c548512031a req-fafb84ce-b4b1-4d22-ad0c-53a395054ac3 service nova] Acquiring lock "308f5fad-3a32-4104-b9ec-c51ed08f2a3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2cdc5890-533f-4693-ac82-9c548512031a req-fafb84ce-b4b1-4d22-ad0c-53a395054ac3 service nova] Lock "308f5fad-3a32-4104-b9ec-c51ed08f2a3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2cdc5890-533f-4693-ac82-9c548512031a req-fafb84ce-b4b1-4d22-ad0c-53a395054ac3 service nova] Lock "308f5fad-3a32-4104-b9ec-c51ed08f2a3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:26 user nova-compute[75745]: DEBUG nova.compute.manager [req-2cdc5890-533f-4693-ac82-9c548512031a req-fafb84ce-b4b1-4d22-ad0c-53a395054ac3 service nova] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] No waiting events found dispatching network-vif-plugged-2e05fcb5-20a6-4606-8b27-a1592a9ea51c {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:14:26 user nova-compute[75745]: WARNING nova.compute.manager [req-2cdc5890-533f-4693-ac82-9c548512031a req-fafb84ce-b4b1-4d22-ad0c-53a395054ac3 service nova] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Received unexpected event network-vif-plugged-2e05fcb5-20a6-4606-8b27-a1592a9ea51c for instance with vm_state building and task_state spawning.
Dec 01 17:14:27 user nova-compute[75745]: DEBUG nova.compute.manager [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:14:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:14:27 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Instance spawned successfully.
Dec 01 17:14:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:14:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:14:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:14:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:14:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:14:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:14:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:14:27 user nova-compute[75745]: INFO nova.compute.manager [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Took 6.39 seconds to spawn the instance on the hypervisor.
Dec 01 17:14:27 user nova-compute[75745]: DEBUG nova.compute.manager [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:14:27 user nova-compute[75745]: INFO nova.compute.manager [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Took 7.34 seconds to build instance.
Dec 01 17:14:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-83f0d7c4-edff-4c2e-bccf-2eff59886e5e tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "308f5fad-3a32-4104-b9ec-c51ed08f2a3c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.433s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:27 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Acquiring lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:29 user nova-compute[75745]: DEBUG nova.objects.instance [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lazy-loading 'flavor' on Instance uuid 0ab0c115-74aa-4e55-92a3-6fa91ba753e3 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:14:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Acquiring lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:29 user nova-compute[75745]: INFO nova.compute.manager [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Attaching volume 8c6993d8-adc8-45b8-ad23-9421af2db707 to /dev/vdb
Dec 01 17:14:29 user nova-compute[75745]: DEBUG os_brick.utils [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:14:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:29 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0bdb85-9544-4fcb-ac32-4fdf0a9b5193]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:29 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee14a55-c869-4b7d-9dae-1b3295b89775]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:29 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5070b9-21ea-438d-8262-3ebe9b82b08e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:29 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52ec7fb-0312-4adc-bd26-645b0408b61b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:14:29 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:14:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:14:29 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:14:29 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd168fc8-a2ac-4b75-a6d4-686a0a876082]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:29 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:14:29 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:14:29 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:14:29 user nova-compute[75745]: DEBUG os_brick.utils [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:14:29 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Updating existing volume attachment record: ba4f485f-753a-4d70-93e5-ff01e8658866 {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipLKvRXJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:14:32 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:14:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:14:32 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:14:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:14:32 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:14:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[304d882c-9812-4e1c-84a6-8eaab586cf80]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:14:32 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56b394e-320b-41ab-a9d9-f578ca9c754e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0] added
Dec 01 17:14:32 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea31591d-71f7-4fce-a25a-696517c3a484]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0135faa-80f8-411e-8cf5-1d5d9d120734]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ipLKvRXJ {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ipLKvRXJ" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af07e30-2827-49e6-b740-389819fa5e99]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ipLKvRXJ'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd57c2f8-a2cb-4a05-99ff-e0aa90992e27]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e7ecf6-63ed-4500-a7c8-be8919069f1e]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:14:32 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:14:32 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4364f34-7bc0-4c6c-aac5-7f289c871b58]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0, portal: 172.16.0.220,3260]
Dec 01 17:14:32 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0, portal: 172.16.0.220,3260] successful.
Dec 01 17:14:32 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d8fdfd-edbb-4934-b491-0f14dc93a8b5]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed38644-be63-4e71-86bb-2ed62ef3fb4f]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:14:32 user nova-compute[75745]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0 (non-flash)
Dec 01 17:14:32 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:14:32 user nova-compute[75745]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0 (non-flash)
Dec 01 17:14:32 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb3b058-97f5-4109-b784-0939c24ed9ae]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: None {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:14:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:33 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:14:33 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipLKvRXJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:14:33 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:14:33 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26464643135363733', 'path': '/dev/sdb'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:14:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464643135363733', 'path': '/dev/sdb'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:14:33 user nova-compute[75745]: DEBUG nova.objects.instance [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lazy-loading 'flavor' on Instance uuid 06356800-2f67-4c35-9703-a71ca3271693 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:14:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 17:14:33 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:14:33 user nova-compute[75745]:   <source dev="/dev/sdb"/>
Dec 01 17:14:33 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:14:33 user nova-compute[75745]:   <serial>012883a4-d818-43ca-a597-38af6683cef0</serial>
Dec 01 17:14:33 user nova-compute[75745]: </disk>
Dec 01 17:14:33 user nova-compute[75745]:  {{(pid=75745) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 17:14:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:14:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:14:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] No VIF found with MAC fa:16:3e:e1:90:4e, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:14:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a317e362-65f6-4ad4-b9f3-2cd9943059da tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "06356800-2f67-4c35-9703-a71ca3271693" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.807s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "06356800-2f67-4c35-9703-a71ca3271693" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "06356800-2f67-4c35-9703-a71ca3271693" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:34 user nova-compute[75745]: INFO nova.compute.manager [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Detaching volume 012883a4-d818-43ca-a597-38af6683cef0
Dec 01 17:14:34 user nova-compute[75745]: INFO nova.virt.block_device [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Attempting to driver detach volume 012883a4-d818-43ca-a597-38af6683cef0 from mountpoint /dev/vdb
Dec 01 17:14:35 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Attempting to detach device vdb from instance 06356800-2f67-4c35-9703-a71ca3271693 from the persistent domain config. {{(pid=75745) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 17:14:35 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:14:35 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:14:35 user nova-compute[75745]:   <source dev="/dev/sdb"/>
Dec 01 17:14:35 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:14:35 user nova-compute[75745]:   <serial>012883a4-d818-43ca-a597-38af6683cef0</serial>
Dec 01 17:14:35 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 17:14:35 user nova-compute[75745]: </disk>
Dec 01 17:14:35 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:14:35 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Successfully detached device vdb from instance 06356800-2f67-4c35-9703-a71ca3271693 from the persistent domain config.
Dec 01 17:14:35 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 06356800-2f67-4c35-9703-a71ca3271693 from the live domain config. {{(pid=75745) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 17:14:35 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:14:35 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:14:35 user nova-compute[75745]:   <source dev="/dev/sdb"/>
Dec 01 17:14:35 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:14:35 user nova-compute[75745]:   <serial>012883a4-d818-43ca-a597-38af6683cef0</serial>
Dec 01 17:14:35 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 17:14:35 user nova-compute[75745]: </disk>
Dec 01 17:14:35 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:14:35 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 06356800-2f67-4c35-9703-a71ca3271693 {{(pid=75745) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 17:14:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PQIUDeYZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:14:39 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:14:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:14:39 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:14:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:14:39 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:14:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[89644648-988e-4e6a-a4ca-004166b18e34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:14:39 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4ab502-e3f5-42ee-b945-29ee2cde514f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707] added
Dec 01 17:14:39 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4143d3-1f10-489e-98e8-77fc6a26eecb]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92c87b1-2f32-4191-b9a7-434ddb2b439d]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PQIUDeYZ {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PQIUDeYZ" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0415b9d6-9a81-4abb-b21a-a9a0bd3c8c38]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PQIUDeYZ'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b5e318-0304-4422-bf99-d84387cb4335]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[540b7406-af96-47ee-b70d-d0ec038c0588]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:14:39 user nova-compute[75745]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0 (non-flash)
Dec 01 17:14:39 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:14:39 user nova-compute[75745]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0 (non-flash)
Dec 01 17:14:39 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf99448-1542-45f7-a7da-2c795df2c941]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707, portal: 172.16.0.220,3260]
Dec 01 17:14:39 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707, portal: 172.16.0.220,3260] successful.
Dec 01 17:14:39 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16c5ad8-926b-4f7d-89fb-35cc7f7c8c93]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[638d50b8-0514-4c9c-bf6d-317212beecbf]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:14:39 user nova-compute[75745]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0 (non-flash)
Dec 01 17:14:39 user nova-compute[75745]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707 (non-flash)
Dec 01 17:14:39 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:14:39 user nova-compute[75745]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0 (non-flash)
Dec 01 17:14:39 user nova-compute[75745]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707 (non-flash)
Dec 01 17:14:39 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7a9c4f-e6cb-49a4-800f-8c787bf7e6be]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: None {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:14:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:40 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:14:40 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PQIUDeYZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:14:40 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:14:40 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23366316635656436', 'path': '/dev/sdd'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:14:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366316635656436', 'path': '/dev/sdd'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:14:40 user nova-compute[75745]: DEBUG nova.objects.instance [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lazy-loading 'flavor' on Instance uuid 0ab0c115-74aa-4e55-92a3-6fa91ba753e3 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:14:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 17:14:40 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:14:40 user nova-compute[75745]:   <source dev="/dev/sdd"/>
Dec 01 17:14:40 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:14:40 user nova-compute[75745]:   <serial>8c6993d8-adc8-45b8-ad23-9421af2db707</serial>
Dec 01 17:14:40 user nova-compute[75745]: </disk>
Dec 01 17:14:40 user nova-compute[75745]:  {{(pid=75745) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 17:14:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:14:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:14:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] No VIF found with MAC fa:16:3e:f5:29:5f, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:14:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f61392dd-6a78-4838-896d-f9ec894c1568 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.436s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:42 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:14:42 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:14:42 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:14:42 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:14:42 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:14:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:44 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:14:45 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:14:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:45 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:14:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e122638a-a52a-445b-a79e-91c76dc94a64/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e122638a-a52a-445b-a79e-91c76dc94a64/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e122638a-a52a-445b-a79e-91c76dc94a64/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e122638a-a52a-445b-a79e-91c76dc94a64/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06356800-2f67-4c35-9703-a71ca3271693/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06356800-2f67-4c35-9703-a71ca3271693/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06356800-2f67-4c35-9703-a71ca3271693/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06356800-2f67-4c35-9703-a71ca3271693/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:49 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:14:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:49 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:14:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/308f5fad-3a32-4104-b9ec-c51ed08f2a3c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/308f5fad-3a32-4104-b9ec-c51ed08f2a3c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/308f5fad-3a32-4104-b9ec-c51ed08f2a3c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/308f5fad-3a32-4104-b9ec-c51ed08f2a3c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:50 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:14:50 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:14:50 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=7113MB free_disk=25.297637939453125GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:14:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:50 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Applying migration context for instance 98b29ba5-9993-4494-b196-f7eea077df7a as it has an incoming, in-progress migration 2cceade1-2602-4b26-8c1c-27cdb0c24750. Migration status is finished {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Dec 01 17:14:50 user nova-compute[75745]: INFO nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Updating resource usage from migration 2cceade1-2602-4b26-8c1c-27cdb0c24750
Dec 01 17:14:50 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 4ac6f586-cc5b-4a3f-b374-4b2006a48427 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:14:50 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance d997cdd6-67c6-4263-814a-17cf9e27bbeb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:14:50 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 3a56aca8-ffbb-450b-a953-fc2071902486 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:14:50 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 06356800-2f67-4c35-9703-a71ca3271693 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:14:50 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 0ab0c115-74aa-4e55-92a3-6fa91ba753e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:14:50 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Migration 2cceade1-2602-4b26-8c1c-27cdb0c24750 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Dec 01 17:14:50 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 98b29ba5-9993-4494-b196-f7eea077df7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:14:50 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance e122638a-a52a-445b-a79e-91c76dc94a64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:14:50 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance e4ffb96e-456c-4fb9-9850-9e98310d63e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:14:50 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 80962f79-dbb2-4380-b2c8-791642cfa86b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:14:50 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance a690fa65-078d-4ffd-bc62-3366aaa3d681 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:14:50 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 308f5fad-3a32-4104-b9ec-c51ed08f2a3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:14:50 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:14:50 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:14:51 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:14:51 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:14:51 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:14:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.590s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:52 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:14:52 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:14:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-d997cdd6-67c6-4263-814a-17cf9e27bbeb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:14:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-d997cdd6-67c6-4263-814a-17cf9e27bbeb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:14:52 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:14:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:53 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Updating instance_info_cache with network_info: [{"id": "9d64a643-0dca-4fe1-8734-9778689292bc", "address": "fa:16:3e:e2:0c:90", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d64a643-0d", "ovs_interfaceid": "9d64a643-0dca-4fe1-8734-9778689292bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:14:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-d997cdd6-67c6-4263-814a-17cf9e27bbeb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:14:53 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:14:53 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:14:53 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:14:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "9aca117f-581a-4625-abf1-c7faba669572" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "9aca117f-581a-4625-abf1-c7faba669572" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:54 user nova-compute[75745]: DEBUG nova.compute.manager [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:14:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:54 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:14:54 user nova-compute[75745]: INFO nova.compute.claims [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Claim successful on node user
Dec 01 17:14:54 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:14:54 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:14:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:54 user nova-compute[75745]: DEBUG nova.compute.manager [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:14:54 user nova-compute[75745]: DEBUG nova.compute.manager [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:14:54 user nova-compute[75745]: DEBUG nova.network.neutron [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:14:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:54 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:14:54 user nova-compute[75745]: DEBUG nova.compute.manager [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:14:54 user nova-compute[75745]: DEBUG nova.policy [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5204ecaa9b354d10bac514c27acbccc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409356993ea442c5abdf4269aebe43ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:14:54 user nova-compute[75745]: DEBUG nova.compute.manager [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:14:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:14:54 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Creating image(s)
Dec 01 17:14:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "/opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "/opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "/opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.184s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.180s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk 1073741824" returned: 0 in 0.047s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG nova.network.neutron [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Successfully created port: 30260fca-fac2-4377-b514-add8784429c4 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.198s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:55 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 06356800-2f67-4c35-9703-a71ca3271693 is timed out.
Dec 01 17:14:55 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Successfully detached device vdb from instance 06356800-2f67-4c35-9703-a71ca3271693 from the live domain config.
Dec 01 17:14:55 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipLKvRXJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:14:55 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:14:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab7d614-2088-4e49-b01a-1e192a7fc6d2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:14:55 user nova-compute[75745]: No targets found.
Dec 01 17:14:55 user nova-compute[75745]: iSNS:
Dec 01 17:14:55 user nova-compute[75745]: No targets found.
Dec 01 17:14:55 user nova-compute[75745]: STATIC:
Dec 01 17:14:55 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0
Dec 01 17:14:55 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:14:55 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:14:55 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0
Dec 01 17:14:55 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:14:55 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:14:55 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707
Dec 01 17:14:55 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:14:55 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:14:55 user nova-compute[75745]: FIRMWARE:
Dec 01 17:14:55 user nova-compute[75745]: No targets found.
Dec 01 17:14:55 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:14:55 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:14:55 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b44c8c-b35b-4385-acb3-652513da1f78]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6719435-756a-4aef-9d28-65eb01e36427]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:14:55 user nova-compute[75745]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0 (non-flash)
Dec 01 17:14:55 user nova-compute[75745]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707 (non-flash)
Dec 01 17:14:55 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:14:55 user nova-compute[75745]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0 (non-flash)
Dec 01 17:14:55 user nova-compute[75745]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707 (non-flash)
Dec 01 17:14:55 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b81f4b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0'): ({'sdb'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Removing single pathed devices sdb {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b99d2d-ca19-48fd-ac35-3e3f58bed4e4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Cannot resize image /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Ensure instance console log exists: /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d155c88-9239-4bd7-a20a-f52d10a62c9d]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Flushing IO for device /dev/sdb {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[286938e4-62b1-4c02-b4d0-593efcf380ac]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[454f7295-1a05-4f4a-80df-6cfcfb3f0b1e]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] SCSI volumes sdb have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[91de4df3-b1fd-40c6-856e-0820fedf901d]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fc0df9-21fb-4b72-9933-6afc5a800f2b]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0, portal: 172.16.0.220,3260]
Dec 01 17:14:55 user nova-compute[75745]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0, portal: 172.16.0.220,3260] successful.
Dec 01 17:14:55 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:012883a4-d818-43ca-a597-38af6683cef0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0ff69e-92f7-411c-9990-2bc3663fdd58]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] <== disconnect_volume: return (331ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:14:55 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.network.neutron [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Successfully updated port: 30260fca-fac2-4377-b514-add8784429c4 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "refresh_cache-9aca117f-581a-4625-abf1-c7faba669572" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquired lock "refresh_cache-9aca117f-581a-4625-abf1-c7faba669572" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.network.neutron [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-dc284675-f419-41d6-b155-591c276583cc req-5d1996a4-e98b-469a-b75c-97b0fd4fda66 service nova] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Received event network-changed-30260fca-fac2-4377-b514-add8784429c4 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-dc284675-f419-41d6-b155-591c276583cc req-5d1996a4-e98b-469a-b75c-97b0fd4fda66 service nova] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Refreshing instance network info cache due to event network-changed-30260fca-fac2-4377-b514-add8784429c4. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-dc284675-f419-41d6-b155-591c276583cc req-5d1996a4-e98b-469a-b75c-97b0fd4fda66 service nova] Acquiring lock "refresh_cache-9aca117f-581a-4625-abf1-c7faba669572" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.network.neutron [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.network.neutron [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Updating instance_info_cache with network_info: [{"id": "30260fca-fac2-4377-b514-add8784429c4", "address": "fa:16:3e:d6:94:e3", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30260fca-fa", "ovs_interfaceid": "30260fca-fac2-4377-b514-add8784429c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Releasing lock "refresh_cache-9aca117f-581a-4625-abf1-c7faba669572" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.compute.manager [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Instance network_info: |[{"id": "30260fca-fac2-4377-b514-add8784429c4", "address": "fa:16:3e:d6:94:e3", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30260fca-fa", "ovs_interfaceid": "30260fca-fac2-4377-b514-add8784429c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-dc284675-f419-41d6-b155-591c276583cc req-5d1996a4-e98b-469a-b75c-97b0fd4fda66 service nova] Acquired lock "refresh_cache-9aca117f-581a-4625-abf1-c7faba669572" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.network.neutron [req-dc284675-f419-41d6-b155-591c276583cc req-5d1996a4-e98b-469a-b75c-97b0fd4fda66 service nova] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Refreshing network info cache for port 30260fca-fac2-4377-b514-add8784429c4 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Start _get_guest_xml network_info=[{"id": "30260fca-fac2-4377-b514-add8784429c4", "address": "fa:16:3e:d6:94:e3", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30260fca-fa", "ovs_interfaceid": "30260fca-fac2-4377-b514-add8784429c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:14:56 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:14:56 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-860674518',display_name='tempest-tempest.common.compute-instance-860674518',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-860674518',id=26,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0VPvubRo9N9hDbGZ7rvBGfNIC49qGsVU6LVqmy/4M0zGXAuWOJcM6VFMASpfTpY2Uok0EIDnJL42vbGcwlx4yY9AlIDoh46ApbqcvwQjSds+Lyv6QMRAVGuNqnSLgdTA==',key_name='tempest-keypair-723015957',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='409356993ea442c5abdf4269aebe43ab',ramdisk_id='',reservation_id='r-9f0md9mc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1500186869',owner_user_name='tempest-ServerActionsTestOtherA-1500186869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:14:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5204ecaa9b354d10bac514c27acbccc6',uuid=9aca117f-581a-4625-abf1-c7faba669572,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30260fca-fac2-4377-b514-add8784429c4", "address": "fa:16:3e:d6:94:e3", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30260fca-fa", "ovs_interfaceid": "30260fca-fac2-4377-b514-add8784429c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Converting VIF {"id": "30260fca-fac2-4377-b514-add8784429c4", "address": "fa:16:3e:d6:94:e3", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30260fca-fa", "ovs_interfaceid": "30260fca-fac2-4377-b514-add8784429c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:94:e3,bridge_name='br-int',has_traffic_filtering=True,id=30260fca-fac2-4377-b514-add8784429c4,network=Network(f7cefc9d-2279-4601-8a81-a640ad1aea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30260fca-fa') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.objects.instance [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lazy-loading 'pci_devices' on Instance uuid 9aca117f-581a-4625-abf1-c7faba669572 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:14:56 user nova-compute[75745]:   <uuid>9aca117f-581a-4625-abf1-c7faba669572</uuid>
Dec 01 17:14:56 user nova-compute[75745]:   <name>instance-0000001a</name>
Dec 01 17:14:56 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:14:56 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:14:56 user nova-compute[75745]:   <metadata>
Dec 01 17:14:56 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:14:56 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:14:56 user nova-compute[75745]:       <nova:name>tempest-tempest.common.compute-instance-860674518</nova:name>
Dec 01 17:14:56 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:14:56</nova:creationTime>
Dec 01 17:14:56 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:14:56 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:14:56 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:14:56 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:14:56 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:14:56 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:14:56 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:14:56 user nova-compute[75745]:       <nova:owner>
Dec 01 17:14:56 user nova-compute[75745]:         <nova:user uuid="5204ecaa9b354d10bac514c27acbccc6">tempest-ServerActionsTestOtherA-1500186869-project-member</nova:user>
Dec 01 17:14:56 user nova-compute[75745]:         <nova:project uuid="409356993ea442c5abdf4269aebe43ab">tempest-ServerActionsTestOtherA-1500186869</nova:project>
Dec 01 17:14:56 user nova-compute[75745]:       </nova:owner>
Dec 01 17:14:56 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:14:56 user nova-compute[75745]:       <nova:ports>
Dec 01 17:14:56 user nova-compute[75745]:         <nova:port uuid="30260fca-fac2-4377-b514-add8784429c4">
Dec 01 17:14:56 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 01 17:14:56 user nova-compute[75745]:         </nova:port>
Dec 01 17:14:56 user nova-compute[75745]:       </nova:ports>
Dec 01 17:14:56 user nova-compute[75745]:     </nova:instance>
Dec 01 17:14:56 user nova-compute[75745]:   </metadata>
Dec 01 17:14:56 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:14:56 user nova-compute[75745]:     <system>
Dec 01 17:14:56 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:14:56 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:14:56 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:14:56 user nova-compute[75745]:       <entry name="serial">9aca117f-581a-4625-abf1-c7faba669572</entry>
Dec 01 17:14:56 user nova-compute[75745]:       <entry name="uuid">9aca117f-581a-4625-abf1-c7faba669572</entry>
Dec 01 17:14:56 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:14:56 user nova-compute[75745]:     </system>
Dec 01 17:14:56 user nova-compute[75745]:   </sysinfo>
Dec 01 17:14:56 user nova-compute[75745]:   <os>
Dec 01 17:14:56 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:14:56 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:14:56 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:14:56 user nova-compute[75745]:   </os>
Dec 01 17:14:56 user nova-compute[75745]:   <features>
Dec 01 17:14:56 user nova-compute[75745]:     <acpi/>
Dec 01 17:14:56 user nova-compute[75745]:     <apic/>
Dec 01 17:14:56 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:14:56 user nova-compute[75745]:   </features>
Dec 01 17:14:56 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:14:56 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:14:56 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:14:56 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:14:56 user nova-compute[75745]:   </clock>
Dec 01 17:14:56 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:14:56 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:14:56 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:14:56 user nova-compute[75745]:   </cpu>
Dec 01 17:14:56 user nova-compute[75745]:   <devices>
Dec 01 17:14:56 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:14:56 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:14:56 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk"/>
Dec 01 17:14:56 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:14:56 user nova-compute[75745]:     </disk>
Dec 01 17:14:56 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:14:56 user nova-compute[75745]:       <mac address="fa:16:3e:d6:94:e3"/>
Dec 01 17:14:56 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:14:56 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:14:56 user nova-compute[75745]:       <target dev="tap30260fca-fa"/>
Dec 01 17:14:56 user nova-compute[75745]:     </interface>
Dec 01 17:14:56 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:14:56 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/console.log" append="off"/>
Dec 01 17:14:56 user nova-compute[75745]:     </serial>
Dec 01 17:14:56 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:14:56 user nova-compute[75745]:     <video>
Dec 01 17:14:56 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:14:56 user nova-compute[75745]:     </video>
Dec 01 17:14:56 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:14:56 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:14:56 user nova-compute[75745]:     </rng>
Dec 01 17:14:56 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:14:56 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:14:56 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:14:56 user nova-compute[75745]:     </memballoon>
Dec 01 17:14:56 user nova-compute[75745]:   </devices>
Dec 01 17:14:56 user nova-compute[75745]: </domain>
Dec 01 17:14:56 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-860674518',display_name='tempest-tempest.common.compute-instance-860674518',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-860674518',id=26,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0VPvubRo9N9hDbGZ7rvBGfNIC49qGsVU6LVqmy/4M0zGXAuWOJcM6VFMASpfTpY2Uok0EIDnJL42vbGcwlx4yY9AlIDoh46ApbqcvwQjSds+Lyv6QMRAVGuNqnSLgdTA==',key_name='tempest-keypair-723015957',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='409356993ea442c5abdf4269aebe43ab',ramdisk_id='',reservation_id='r-9f0md9mc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1500186869',owner_user_name='tempest-ServerActionsTestOtherA-1500186869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:14:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5204ecaa9b354d10bac514c27acbccc6',uuid=9aca117f-581a-4625-abf1-c7faba669572,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30260fca-fac2-4377-b514-add8784429c4", "address": "fa:16:3e:d6:94:e3", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30260fca-fa", "ovs_interfaceid": "30260fca-fac2-4377-b514-add8784429c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Converting VIF {"id": "30260fca-fac2-4377-b514-add8784429c4", "address": "fa:16:3e:d6:94:e3", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30260fca-fa", "ovs_interfaceid": "30260fca-fac2-4377-b514-add8784429c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:94:e3,bridge_name='br-int',has_traffic_filtering=True,id=30260fca-fac2-4377-b514-add8784429c4,network=Network(f7cefc9d-2279-4601-8a81-a640ad1aea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30260fca-fa') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG os_vif [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:94:e3,bridge_name='br-int',has_traffic_filtering=True,id=30260fca-fac2-4377-b514-add8784429c4,network=Network(f7cefc9d-2279-4601-8a81-a640ad1aea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30260fca-fa') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '219868d8-f848-5a8d-99dc-688ed426a4fd', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30260fca-fa, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap30260fca-fa, col_values=(('qos', UUID('8dd72a37-0188-40b8-910d-f53268f1f29e')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap30260fca-fa, col_values=(('external_ids', {'iface-id': '30260fca-fac2-4377-b514-add8784429c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:94:e3', 'vm-uuid': '9aca117f-581a-4625-abf1-c7faba669572'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:56 user nova-compute[75745]: INFO os_vif [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:94:e3,bridge_name='br-int',has_traffic_filtering=True,id=30260fca-fac2-4377-b514-add8784429c4,network=Network(f7cefc9d-2279-4601-8a81-a640ad1aea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30260fca-fa')
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] No VIF found with MAC fa:16:3e:d6:94:e3, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.objects.instance [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lazy-loading 'flavor' on Instance uuid 06356800-2f67-4c35-9703-a71ca3271693 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c0e24118-1467-49b5-a514-01d4b6ede7aa tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "06356800-2f67-4c35-9703-a71ca3271693" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.890s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.network.neutron [req-dc284675-f419-41d6-b155-591c276583cc req-5d1996a4-e98b-469a-b75c-97b0fd4fda66 service nova] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Updated VIF entry in instance network info cache for port 30260fca-fac2-4377-b514-add8784429c4. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG nova.network.neutron [req-dc284675-f419-41d6-b155-591c276583cc req-5d1996a4-e98b-469a-b75c-97b0fd4fda66 service nova] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Updating instance_info_cache with network_info: [{"id": "30260fca-fac2-4377-b514-add8784429c4", "address": "fa:16:3e:d6:94:e3", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30260fca-fa", "ovs_interfaceid": "30260fca-fac2-4377-b514-add8784429c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:14:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-dc284675-f419-41d6-b155-591c276583cc req-5d1996a4-e98b-469a-b75c-97b0fd4fda66 service nova] Releasing lock "refresh_cache-9aca117f-581a-4625-abf1-c7faba669572" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:14:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Acquiring lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:57 user nova-compute[75745]: INFO nova.compute.manager [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Detaching volume 8c6993d8-adc8-45b8-ad23-9421af2db707
Dec 01 17:14:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:57 user nova-compute[75745]: INFO nova.virt.block_device [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Attempting to driver detach volume 8c6993d8-adc8-45b8-ad23-9421af2db707 from mountpoint /dev/vdb
Dec 01 17:14:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Attempting to detach device vdb from instance 0ab0c115-74aa-4e55-92a3-6fa91ba753e3 from the persistent domain config. {{(pid=75745) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 17:14:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:14:57 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:14:57 user nova-compute[75745]:   <source dev="/dev/sdd"/>
Dec 01 17:14:57 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:14:57 user nova-compute[75745]:   <serial>8c6993d8-adc8-45b8-ad23-9421af2db707</serial>
Dec 01 17:14:57 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 17:14:57 user nova-compute[75745]: </disk>
Dec 01 17:14:57 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:14:57 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Successfully detached device vdb from instance 0ab0c115-74aa-4e55-92a3-6fa91ba753e3 from the persistent domain config.
Dec 01 17:14:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0ab0c115-74aa-4e55-92a3-6fa91ba753e3 from the live domain config. {{(pid=75745) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 17:14:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:14:57 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:14:57 user nova-compute[75745]:   <source dev="/dev/sdd"/>
Dec 01 17:14:57 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:14:57 user nova-compute[75745]:   <serial>8c6993d8-adc8-45b8-ad23-9421af2db707</serial>
Dec 01 17:14:57 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 17:14:57 user nova-compute[75745]: </disk>
Dec 01 17:14:57 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:14:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-41e2c9f5-6a5f-4807-bb35-180a33ec40c9 req-796538c3-ff9d-432a-9ce8-d6fec93da09a service nova] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Received event network-vif-plugged-30260fca-fac2-4377-b514-add8784429c4 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:14:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-41e2c9f5-6a5f-4807-bb35-180a33ec40c9 req-796538c3-ff9d-432a-9ce8-d6fec93da09a service nova] Acquiring lock "9aca117f-581a-4625-abf1-c7faba669572-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:14:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-41e2c9f5-6a5f-4807-bb35-180a33ec40c9 req-796538c3-ff9d-432a-9ce8-d6fec93da09a service nova] Lock "9aca117f-581a-4625-abf1-c7faba669572-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:14:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-41e2c9f5-6a5f-4807-bb35-180a33ec40c9 req-796538c3-ff9d-432a-9ce8-d6fec93da09a service nova] Lock "9aca117f-581a-4625-abf1-c7faba669572-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:14:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-41e2c9f5-6a5f-4807-bb35-180a33ec40c9 req-796538c3-ff9d-432a-9ce8-d6fec93da09a service nova] [instance: 9aca117f-581a-4625-abf1-c7faba669572] No waiting events found dispatching network-vif-plugged-30260fca-fac2-4377-b514-add8784429c4 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:14:58 user nova-compute[75745]: WARNING nova.compute.manager [req-41e2c9f5-6a5f-4807-bb35-180a33ec40c9 req-796538c3-ff9d-432a-9ce8-d6fec93da09a service nova] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Received unexpected event network-vif-plugged-30260fca-fac2-4377-b514-add8784429c4 for instance with vm_state building and task_state spawning.
Dec 01 17:14:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:14:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0ab0c115-74aa-4e55-92a3-6fa91ba753e3 {{(pid=75745) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 17:14:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:00 user nova-compute[75745]: DEBUG nova.compute.manager [req-7e5a9ce9-368f-416c-9a37-7a0c565be750 req-38dc5fc3-cd16-4ffa-b820-3ceac6daa161 service nova] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Received event network-vif-plugged-30260fca-fac2-4377-b514-add8784429c4 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:15:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7e5a9ce9-368f-416c-9a37-7a0c565be750 req-38dc5fc3-cd16-4ffa-b820-3ceac6daa161 service nova] Acquiring lock "9aca117f-581a-4625-abf1-c7faba669572-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:15:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7e5a9ce9-368f-416c-9a37-7a0c565be750 req-38dc5fc3-cd16-4ffa-b820-3ceac6daa161 service nova] Lock "9aca117f-581a-4625-abf1-c7faba669572-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:15:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7e5a9ce9-368f-416c-9a37-7a0c565be750 req-38dc5fc3-cd16-4ffa-b820-3ceac6daa161 service nova] Lock "9aca117f-581a-4625-abf1-c7faba669572-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:15:00 user nova-compute[75745]: DEBUG nova.compute.manager [req-7e5a9ce9-368f-416c-9a37-7a0c565be750 req-38dc5fc3-cd16-4ffa-b820-3ceac6daa161 service nova] [instance: 9aca117f-581a-4625-abf1-c7faba669572] No waiting events found dispatching network-vif-plugged-30260fca-fac2-4377-b514-add8784429c4 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:15:00 user nova-compute[75745]: WARNING nova.compute.manager [req-7e5a9ce9-368f-416c-9a37-7a0c565be750 req-38dc5fc3-cd16-4ffa-b820-3ceac6daa161 service nova] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Received unexpected event network-vif-plugged-30260fca-fac2-4377-b514-add8784429c4 for instance with vm_state building and task_state spawning.
Dec 01 17:15:00 user nova-compute[75745]: DEBUG nova.compute.manager [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:15:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:15:00 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Instance spawned successfully.
Dec 01 17:15:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:15:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:15:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:15:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:15:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:15:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:15:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:15:00 user nova-compute[75745]: INFO nova.compute.manager [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Took 5.56 seconds to spawn the instance on the hypervisor.
Dec 01 17:15:00 user nova-compute[75745]: DEBUG nova.compute.manager [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:15:00 user nova-compute[75745]: INFO nova.compute.manager [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Took 6.36 seconds to build instance.
Dec 01 17:15:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-efa77430-798b-4d86-bb22-89dcf2918428 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "9aca117f-581a-4625-abf1-c7faba669572" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.480s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:15:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:18 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0ab0c115-74aa-4e55-92a3-6fa91ba753e3 is timed out.
Dec 01 17:15:18 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Successfully detached device vdb from instance 0ab0c115-74aa-4e55-92a3-6fa91ba753e3 from the live domain config.
Dec 01 17:15:18 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PQIUDeYZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:15:18 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:15:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b418fa5-5572-4e92-b66c-c4d8639d6f1d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:15:18 user nova-compute[75745]: No targets found.
Dec 01 17:15:18 user nova-compute[75745]: iSNS:
Dec 01 17:15:18 user nova-compute[75745]: No targets found.
Dec 01 17:15:18 user nova-compute[75745]: STATIC:
Dec 01 17:15:18 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0
Dec 01 17:15:18 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:15:18 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:15:18 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707
Dec 01 17:15:18 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:15:18 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:15:18 user nova-compute[75745]: FIRMWARE:
Dec 01 17:15:18 user nova-compute[75745]: No targets found.
Dec 01 17:15:18 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:15:18 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:15:18 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda4cd93-0622-4a56-b230-2c59e2b53a11]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bf47a6-8636-4235-b44d-1d024a9424ad]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:15:18 user nova-compute[75745]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707 (non-flash)
Dec 01 17:15:18 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:15:18 user nova-compute[75745]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707 (non-flash)
Dec 01 17:15:18 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b8199c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707'): ({'sdd'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Removing single pathed devices sdd {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[179e293d-88f1-4e8d-93a3-bcb07c663e09]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8664e061-6fad-44e6-9b2c-fd820e8daee1]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Flushing IO for device /dev/sdd {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c635c423-ac96-4044-8e31-1784a2c8eaca]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c208ed6-5189-49ed-914c-35223be7f3d2]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] SCSI volumes sdd have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[71938bbb-afdf-4160-ad78-a53445115600]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c606e9e-385d-458d-81c6-78d5b4cc9758]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707, portal: 172.16.0.220,3260]
Dec 01 17:15:18 user nova-compute[75745]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707, portal: 172.16.0.220,3260] successful.
Dec 01 17:15:18 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c6993d8-adc8-45b8-ad23-9421af2db707 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4470e2-edfd-4c08-a079-3e47b88c13ea]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] <== disconnect_volume: return (279ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:15:18 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:15:19 user nova-compute[75745]: DEBUG nova.objects.instance [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lazy-loading 'flavor' on Instance uuid 0ab0c115-74aa-4e55-92a3-6fa91ba753e3 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:15:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-57416ba3-47c7-4c8f-a9a3-1a54782aeacc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.912s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:15:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:22 user nova-compute[75745]: DEBUG nova.network.neutron [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Port 9c3aade6-4181-435d-aabd-07988112a373 binding to destination host user is already ACTIVE {{(pid=75745) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Dec 01 17:15:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Acquiring lock "refresh_cache-98b29ba5-9993-4494-b196-f7eea077df7a" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:15:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Acquired lock "refresh_cache-98b29ba5-9993-4494-b196-f7eea077df7a" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:15:22 user nova-compute[75745]: DEBUG nova.network.neutron [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:15:22 user nova-compute[75745]: DEBUG nova.network.neutron [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Updating instance_info_cache with network_info: [{"id": "9c3aade6-4181-435d-aabd-07988112a373", "address": "fa:16:3e:60:67:90", "network": {"id": "9083e0bd-c071-4794-bf87-74bc7ba3898b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-947489426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4f3ec75737429e8834e7d3576ffa69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3aade6-41", "ovs_interfaceid": "9c3aade6-4181-435d-aabd-07988112a373", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:15:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Releasing lock "refresh_cache-98b29ba5-9993-4494-b196-f7eea077df7a" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:15:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Creating tmpfile /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/tmpezhqbnzk to verify with other compute node that the instance is on the same shared storage. {{(pid=75745) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Dec 01 17:15:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG nova.compute.manager [req-70742903-b935-4149-8787-6ca9ac95a890 req-309b35bf-c0ec-435e-877a-0689283f2476 service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Received event network-vif-unplugged-9c3aade6-4181-435d-aabd-07988112a373 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-70742903-b935-4149-8787-6ca9ac95a890 req-309b35bf-c0ec-435e-877a-0689283f2476 service nova] Acquiring lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-70742903-b935-4149-8787-6ca9ac95a890 req-309b35bf-c0ec-435e-877a-0689283f2476 service nova] Lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-70742903-b935-4149-8787-6ca9ac95a890 req-309b35bf-c0ec-435e-877a-0689283f2476 service nova] Lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG nova.compute.manager [req-70742903-b935-4149-8787-6ca9ac95a890 req-309b35bf-c0ec-435e-877a-0689283f2476 service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] No waiting events found dispatching network-vif-unplugged-9c3aade6-4181-435d-aabd-07988112a373 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:15:23 user nova-compute[75745]: WARNING nova.compute.manager [req-70742903-b935-4149-8787-6ca9ac95a890 req-309b35bf-c0ec-435e-877a-0689283f2476 service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Received unexpected event network-vif-unplugged-9c3aade6-4181-435d-aabd-07988112a373 for instance with vm_state resized and task_state resize_reverting.
Dec 01 17:15:23 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Instance destroyed successfully.
Dec 01 17:15:23 user nova-compute[75745]: DEBUG nova.objects.instance [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lazy-loading 'resources' on Instance uuid 98b29ba5-9993-4494-b196-f7eea077df7a {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-321906429',display_name='tempest-ServerActionsTestOtherB-server-321906429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-321906429',id=14,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6Xv1Rwscmn/urtTSZP43LfdG03kX+bxRxOhmhIXfcYy1rBNpzO0Q01awhPBxn/6X5VK/oxuGhv1u1yXJ9Fp7a3tqYVzRZF/9QTyYTjIDpNO30GMbJX0Ytk2j/sLZKHuw==',key_name='tempest-keypair-56607333',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:13:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e4f3ec75737429e8834e7d3576ffa69',ramdisk_id='',reservation_id='r-64j6n0b5',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-978518734',owner_user_name='tempest-ServerActionsTestOtherB-978518734-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:13:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad1d09d017314c67b4616642f1108f21',uuid=98b29ba5-9993-4494-b196-f7eea077df7a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9c3aade6-4181-435d-aabd-07988112a373", "address": "fa:16:3e:60:67:90", "network": {"id": "9083e0bd-c071-4794-bf87-74bc7ba3898b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-947489426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4f3ec75737429e8834e7d3576ffa69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3aade6-41", "ovs_interfaceid": "9c3aade6-4181-435d-aabd-07988112a373", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Converting VIF {"id": "9c3aade6-4181-435d-aabd-07988112a373", "address": "fa:16:3e:60:67:90", "network": {"id": "9083e0bd-c071-4794-bf87-74bc7ba3898b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-947489426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4f3ec75737429e8834e7d3576ffa69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3aade6-41", "ovs_interfaceid": "9c3aade6-4181-435d-aabd-07988112a373", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:67:90,bridge_name='br-int',has_traffic_filtering=True,id=9c3aade6-4181-435d-aabd-07988112a373,network=Network(9083e0bd-c071-4794-bf87-74bc7ba3898b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c3aade6-41') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG os_vif [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:67:90,bridge_name='br-int',has_traffic_filtering=True,id=9c3aade6-4181-435d-aabd-07988112a373,network=Network(9083e0bd-c071-4794-bf87-74bc7ba3898b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c3aade6-41') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c3aade6-41, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=477635a8-f1e0-4156-9f3e-6acd321d6a5c) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:23 user nova-compute[75745]: INFO os_vif [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:67:90,bridge_name='br-int',has_traffic_filtering=True,id=9c3aade6-4181-435d-aabd-07988112a373,network=Network(9083e0bd-c071-4794-bf87-74bc7ba3898b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c3aade6-41')
Dec 01 17:15:23 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxLBeEqG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:15:23 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:15:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a246d3c-a79e-4e06-9542-e87da0ace113]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:15:23 user nova-compute[75745]: No targets found.
Dec 01 17:15:23 user nova-compute[75745]: iSNS:
Dec 01 17:15:23 user nova-compute[75745]: No targets found.
Dec 01 17:15:23 user nova-compute[75745]: STATIC:
Dec 01 17:15:23 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0
Dec 01 17:15:23 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:15:23 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:15:23 user nova-compute[75745]: FIRMWARE:
Dec 01 17:15:23 user nova-compute[75745]: No targets found.
Dec 01 17:15:23 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:15:23 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:15:23 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a46416a-6f39-450c-a023-916458f7d6ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9b0f63-3438-4e24-b900-f3187509d7e1]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:15:23 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:15:23 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b879ca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0'): ({'sdc'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Removing single pathed devices sdc {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb2293b-2037-440e-ba5c-f9110d036d48]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e436575d-5bd3-4ac2-af17-f33c4e63bc7a]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Flushing IO for device /dev/sdc {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e73b2a-0aa7-4d65-b127-af9d07a3c51e]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dde246a-3e66-4a6d-bbac-6b8e69e01418]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] SCSI volumes sdc have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a154f73-87a5-408a-8234-35f405a678e6]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:15:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:24 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ce397a-c57f-47a7-b57d-b4c2033249e6]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0, portal: 172.16.0.220,3260]
Dec 01 17:15:24 user nova-compute[75745]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0, portal: 172.16.0.220,3260] successful.
Dec 01 17:15:24 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:15:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:24 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce74664-e7f5-465d-9ef0-80e67fe68011]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:15:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:15:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] <== disconnect_volume: return (316ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:15:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:15:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:15:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:15:25 user nova-compute[75745]: DEBUG nova.objects.instance [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lazy-loading 'migration_context' on Instance uuid 98b29ba5-9993-4494-b196-f7eea077df7a {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:15:25 user nova-compute[75745]: DEBUG nova.objects.base [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Object Instance<98b29ba5-9993-4494-b196-f7eea077df7a> lazy-loaded attributes: resources,migration_context {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:15:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f96d73c2-67c5-4df8-89a0-15c63820beeb tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "06356800-2f67-4c35-9703-a71ca3271693" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:15:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f96d73c2-67c5-4df8-89a0-15c63820beeb tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "06356800-2f67-4c35-9703-a71ca3271693" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:15:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f96d73c2-67c5-4df8-89a0-15c63820beeb tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "06356800-2f67-4c35-9703-a71ca3271693-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:15:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f96d73c2-67c5-4df8-89a0-15c63820beeb tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "06356800-2f67-4c35-9703-a71ca3271693-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:15:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f96d73c2-67c5-4df8-89a0-15c63820beeb tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "06356800-2f67-4c35-9703-a71ca3271693-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:15:25 user nova-compute[75745]: INFO nova.compute.manager [None req-f96d73c2-67c5-4df8-89a0-15c63820beeb tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Terminating instance
Dec 01 17:15:25 user nova-compute[75745]: DEBUG nova.compute.manager [None req-f96d73c2-67c5-4df8-89a0-15c63820beeb tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:15:25 user nova-compute[75745]: DEBUG nova.compute.manager [req-b935390d-ae7c-4846-b646-7b0c75511977 req-88cecb9e-31db-4304-8524-464090009eef service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Received event network-vif-plugged-9c3aade6-4181-435d-aabd-07988112a373 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:15:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b935390d-ae7c-4846-b646-7b0c75511977 req-88cecb9e-31db-4304-8524-464090009eef service nova] Acquiring lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:15:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b935390d-ae7c-4846-b646-7b0c75511977 req-88cecb9e-31db-4304-8524-464090009eef service nova] Lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:15:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b935390d-ae7c-4846-b646-7b0c75511977 req-88cecb9e-31db-4304-8524-464090009eef service nova] Lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:15:25 user nova-compute[75745]: DEBUG nova.compute.manager [req-b935390d-ae7c-4846-b646-7b0c75511977 req-88cecb9e-31db-4304-8524-464090009eef service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] No waiting events found dispatching network-vif-plugged-9c3aade6-4181-435d-aabd-07988112a373 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:15:25 user nova-compute[75745]: WARNING nova.compute.manager [req-b935390d-ae7c-4846-b646-7b0c75511977 req-88cecb9e-31db-4304-8524-464090009eef service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Received unexpected event network-vif-plugged-9c3aade6-4181-435d-aabd-07988112a373 for instance with vm_state resized and task_state resize_reverting.
Dec 01 17:15:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:25 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:15:25 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:15:25 user nova-compute[75745]: DEBUG nova.compute.manager [req-96ac2399-c1fe-4a50-b469-c1f08785f7ea req-fa8be753-9c90-43fb-997a-15ca056f140d service nova] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Received event network-vif-unplugged-9b2916b4-ab61-436b-b0a1-1fecb6bee4fa {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:15:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-96ac2399-c1fe-4a50-b469-c1f08785f7ea req-fa8be753-9c90-43fb-997a-15ca056f140d service nova] Acquiring lock "06356800-2f67-4c35-9703-a71ca3271693-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:15:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-96ac2399-c1fe-4a50-b469-c1f08785f7ea req-fa8be753-9c90-43fb-997a-15ca056f140d service nova] Lock "06356800-2f67-4c35-9703-a71ca3271693-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:15:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-96ac2399-c1fe-4a50-b469-c1f08785f7ea req-fa8be753-9c90-43fb-997a-15ca056f140d service nova] Lock "06356800-2f67-4c35-9703-a71ca3271693-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:15:25 user nova-compute[75745]: DEBUG nova.compute.manager [req-96ac2399-c1fe-4a50-b469-c1f08785f7ea req-fa8be753-9c90-43fb-997a-15ca056f140d service nova] [instance: 06356800-2f67-4c35-9703-a71ca3271693] No waiting events found dispatching network-vif-unplugged-9b2916b4-ab61-436b-b0a1-1fecb6bee4fa {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:15:25 user nova-compute[75745]: DEBUG nova.compute.manager [req-96ac2399-c1fe-4a50-b469-c1f08785f7ea req-fa8be753-9c90-43fb-997a-15ca056f140d service nova] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Received event network-vif-unplugged-9b2916b4-ab61-436b-b0a1-1fecb6bee4fa for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:15:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.542s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:15:25 user nova-compute[75745]: INFO nova.compute.manager [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Swapping old allocation on dict_keys(['33987d7e-4951-418c-ad82-d4ed37170ed9']) held by migration 2cceade1-2602-4b26-8c1c-27cdb0c24750 for instance
Dec 01 17:15:25 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Overwriting current allocation {'allocations': {'33987d7e-4951-418c-ad82-d4ed37170ed9': {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}, 'generation': 30}}, 'project_id': '2e4f3ec75737429e8834e7d3576ffa69', 'user_id': 'ad1d09d017314c67b4616642f1108f21', 'consumer_generation': 1} on consumer 98b29ba5-9993-4494-b196-f7eea077df7a {{(pid=75745) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Dec 01 17:15:25 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Instance destroyed successfully.
Dec 01 17:15:25 user nova-compute[75745]: DEBUG nova.objects.instance [None req-f96d73c2-67c5-4df8-89a0-15c63820beeb tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lazy-loading 'resources' on Instance uuid 06356800-2f67-4c35-9703-a71ca3271693 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-f96d73c2-67c5-4df8-89a0-15c63820beeb tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:12:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1435269449',display_name='tempest-AttachVolumeNegativeTest-server-1435269449',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1435269449',id=19,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtqwquuShxYMqWMPctqcQtjzSW4DWT+9w3SZAFuo2ZmtHYDax/Q8O6qbwl2O1K3c2iS1/9qFZLBKT+Yowi6riKJhG5okf+bCdOuOVxw8yCohOECfsT/QD1N7XekPJdSew==',key_name='tempest-keypair-2042853901',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:12:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1730419061445f98680b8c81753a4f3',ramdisk_id='',reservation_id='r-1whtszwk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1227943771',owner_user_name='tempest-AttachVolumeNegativeTest-1227943771-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:12:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76845c98f91449df9196e19187b1b786',uuid=06356800-2f67-4c35-9703-a71ca3271693,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b2916b4-ab61-436b-b0a1-1fecb6bee4fa", "address": "fa:16:3e:e1:90:4e", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2916b4-ab", "ovs_interfaceid": "9b2916b4-ab61-436b-b0a1-1fecb6bee4fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-f96d73c2-67c5-4df8-89a0-15c63820beeb tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Converting VIF {"id": "9b2916b4-ab61-436b-b0a1-1fecb6bee4fa", "address": "fa:16:3e:e1:90:4e", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2916b4-ab", "ovs_interfaceid": "9b2916b4-ab61-436b-b0a1-1fecb6bee4fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-f96d73c2-67c5-4df8-89a0-15c63820beeb tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:90:4e,bridge_name='br-int',has_traffic_filtering=True,id=9b2916b4-ab61-436b-b0a1-1fecb6bee4fa,network=Network(8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2916b4-ab') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG os_vif [None req-f96d73c2-67c5-4df8-89a0-15c63820beeb tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:90:4e,bridge_name='br-int',has_traffic_filtering=True,id=9b2916b4-ab61-436b-b0a1-1fecb6bee4fa,network=Network(8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2916b4-ab') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b2916b4-ab, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=febb0be1-bb37-48a5-8fb8-bab555ea1b6c) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:26 user nova-compute[75745]: INFO os_vif [None req-f96d73c2-67c5-4df8-89a0-15c63820beeb tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:90:4e,bridge_name='br-int',has_traffic_filtering=True,id=9b2916b4-ab61-436b-b0a1-1fecb6bee4fa,network=Network(8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2916b4-ab')
Dec 01 17:15:26 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-f96d73c2-67c5-4df8-89a0-15c63820beeb tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Deleting instance files /opt/stack/data/nova/instances/06356800-2f67-4c35-9703-a71ca3271693_del
Dec 01 17:15:26 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-f96d73c2-67c5-4df8-89a0-15c63820beeb tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Deletion of /opt/stack/data/nova/instances/06356800-2f67-4c35-9703-a71ca3271693_del complete
Dec 01 17:15:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Acquiring lock "refresh_cache-98b29ba5-9993-4494-b196-f7eea077df7a" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Acquired lock "refresh_cache-98b29ba5-9993-4494-b196-f7eea077df7a" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG nova.network.neutron [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:15:26 user nova-compute[75745]: INFO nova.compute.manager [None req-f96d73c2-67c5-4df8-89a0-15c63820beeb tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Took 0.92 seconds to destroy the instance on the hypervisor.
Dec 01 17:15:26 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-f96d73c2-67c5-4df8-89a0-15c63820beeb tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 06356800-2f67-4c35-9703-a71ca3271693] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG nova.network.neutron [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Updating instance_info_cache with network_info: [{"id": "9c3aade6-4181-435d-aabd-07988112a373", "address": "fa:16:3e:60:67:90", "network": {"id": "9083e0bd-c071-4794-bf87-74bc7ba3898b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-947489426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4f3ec75737429e8834e7d3576ffa69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3aade6-41", "ovs_interfaceid": "9c3aade6-4181-435d-aabd-07988112a373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Releasing lock "refresh_cache-98b29ba5-9993-4494-b196-f7eea077df7a" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG os_brick.utils [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf85d57-c674-498e-b454-b7b1bc57531f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df4e868-8af0-4955-840c-a8d9d6c13bf5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddf3183-03d9-472b-b19e-49430b0efbca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd035b9-bcd1-43cf-a8ed-f69fad14c22c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:15:26 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:15:26 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce29a4b-210c-4dce-a24b-386f3a7ab5d9]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:15:26 user nova-compute[75745]: DEBUG os_brick.utils [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:15:27 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:15:27 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Took 1.20 seconds to deallocate network for instance.
Dec 01 17:15:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f96d73c2-67c5-4df8-89a0-15c63820beeb tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:15:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f96d73c2-67c5-4df8-89a0-15c63820beeb tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:15:27 user nova-compute[75745]: DEBUG nova.compute.manager [req-53d06406-32fe-4446-9ab5-b771f300f23e req-de37117a-8005-48eb-a765-aed20ef71591 service nova] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Received event network-vif-plugged-9b2916b4-ab61-436b-b0a1-1fecb6bee4fa {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:15:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-53d06406-32fe-4446-9ab5-b771f300f23e req-de37117a-8005-48eb-a765-aed20ef71591 service nova] Acquiring lock "06356800-2f67-4c35-9703-a71ca3271693-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:15:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-53d06406-32fe-4446-9ab5-b771f300f23e req-de37117a-8005-48eb-a765-aed20ef71591 service nova] Lock "06356800-2f67-4c35-9703-a71ca3271693-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:15:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-53d06406-32fe-4446-9ab5-b771f300f23e req-de37117a-8005-48eb-a765-aed20ef71591 service nova] Lock "06356800-2f67-4c35-9703-a71ca3271693-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:15:27 user nova-compute[75745]: DEBUG nova.compute.manager [req-53d06406-32fe-4446-9ab5-b771f300f23e req-de37117a-8005-48eb-a765-aed20ef71591 service nova] [instance: 06356800-2f67-4c35-9703-a71ca3271693] No waiting events found dispatching network-vif-plugged-9b2916b4-ab61-436b-b0a1-1fecb6bee4fa {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:15:27 user nova-compute[75745]: WARNING nova.compute.manager [req-53d06406-32fe-4446-9ab5-b771f300f23e req-de37117a-8005-48eb-a765-aed20ef71591 service nova] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Received unexpected event network-vif-plugged-9b2916b4-ab61-436b-b0a1-1fecb6bee4fa for instance with vm_state deleted and task_state None.
Dec 01 17:15:27 user nova-compute[75745]: DEBUG nova.compute.manager [req-53d06406-32fe-4446-9ab5-b771f300f23e req-de37117a-8005-48eb-a765-aed20ef71591 service nova] [instance: 06356800-2f67-4c35-9703-a71ca3271693] Received event network-vif-deleted-9b2916b4-ab61-436b-b0a1-1fecb6bee4fa {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:15:27 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-f96d73c2-67c5-4df8-89a0-15c63820beeb tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:15:27 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-f96d73c2-67c5-4df8-89a0-15c63820beeb tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:15:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f96d73c2-67c5-4df8-89a0-15c63820beeb tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:15:27 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-f96d73c2-67c5-4df8-89a0-15c63820beeb tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Deleted allocations for instance 06356800-2f67-4c35-9703-a71ca3271693
Dec 01 17:15:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-f96d73c2-67c5-4df8-89a0-15c63820beeb tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "06356800-2f67-4c35-9703-a71ca3271693" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.677s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:15:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Starting finish_revert_migration {{(pid=75745) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11813}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Start _get_guest_xml network_info=[{"id": "9c3aade6-4181-435d-aabd-07988112a373", "address": "fa:16:3e:60:67:90", "network": {"id": "9083e0bd-c071-4794-bf87-74bc7ba3898b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-947489426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4f3ec75737429e8834e7d3576ffa69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3aade6-41", "ovs_interfaceid": "9c3aade6-4181-435d-aabd-07988112a373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': '2d4edfcb-aeb1-4e30-9cec-af1d89e191c8', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxLBeEqG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '98b29ba5-9993-4494-b196-f7eea077df7a', 'attached_at': '2023-12-01T17:15:36.000000', 'detached_at': '', 'volume_id': '2e941299-9596-4969-a82d-e543f40668c0', 'serial': '2e941299-9596-4969-a82d-e543f40668c0'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:15:36 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:15:36 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:15:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG nova.objects.instance [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lazy-loading 'vcpu_model' on Instance uuid 98b29ba5-9993-4494-b196-f7eea077df7a {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxLBeEqG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:15:36 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:15:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:15:36 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:15:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:15:36 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:15:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd94442-52a0-433e-b40e-7b5667678867]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:15:36 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5193aba-074f-4d7a-bfe8-e1ac4dee3d3b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0] added
Dec 01 17:15:36 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[786d8221-a455-417e-91aa-c0b3d1157461]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3bb3b0-f9d4-4b41-a197-af0da06a6238]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YxLBeEqG {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YxLBeEqG" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[89195327-8966-4255-8a29-e747d455055f]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YxLBeEqG'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[081a510d-71ce-4d3d-a928-655ad9e08f2c]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf890c56-546c-4920-a336-43aaee3135d6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 01 17:15:36 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 01 17:15:36 user nova-compute[75745]:  {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:15:36 user nova-compute[75745]: WARNING os_brick.initiator.connectors.iscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 01 17:15:36 user nova-compute[75745]: 
Dec 01 17:15:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b013343b-13ad-46dd-8208-03063b849c16]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0, portal: 172.16.0.220,3260]
Dec 01 17:15:36 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0, portal: 172.16.0.220,3260] successful.
Dec 01 17:15:36 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e767a609-fa41-423e-a229-f55ead38e0da]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb4d7dd-8978-42ab-922f-27845b73675f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:15:36 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:15:36 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e4f9e0-6a1e-4688-b4d1-41b326ec0628]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:15:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxLBeEqG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:15:37 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:15:37 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23039393336386336', 'path': '/dev/sdb'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:15:37 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039393336386336', 'path': '/dev/sdb'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:15:37 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-321906429',display_name='tempest-ServerActionsTestOtherB-server-321906429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-321906429',id=14,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6Xv1Rwscmn/urtTSZP43LfdG03kX+bxRxOhmhIXfcYy1rBNpzO0Q01awhPBxn/6X5VK/oxuGhv1u1yXJ9Fp7a3tqYVzRZF/9QTyYTjIDpNO30GMbJX0Ytk2j/sLZKHuw==',key_name='tempest-keypair-56607333',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:13:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2e4f3ec75737429e8834e7d3576ffa69',ramdisk_id='',reservation_id='r-64j6n0b5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-978518734',owner_user_name='tempest-ServerActionsTestOtherB-978518734-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:15:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad1d09d017314c67b4616642f1108f21',uuid=98b29ba5-9993-4494-b196-f7eea077df7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9c3aade6-4181-435d-aabd-07988112a373", "address": "fa:16:3e:60:67:90", "network": {"id": "9083e0bd-c071-4794-bf87-74bc7ba3898b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-947489426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4f3ec75737429e8834e7d3576ffa69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3aade6-41", "ovs_interfaceid": "9c3aade6-4181-435d-aabd-07988112a373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:15:37 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Converting VIF {"id": "9c3aade6-4181-435d-aabd-07988112a373", "address": "fa:16:3e:60:67:90", "network": {"id": "9083e0bd-c071-4794-bf87-74bc7ba3898b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-947489426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4f3ec75737429e8834e7d3576ffa69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3aade6-41", "ovs_interfaceid": "9c3aade6-4181-435d-aabd-07988112a373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:15:37 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:67:90,bridge_name='br-int',has_traffic_filtering=True,id=9c3aade6-4181-435d-aabd-07988112a373,network=Network(9083e0bd-c071-4794-bf87-74bc7ba3898b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c3aade6-41') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:15:37 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:15:37 user nova-compute[75745]:   <uuid>98b29ba5-9993-4494-b196-f7eea077df7a</uuid>
Dec 01 17:15:37 user nova-compute[75745]:   <name>instance-0000000e</name>
Dec 01 17:15:37 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:15:37 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:15:37 user nova-compute[75745]:   <metadata>
Dec 01 17:15:37 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:15:37 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:15:37 user nova-compute[75745]:       <nova:name>tempest-ServerActionsTestOtherB-server-321906429</nova:name>
Dec 01 17:15:37 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:15:36</nova:creationTime>
Dec 01 17:15:37 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:15:37 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:15:37 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:15:37 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:15:37 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:15:37 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:15:37 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:15:37 user nova-compute[75745]:       <nova:owner>
Dec 01 17:15:37 user nova-compute[75745]:         <nova:user uuid="ad1d09d017314c67b4616642f1108f21">tempest-ServerActionsTestOtherB-978518734-project-member</nova:user>
Dec 01 17:15:37 user nova-compute[75745]:         <nova:project uuid="2e4f3ec75737429e8834e7d3576ffa69">tempest-ServerActionsTestOtherB-978518734</nova:project>
Dec 01 17:15:37 user nova-compute[75745]:       </nova:owner>
Dec 01 17:15:37 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:15:37 user nova-compute[75745]:       <nova:ports>
Dec 01 17:15:37 user nova-compute[75745]:         <nova:port uuid="9c3aade6-4181-435d-aabd-07988112a373">
Dec 01 17:15:37 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 01 17:15:37 user nova-compute[75745]:         </nova:port>
Dec 01 17:15:37 user nova-compute[75745]:       </nova:ports>
Dec 01 17:15:37 user nova-compute[75745]:     </nova:instance>
Dec 01 17:15:37 user nova-compute[75745]:   </metadata>
Dec 01 17:15:37 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:15:37 user nova-compute[75745]:     <system>
Dec 01 17:15:37 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:15:37 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:15:37 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:15:37 user nova-compute[75745]:       <entry name="serial">98b29ba5-9993-4494-b196-f7eea077df7a</entry>
Dec 01 17:15:37 user nova-compute[75745]:       <entry name="uuid">98b29ba5-9993-4494-b196-f7eea077df7a</entry>
Dec 01 17:15:37 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:15:37 user nova-compute[75745]:     </system>
Dec 01 17:15:37 user nova-compute[75745]:   </sysinfo>
Dec 01 17:15:37 user nova-compute[75745]:   <os>
Dec 01 17:15:37 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:15:37 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:15:37 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:15:37 user nova-compute[75745]:   </os>
Dec 01 17:15:37 user nova-compute[75745]:   <features>
Dec 01 17:15:37 user nova-compute[75745]:     <acpi/>
Dec 01 17:15:37 user nova-compute[75745]:     <apic/>
Dec 01 17:15:37 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:15:37 user nova-compute[75745]:   </features>
Dec 01 17:15:37 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:15:37 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:15:37 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:15:37 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:15:37 user nova-compute[75745]:   </clock>
Dec 01 17:15:37 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:15:37 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:15:37 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:15:37 user nova-compute[75745]:   </cpu>
Dec 01 17:15:37 user nova-compute[75745]:   <devices>
Dec 01 17:15:37 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:15:37 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:15:37 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk"/>
Dec 01 17:15:37 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:15:37 user nova-compute[75745]:     </disk>
Dec 01 17:15:37 user nova-compute[75745]:     <disk type="block" device="disk">
Dec 01 17:15:37 user nova-compute[75745]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:15:37 user nova-compute[75745]:       <source dev="/dev/sdb"/>
Dec 01 17:15:37 user nova-compute[75745]:       <target dev="vdb" bus="virtio"/>
Dec 01 17:15:37 user nova-compute[75745]:       <serial>2e941299-9596-4969-a82d-e543f40668c0</serial>
Dec 01 17:15:37 user nova-compute[75745]:     </disk>
Dec 01 17:15:37 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:15:37 user nova-compute[75745]:       <mac address="fa:16:3e:60:67:90"/>
Dec 01 17:15:37 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:15:37 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:15:37 user nova-compute[75745]:       <target dev="tap9c3aade6-41"/>
Dec 01 17:15:37 user nova-compute[75745]:     </interface>
Dec 01 17:15:37 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:15:37 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/console.log" append="off"/>
Dec 01 17:15:37 user nova-compute[75745]:     </serial>
Dec 01 17:15:37 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:15:37 user nova-compute[75745]:     <video>
Dec 01 17:15:37 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:15:37 user nova-compute[75745]:     </video>
Dec 01 17:15:37 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:15:37 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:15:37 user nova-compute[75745]:     </rng>
Dec 01 17:15:37 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:15:37 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:15:37 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:15:37 user nova-compute[75745]:     </memballoon>
Dec 01 17:15:37 user nova-compute[75745]:   </devices>
Dec 01 17:15:37 user nova-compute[75745]: </domain>
Dec 01 17:15:37 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:15:37 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-321906429',display_name='tempest-ServerActionsTestOtherB-server-321906429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-321906429',id=14,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6Xv1Rwscmn/urtTSZP43LfdG03kX+bxRxOhmhIXfcYy1rBNpzO0Q01awhPBxn/6X5VK/oxuGhv1u1yXJ9Fp7a3tqYVzRZF/9QTyYTjIDpNO30GMbJX0Ytk2j/sLZKHuw==',key_name='tempest-keypair-56607333',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:13:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2e4f3ec75737429e8834e7d3576ffa69',ramdisk_id='',reservation_id='r-64j6n0b5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-978518734',owner_user_name='tempest-ServerActionsTestOtherB-978518734-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:15:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad1d09d017314c67b4616642f1108f21',uuid=98b29ba5-9993-4494-b196-f7eea077df7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9c3aade6-4181-435d-aabd-07988112a373", "address": "fa:16:3e:60:67:90", "network": {"id": "9083e0bd-c071-4794-bf87-74bc7ba3898b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-947489426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4f3ec75737429e8834e7d3576ffa69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3aade6-41", "ovs_interfaceid": "9c3aade6-4181-435d-aabd-07988112a373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:15:37 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Converting VIF {"id": "9c3aade6-4181-435d-aabd-07988112a373", "address": "fa:16:3e:60:67:90", "network": {"id": "9083e0bd-c071-4794-bf87-74bc7ba3898b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-947489426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4f3ec75737429e8834e7d3576ffa69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3aade6-41", "ovs_interfaceid": "9c3aade6-4181-435d-aabd-07988112a373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:15:37 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:67:90,bridge_name='br-int',has_traffic_filtering=True,id=9c3aade6-4181-435d-aabd-07988112a373,network=Network(9083e0bd-c071-4794-bf87-74bc7ba3898b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c3aade6-41') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:15:37 user nova-compute[75745]: DEBUG os_vif [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:67:90,bridge_name='br-int',has_traffic_filtering=True,id=9c3aade6-4181-435d-aabd-07988112a373,network=Network(9083e0bd-c071-4794-bf87-74bc7ba3898b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c3aade6-41') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:15:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:15:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:15:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec1b282c-a7fa-5026-9d11-8f93a071c319', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:15:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:15:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c3aade6-41, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:15:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c3aade6-41, col_values=(('qos', UUID('6b6f15aa-a379-4435-a5d0-a67bf9518a04')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:15:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c3aade6-41, col_values=(('external_ids', {'iface-id': '9c3aade6-4181-435d-aabd-07988112a373', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:67:90', 'vm-uuid': '98b29ba5-9993-4494-b196-f7eea077df7a'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:15:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:15:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:37 user nova-compute[75745]: INFO os_vif [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:67:90,bridge_name='br-int',has_traffic_filtering=True,id=9c3aade6-4181-435d-aabd-07988112a373,network=Network(9083e0bd-c071-4794-bf87-74bc7ba3898b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c3aade6-41')
Dec 01 17:15:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:38 user nova-compute[75745]: DEBUG nova.compute.manager [req-0ccac18a-73fc-4eb9-87e2-e2ca5b9c4297 req-a3760701-af85-42a6-b621-94175438d3d6 service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Received event network-vif-plugged-9c3aade6-4181-435d-aabd-07988112a373 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:15:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0ccac18a-73fc-4eb9-87e2-e2ca5b9c4297 req-a3760701-af85-42a6-b621-94175438d3d6 service nova] Acquiring lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:15:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0ccac18a-73fc-4eb9-87e2-e2ca5b9c4297 req-a3760701-af85-42a6-b621-94175438d3d6 service nova] Lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:15:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0ccac18a-73fc-4eb9-87e2-e2ca5b9c4297 req-a3760701-af85-42a6-b621-94175438d3d6 service nova] Lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:15:38 user nova-compute[75745]: DEBUG nova.compute.manager [req-0ccac18a-73fc-4eb9-87e2-e2ca5b9c4297 req-a3760701-af85-42a6-b621-94175438d3d6 service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] No waiting events found dispatching network-vif-plugged-9c3aade6-4181-435d-aabd-07988112a373 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:15:38 user nova-compute[75745]: WARNING nova.compute.manager [req-0ccac18a-73fc-4eb9-87e2-e2ca5b9c4297 req-a3760701-af85-42a6-b621-94175438d3d6 service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Received unexpected event network-vif-plugged-9c3aade6-4181-435d-aabd-07988112a373 for instance with vm_state resized and task_state resize_reverting.
Dec 01 17:15:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:40 user nova-compute[75745]: DEBUG nova.compute.manager [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:15:40 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Instance running successfully.
Dec 01 17:15:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] finish_revert_migration finished successfully. {{(pid=75745) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11857}}
Dec 01 17:15:41 user nova-compute[75745]: INFO nova.compute.manager [None req-7d1e3661-3dd5-453b-a841-d4c5fc4ffdab tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Updating instance to original state: 'active'
Dec 01 17:15:41 user nova-compute[75745]: DEBUG nova.compute.manager [req-1815819c-c21a-4762-bbd1-73c05f5858c6 req-4becfbc6-656c-42e3-9dd7-ec81a3f959c4 service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Received event network-vif-plugged-9c3aade6-4181-435d-aabd-07988112a373 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:15:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1815819c-c21a-4762-bbd1-73c05f5858c6 req-4becfbc6-656c-42e3-9dd7-ec81a3f959c4 service nova] Acquiring lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:15:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1815819c-c21a-4762-bbd1-73c05f5858c6 req-4becfbc6-656c-42e3-9dd7-ec81a3f959c4 service nova] Lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:15:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1815819c-c21a-4762-bbd1-73c05f5858c6 req-4becfbc6-656c-42e3-9dd7-ec81a3f959c4 service nova] Lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:15:41 user nova-compute[75745]: DEBUG nova.compute.manager [req-1815819c-c21a-4762-bbd1-73c05f5858c6 req-4becfbc6-656c-42e3-9dd7-ec81a3f959c4 service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] No waiting events found dispatching network-vif-plugged-9c3aade6-4181-435d-aabd-07988112a373 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:15:41 user nova-compute[75745]: WARNING nova.compute.manager [req-1815819c-c21a-4762-bbd1-73c05f5858c6 req-4becfbc6-656c-42e3-9dd7-ec81a3f959c4 service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Received unexpected event network-vif-plugged-9c3aade6-4181-435d-aabd-07988112a373 for instance with vm_state resized and task_state resize_reverting.
Dec 01 17:15:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:42 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:15:43 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:15:43 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:15:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8d36bc38-8dca-4a72-9fb5-0e34d59096bb tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:15:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8d36bc38-8dca-4a72-9fb5-0e34d59096bb tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:15:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8d36bc38-8dca-4a72-9fb5-0e34d59096bb tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:15:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8d36bc38-8dca-4a72-9fb5-0e34d59096bb tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:15:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8d36bc38-8dca-4a72-9fb5-0e34d59096bb tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:15:44 user nova-compute[75745]: INFO nova.compute.manager [None req-8d36bc38-8dca-4a72-9fb5-0e34d59096bb tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Terminating instance
Dec 01 17:15:44 user nova-compute[75745]: DEBUG nova.compute.manager [None req-8d36bc38-8dca-4a72-9fb5-0e34d59096bb tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:15:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:44 user nova-compute[75745]: DEBUG nova.compute.manager [req-43095795-b36f-443d-a80f-66ad7bf15292 req-bfd72aad-2c4f-4ffc-a7b6-9586d725fdb2 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Received event network-vif-unplugged-b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:15:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-43095795-b36f-443d-a80f-66ad7bf15292 req-bfd72aad-2c4f-4ffc-a7b6-9586d725fdb2 service nova] Acquiring lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:15:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-43095795-b36f-443d-a80f-66ad7bf15292 req-bfd72aad-2c4f-4ffc-a7b6-9586d725fdb2 service nova] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:15:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-43095795-b36f-443d-a80f-66ad7bf15292 req-bfd72aad-2c4f-4ffc-a7b6-9586d725fdb2 service nova] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:15:44 user nova-compute[75745]: DEBUG nova.compute.manager [req-43095795-b36f-443d-a80f-66ad7bf15292 req-bfd72aad-2c4f-4ffc-a7b6-9586d725fdb2 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] No waiting events found dispatching network-vif-unplugged-b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:15:44 user nova-compute[75745]: DEBUG nova.compute.manager [req-43095795-b36f-443d-a80f-66ad7bf15292 req-bfd72aad-2c4f-4ffc-a7b6-9586d725fdb2 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Received event network-vif-unplugged-b4990a3b-371a-44eb-98d8-685dc63590da for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:15:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-3c8e1f8e-397b-4cdd-938f-29740afb7ac4 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Acquiring lock "e122638a-a52a-445b-a79e-91c76dc94a64" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:15:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-3c8e1f8e-397b-4cdd-938f-29740afb7ac4 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Lock "e122638a-a52a-445b-a79e-91c76dc94a64" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:15:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-3c8e1f8e-397b-4cdd-938f-29740afb7ac4 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Acquiring lock "e122638a-a52a-445b-a79e-91c76dc94a64-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:15:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-3c8e1f8e-397b-4cdd-938f-29740afb7ac4 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Lock "e122638a-a52a-445b-a79e-91c76dc94a64-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:15:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-3c8e1f8e-397b-4cdd-938f-29740afb7ac4 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Lock "e122638a-a52a-445b-a79e-91c76dc94a64-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:15:44 user nova-compute[75745]: INFO nova.compute.manager [None req-3c8e1f8e-397b-4cdd-938f-29740afb7ac4 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Terminating instance
Dec 01 17:15:44 user nova-compute[75745]: DEBUG nova.compute.manager [None req-3c8e1f8e-397b-4cdd-938f-29740afb7ac4 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:15:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:44 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:15:44 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:15:44 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:15:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:44 user nova-compute[75745]: DEBUG nova.compute.manager [req-358cad27-60c7-4b47-ab74-e1c86b7f5539 req-00cdda71-be9c-4632-be10-cc0e8c041f59 service nova] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Received event network-vif-unplugged-1713fd8b-927a-4698-9013-7eebf0815bf8 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:15:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-358cad27-60c7-4b47-ab74-e1c86b7f5539 req-00cdda71-be9c-4632-be10-cc0e8c041f59 service nova] Acquiring lock "e122638a-a52a-445b-a79e-91c76dc94a64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:15:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-358cad27-60c7-4b47-ab74-e1c86b7f5539 req-00cdda71-be9c-4632-be10-cc0e8c041f59 service nova] Lock "e122638a-a52a-445b-a79e-91c76dc94a64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:15:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-358cad27-60c7-4b47-ab74-e1c86b7f5539 req-00cdda71-be9c-4632-be10-cc0e8c041f59 service nova] Lock "e122638a-a52a-445b-a79e-91c76dc94a64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:15:44 user nova-compute[75745]: DEBUG nova.compute.manager [req-358cad27-60c7-4b47-ab74-e1c86b7f5539 req-00cdda71-be9c-4632-be10-cc0e8c041f59 service nova] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] No waiting events found dispatching network-vif-unplugged-1713fd8b-927a-4698-9013-7eebf0815bf8 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:15:44 user nova-compute[75745]: DEBUG nova.compute.manager [req-358cad27-60c7-4b47-ab74-e1c86b7f5539 req-00cdda71-be9c-4632-be10-cc0e8c041f59 service nova] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Received event network-vif-unplugged-1713fd8b-927a-4698-9013-7eebf0815bf8 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:45 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Instance destroyed successfully.
Dec 01 17:15:45 user nova-compute[75745]: DEBUG nova.objects.instance [None req-8d36bc38-8dca-4a72-9fb5-0e34d59096bb tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lazy-loading 'resources' on Instance uuid 4ac6f586-cc5b-4a3f-b374-4b2006a48427 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:15:45 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Instance destroyed successfully.
Dec 01 17:15:45 user nova-compute[75745]: DEBUG nova.objects.instance [None req-3c8e1f8e-397b-4cdd-938f-29740afb7ac4 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Lazy-loading 'resources' on Instance uuid e122638a-a52a-445b-a79e-91c76dc94a64 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-8d36bc38-8dca-4a72-9fb5-0e34d59096bb tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:05:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2091565177',display_name='tempest-AttachVolumeTestJSON-server-2091565177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2091565177',id=3,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3XjkUwzRZSzJkFVK8CajxZrqSjgRTlHxxeyK14q4pHPTuyqvoLAZM+Yf8NfQQKwzsK8V31lsj4YBhMGkfSH1VtWc/GskdhpcUVvoTFK+eiPPk/qO2e2As1y2z8e2iGKw==',key_name='tempest-keypair-811365711',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:06:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c4e507763844b67b588fa2509ec3aff',ramdisk_id='',reservation_id='r-38xwk32b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-712829532',owner_user_name='tempest-AttachVolumeTestJSON-712829532-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:13:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e92e1fa18cc4bdaa17afd2b2db97259',uuid=4ac6f586-cc5b-4a3f-b374-4b2006a48427,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4990a3b-371a-44eb-98d8-685dc63590da", "address": "fa:16:3e:d3:4e:b4", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4990a3b-37", "ovs_interfaceid": "b4990a3b-371a-44eb-98d8-685dc63590da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-8d36bc38-8dca-4a72-9fb5-0e34d59096bb tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Converting VIF {"id": "b4990a3b-371a-44eb-98d8-685dc63590da", "address": "fa:16:3e:d3:4e:b4", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4990a3b-37", "ovs_interfaceid": "b4990a3b-371a-44eb-98d8-685dc63590da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-8d36bc38-8dca-4a72-9fb5-0e34d59096bb tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:4e:b4,bridge_name='br-int',has_traffic_filtering=True,id=b4990a3b-371a-44eb-98d8-685dc63590da,network=Network(b2b1c054-5370-4c64-9fb7-b98791c8f5ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4990a3b-37') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG os_vif [None req-8d36bc38-8dca-4a72-9fb5-0e34d59096bb tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:4e:b4,bridge_name='br-int',has_traffic_filtering=True,id=b4990a3b-371a-44eb-98d8-685dc63590da,network=Network(b2b1c054-5370-4c64-9fb7-b98791c8f5ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4990a3b-37') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4990a3b-37, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-3c8e1f8e-397b-4cdd-938f-29740afb7ac4 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:13:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-251859014',display_name='tempest-VolumesActionsTest-instance-251859014',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-251859014',id=21,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:14:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b88dee991f154d659d74d3dd5be6a231',ramdisk_id='',reservation_id='r-3ccxqozt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1774873278',owner_user_name='tempest-VolumesActionsTest-1774873278-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:14:01Z,user_data=None,user_id='52fef9da772c4f8ba9f4be1b168ad305',uuid=e122638a-a52a-445b-a79e-91c76dc94a64,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1713fd8b-927a-4698-9013-7eebf0815bf8", "address": "fa:16:3e:10:c8:a2", "network": {"id": "3bcde777-87d9-442e-a2ff-85106f3b0299", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1741466836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b88dee991f154d659d74d3dd5be6a231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1713fd8b-92", "ovs_interfaceid": "1713fd8b-927a-4698-9013-7eebf0815bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-3c8e1f8e-397b-4cdd-938f-29740afb7ac4 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Converting VIF {"id": "1713fd8b-927a-4698-9013-7eebf0815bf8", "address": "fa:16:3e:10:c8:a2", "network": {"id": "3bcde777-87d9-442e-a2ff-85106f3b0299", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1741466836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b88dee991f154d659d74d3dd5be6a231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1713fd8b-92", "ovs_interfaceid": "1713fd8b-927a-4698-9013-7eebf0815bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-3c8e1f8e-397b-4cdd-938f-29740afb7ac4 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:c8:a2,bridge_name='br-int',has_traffic_filtering=True,id=1713fd8b-927a-4698-9013-7eebf0815bf8,network=Network(3bcde777-87d9-442e-a2ff-85106f3b0299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1713fd8b-92') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG os_vif [None req-3c8e1f8e-397b-4cdd-938f-29740afb7ac4 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:c8:a2,bridge_name='br-int',has_traffic_filtering=True,id=1713fd8b-927a-4698-9013-7eebf0815bf8,network=Network(3bcde777-87d9-442e-a2ff-85106f3b0299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1713fd8b-92') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1713fd8b-92, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=43c8d8a2-ad14-49df-90c4-27653410bd2e) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=76588ac2-ee0b-4348-86c1-7d4160d6a18e) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:45 user nova-compute[75745]: INFO os_vif [None req-8d36bc38-8dca-4a72-9fb5-0e34d59096bb tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:4e:b4,bridge_name='br-int',has_traffic_filtering=True,id=b4990a3b-371a-44eb-98d8-685dc63590da,network=Network(b2b1c054-5370-4c64-9fb7-b98791c8f5ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4990a3b-37')
Dec 01 17:15:45 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-8d36bc38-8dca-4a72-9fb5-0e34d59096bb tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Deleting instance files /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427_del
Dec 01 17:15:45 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-8d36bc38-8dca-4a72-9fb5-0e34d59096bb tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Deletion of /opt/stack/data/nova/instances/4ac6f586-cc5b-4a3f-b374-4b2006a48427_del complete
Dec 01 17:15:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:45 user nova-compute[75745]: INFO os_vif [None req-3c8e1f8e-397b-4cdd-938f-29740afb7ac4 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:c8:a2,bridge_name='br-int',has_traffic_filtering=True,id=1713fd8b-927a-4698-9013-7eebf0815bf8,network=Network(3bcde777-87d9-442e-a2ff-85106f3b0299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1713fd8b-92')
Dec 01 17:15:45 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-3c8e1f8e-397b-4cdd-938f-29740afb7ac4 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Deleting instance files /opt/stack/data/nova/instances/e122638a-a52a-445b-a79e-91c76dc94a64_del
Dec 01 17:15:45 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-3c8e1f8e-397b-4cdd-938f-29740afb7ac4 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Deletion of /opt/stack/data/nova/instances/e122638a-a52a-445b-a79e-91c76dc94a64_del complete
Dec 01 17:15:45 user nova-compute[75745]: INFO nova.compute.manager [None req-3c8e1f8e-397b-4cdd-938f-29740afb7ac4 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Took 0.93 seconds to destroy the instance on the hypervisor.
Dec 01 17:15:45 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-3c8e1f8e-397b-4cdd-938f-29740afb7ac4 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:15:45 user nova-compute[75745]: INFO nova.compute.manager [None req-8d36bc38-8dca-4a72-9fb5-0e34d59096bb tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Took 1.38 seconds to destroy the instance on the hypervisor.
Dec 01 17:15:45 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-8d36bc38-8dca-4a72-9fb5-0e34d59096bb tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:46 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:15:46 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Took 0.72 seconds to deallocate network for instance.
Dec 01 17:15:46 user nova-compute[75745]: DEBUG nova.compute.manager [req-87baf440-a6ed-422f-a97d-c9ab2bda3ba6 req-b5fa94ff-720c-406a-b4f3-a647cb9a53ba service nova] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Received event network-vif-deleted-1713fd8b-927a-4698-9013-7eebf0815bf8 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:15:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-3c8e1f8e-397b-4cdd-938f-29740afb7ac4 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:15:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-3c8e1f8e-397b-4cdd-938f-29740afb7ac4 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:15:46 user nova-compute[75745]: DEBUG nova.compute.manager [req-52f25f85-c39d-4407-8c9f-ef1afdc73175 req-08471d5c-0ba3-4115-bb3f-242d2d2b4e31 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Received event network-vif-plugged-b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:15:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-52f25f85-c39d-4407-8c9f-ef1afdc73175 req-08471d5c-0ba3-4115-bb3f-242d2d2b4e31 service nova] Acquiring lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:15:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-52f25f85-c39d-4407-8c9f-ef1afdc73175 req-08471d5c-0ba3-4115-bb3f-242d2d2b4e31 service nova] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:15:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-52f25f85-c39d-4407-8c9f-ef1afdc73175 req-08471d5c-0ba3-4115-bb3f-242d2d2b4e31 service nova] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:15:46 user nova-compute[75745]: DEBUG nova.compute.manager [req-52f25f85-c39d-4407-8c9f-ef1afdc73175 req-08471d5c-0ba3-4115-bb3f-242d2d2b4e31 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] No waiting events found dispatching network-vif-plugged-b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:15:46 user nova-compute[75745]: WARNING nova.compute.manager [req-52f25f85-c39d-4407-8c9f-ef1afdc73175 req-08471d5c-0ba3-4115-bb3f-242d2d2b4e31 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Received unexpected event network-vif-plugged-b4990a3b-371a-44eb-98d8-685dc63590da for instance with vm_state active and task_state deleting.
Dec 01 17:15:46 user nova-compute[75745]: DEBUG nova.compute.manager [req-52f25f85-c39d-4407-8c9f-ef1afdc73175 req-08471d5c-0ba3-4115-bb3f-242d2d2b4e31 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Received event network-vif-plugged-b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:15:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-52f25f85-c39d-4407-8c9f-ef1afdc73175 req-08471d5c-0ba3-4115-bb3f-242d2d2b4e31 service nova] Acquiring lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:15:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-52f25f85-c39d-4407-8c9f-ef1afdc73175 req-08471d5c-0ba3-4115-bb3f-242d2d2b4e31 service nova] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:15:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-52f25f85-c39d-4407-8c9f-ef1afdc73175 req-08471d5c-0ba3-4115-bb3f-242d2d2b4e31 service nova] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:15:46 user nova-compute[75745]: DEBUG nova.compute.manager [req-52f25f85-c39d-4407-8c9f-ef1afdc73175 req-08471d5c-0ba3-4115-bb3f-242d2d2b4e31 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] No waiting events found dispatching network-vif-plugged-b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:15:46 user nova-compute[75745]: WARNING nova.compute.manager [req-52f25f85-c39d-4407-8c9f-ef1afdc73175 req-08471d5c-0ba3-4115-bb3f-242d2d2b4e31 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Received unexpected event network-vif-plugged-b4990a3b-371a-44eb-98d8-685dc63590da for instance with vm_state active and task_state deleting.
Dec 01 17:15:46 user nova-compute[75745]: DEBUG nova.compute.manager [req-52f25f85-c39d-4407-8c9f-ef1afdc73175 req-08471d5c-0ba3-4115-bb3f-242d2d2b4e31 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Received event network-vif-plugged-b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:15:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-52f25f85-c39d-4407-8c9f-ef1afdc73175 req-08471d5c-0ba3-4115-bb3f-242d2d2b4e31 service nova] Acquiring lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:15:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-52f25f85-c39d-4407-8c9f-ef1afdc73175 req-08471d5c-0ba3-4115-bb3f-242d2d2b4e31 service nova] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:15:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-52f25f85-c39d-4407-8c9f-ef1afdc73175 req-08471d5c-0ba3-4115-bb3f-242d2d2b4e31 service nova] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:15:46 user nova-compute[75745]: DEBUG nova.compute.manager [req-52f25f85-c39d-4407-8c9f-ef1afdc73175 req-08471d5c-0ba3-4115-bb3f-242d2d2b4e31 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] No waiting events found dispatching network-vif-plugged-b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:15:46 user nova-compute[75745]: WARNING nova.compute.manager [req-52f25f85-c39d-4407-8c9f-ef1afdc73175 req-08471d5c-0ba3-4115-bb3f-242d2d2b4e31 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Received unexpected event network-vif-plugged-b4990a3b-371a-44eb-98d8-685dc63590da for instance with vm_state active and task_state deleting.
Dec 01 17:15:46 user nova-compute[75745]: DEBUG nova.compute.manager [req-52f25f85-c39d-4407-8c9f-ef1afdc73175 req-08471d5c-0ba3-4115-bb3f-242d2d2b4e31 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Received event network-vif-unplugged-b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:15:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-52f25f85-c39d-4407-8c9f-ef1afdc73175 req-08471d5c-0ba3-4115-bb3f-242d2d2b4e31 service nova] Acquiring lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:15:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-52f25f85-c39d-4407-8c9f-ef1afdc73175 req-08471d5c-0ba3-4115-bb3f-242d2d2b4e31 service nova] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:15:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-52f25f85-c39d-4407-8c9f-ef1afdc73175 req-08471d5c-0ba3-4115-bb3f-242d2d2b4e31 service nova] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:15:46 user nova-compute[75745]: DEBUG nova.compute.manager [req-52f25f85-c39d-4407-8c9f-ef1afdc73175 req-08471d5c-0ba3-4115-bb3f-242d2d2b4e31 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] No waiting events found dispatching network-vif-unplugged-b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:15:46 user nova-compute[75745]: DEBUG nova.compute.manager [req-52f25f85-c39d-4407-8c9f-ef1afdc73175 req-08471d5c-0ba3-4115-bb3f-242d2d2b4e31 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Received event network-vif-unplugged-b4990a3b-371a-44eb-98d8-685dc63590da for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:15:46 user nova-compute[75745]: DEBUG nova.compute.manager [req-52f25f85-c39d-4407-8c9f-ef1afdc73175 req-08471d5c-0ba3-4115-bb3f-242d2d2b4e31 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Received event network-vif-plugged-b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:15:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-52f25f85-c39d-4407-8c9f-ef1afdc73175 req-08471d5c-0ba3-4115-bb3f-242d2d2b4e31 service nova] Acquiring lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:15:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-52f25f85-c39d-4407-8c9f-ef1afdc73175 req-08471d5c-0ba3-4115-bb3f-242d2d2b4e31 service nova] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:15:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-52f25f85-c39d-4407-8c9f-ef1afdc73175 req-08471d5c-0ba3-4115-bb3f-242d2d2b4e31 service nova] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:15:46 user nova-compute[75745]: DEBUG nova.compute.manager [req-52f25f85-c39d-4407-8c9f-ef1afdc73175 req-08471d5c-0ba3-4115-bb3f-242d2d2b4e31 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] No waiting events found dispatching network-vif-plugged-b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:15:46 user nova-compute[75745]: WARNING nova.compute.manager [req-52f25f85-c39d-4407-8c9f-ef1afdc73175 req-08471d5c-0ba3-4115-bb3f-242d2d2b4e31 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Received unexpected event network-vif-plugged-b4990a3b-371a-44eb-98d8-685dc63590da for instance with vm_state active and task_state deleting.
Dec 01 17:15:46 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-3c8e1f8e-397b-4cdd-938f-29740afb7ac4 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:15:46 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-3c8e1f8e-397b-4cdd-938f-29740afb7ac4 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:15:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-3c8e1f8e-397b-4cdd-938f-29740afb7ac4 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.497s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:15:46 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-3c8e1f8e-397b-4cdd-938f-29740afb7ac4 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Deleted allocations for instance e122638a-a52a-445b-a79e-91c76dc94a64
Dec 01 17:15:46 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:15:46 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:15:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-3c8e1f8e-397b-4cdd-938f-29740afb7ac4 tempest-VolumesActionsTest-1774873278 tempest-VolumesActionsTest-1774873278-project-member] Lock "e122638a-a52a-445b-a79e-91c76dc94a64" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.409s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:15:47 user nova-compute[75745]: DEBUG nova.compute.manager [req-058f6dab-0267-4c96-bc7a-4f8d36123ef3 req-11316e0a-2949-4efc-95cd-6467c8b1f9aa service nova] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Received event network-vif-plugged-1713fd8b-927a-4698-9013-7eebf0815bf8 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:15:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-058f6dab-0267-4c96-bc7a-4f8d36123ef3 req-11316e0a-2949-4efc-95cd-6467c8b1f9aa service nova] Acquiring lock "e122638a-a52a-445b-a79e-91c76dc94a64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:15:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-058f6dab-0267-4c96-bc7a-4f8d36123ef3 req-11316e0a-2949-4efc-95cd-6467c8b1f9aa service nova] Lock "e122638a-a52a-445b-a79e-91c76dc94a64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:15:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-058f6dab-0267-4c96-bc7a-4f8d36123ef3 req-11316e0a-2949-4efc-95cd-6467c8b1f9aa service nova] Lock "e122638a-a52a-445b-a79e-91c76dc94a64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:15:47 user nova-compute[75745]: DEBUG nova.compute.manager [req-058f6dab-0267-4c96-bc7a-4f8d36123ef3 req-11316e0a-2949-4efc-95cd-6467c8b1f9aa service nova] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] No waiting events found dispatching network-vif-plugged-1713fd8b-927a-4698-9013-7eebf0815bf8 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:15:47 user nova-compute[75745]: WARNING nova.compute.manager [req-058f6dab-0267-4c96-bc7a-4f8d36123ef3 req-11316e0a-2949-4efc-95cd-6467c8b1f9aa service nova] [instance: e122638a-a52a-445b-a79e-91c76dc94a64] Received unexpected event network-vif-plugged-1713fd8b-927a-4698-9013-7eebf0815bf8 for instance with vm_state deleted and task_state None.
Dec 01 17:15:47 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:15:47 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Took 1.55 seconds to deallocate network for instance.
Dec 01 17:15:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8d36bc38-8dca-4a72-9fb5-0e34d59096bb tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:15:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8d36bc38-8dca-4a72-9fb5-0e34d59096bb tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:15:47 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-8d36bc38-8dca-4a72-9fb5-0e34d59096bb tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:15:47 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-8d36bc38-8dca-4a72-9fb5-0e34d59096bb tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:15:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8d36bc38-8dca-4a72-9fb5-0e34d59096bb tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:15:47 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-8d36bc38-8dca-4a72-9fb5-0e34d59096bb tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Deleted allocations for instance 4ac6f586-cc5b-4a3f-b374-4b2006a48427
Dec 01 17:15:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8d36bc38-8dca-4a72-9fb5-0e34d59096bb tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "4ac6f586-cc5b-4a3f-b374-4b2006a48427" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.534s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:15:47 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:15:47 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:15:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:15:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:15:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:15:47 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:15:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:48 user nova-compute[75745]: DEBUG nova.compute.manager [req-71457938-d247-4d79-bce8-3ba9fdb541e1 req-c578e2c8-82f0-453f-a886-77304e58cf53 service nova] [instance: 4ac6f586-cc5b-4a3f-b374-4b2006a48427] Received event network-vif-deleted-b4990a3b-371a-44eb-98d8-685dc63590da {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:15:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:48 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:50 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:15:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/308f5fad-3a32-4104-b9ec-c51ed08f2a3c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Acquiring lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:15:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:15:50 user nova-compute[75745]: DEBUG nova.objects.instance [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lazy-loading 'flavor' on Instance uuid 0ab0c115-74aa-4e55-92a3-6fa91ba753e3 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:15:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:15:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/308f5fad-3a32-4104-b9ec-c51ed08f2a3c/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/308f5fad-3a32-4104-b9ec-c51ed08f2a3c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Acquiring lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:15:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:15:51 user nova-compute[75745]: INFO nova.compute.manager [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Attaching volume 1946fef7-8668-4826-b747-aee6dfef5127 to /dev/vdb
Dec 01 17:15:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/308f5fad-3a32-4104-b9ec-c51ed08f2a3c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:51 user nova-compute[75745]: DEBUG os_brick.utils [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:15:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:51 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c956c8e-1eb3-4fcf-ba6e-fef912663434]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:51 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9400ff-8ca0-4222-ac6d-e178eae5dbeb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:51 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7018ed5b-ea06-4ad3-ace0-13385a4cd880]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:51 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7aedd21-8484-4fb5-bb24-1d3de9c710ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:15:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:15:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:15:51 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:15:51 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[052aeaf4-f804-48ca-afdf-b1e92b6d9f8f]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:15:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:15:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:15:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:15:51 user nova-compute[75745]: DEBUG os_brick.utils [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:15:51 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Updating existing volume attachment record: 236f6d32-2826-4968-9888-06aebf47217e {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:15:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:51 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:15:51 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:15:51 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=7618MB free_disk=25.36711883544922GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:15:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:15:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:15:52 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance d997cdd6-67c6-4263-814a-17cf9e27bbeb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:15:52 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 3a56aca8-ffbb-450b-a953-fc2071902486 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:15:52 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 0ab0c115-74aa-4e55-92a3-6fa91ba753e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:15:52 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 98b29ba5-9993-4494-b196-f7eea077df7a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:15:52 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance e4ffb96e-456c-4fb9-9850-9e98310d63e5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:15:52 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 80962f79-dbb2-4380-b2c8-791642cfa86b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:15:52 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance a690fa65-078d-4ffd-bc62-3366aaa3d681 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:15:52 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 308f5fad-3a32-4104-b9ec-c51ed08f2a3c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:15:52 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 9aca117f-581a-4625-abf1-c7faba669572 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:15:52 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:15:52 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:15:52 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:15:52 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:15:52 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:15:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.413s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:15:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:55 user nova-compute[75745]: INFO nova.compute.manager [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Rescuing
Dec 01 17:15:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "refresh_cache-80962f79-dbb2-4380-b2c8-791642cfa86b" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:15:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquired lock "refresh_cache-80962f79-dbb2-4380-b2c8-791642cfa86b" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:15:55 user nova-compute[75745]: DEBUG nova.network.neutron [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:15:55 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:15:55 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:15:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-3a56aca8-ffbb-450b-a953-fc2071902486" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:15:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-3a56aca8-ffbb-450b-a953-fc2071902486" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:15:55 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:15:55 user nova-compute[75745]: DEBUG nova.network.neutron [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Updating instance_info_cache with network_info: [{"id": "68718048-8e77-438b-a7e0-15675cc9e543", "address": "fa:16:3e:bf:09:08", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68718048-8e", "ovs_interfaceid": "68718048-8e77-438b-a7e0-15675cc9e543", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:15:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Releasing lock "refresh_cache-80962f79-dbb2-4380-b2c8-791642cfa86b" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:15:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-4fcfe627-394b-4314-aa2d-18ee607ed27c req-1af4b0e5-5689-4e82-9b42-2168b9c19547 service nova] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Received event network-vif-unplugged-68718048-8e77-438b-a7e0-15675cc9e543 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-4fcfe627-394b-4314-aa2d-18ee607ed27c req-1af4b0e5-5689-4e82-9b42-2168b9c19547 service nova] Acquiring lock "80962f79-dbb2-4380-b2c8-791642cfa86b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-4fcfe627-394b-4314-aa2d-18ee607ed27c req-1af4b0e5-5689-4e82-9b42-2168b9c19547 service nova] Lock "80962f79-dbb2-4380-b2c8-791642cfa86b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-4fcfe627-394b-4314-aa2d-18ee607ed27c req-1af4b0e5-5689-4e82-9b42-2168b9c19547 service nova] Lock "80962f79-dbb2-4380-b2c8-791642cfa86b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-4fcfe627-394b-4314-aa2d-18ee607ed27c req-1af4b0e5-5689-4e82-9b42-2168b9c19547 service nova] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] No waiting events found dispatching network-vif-unplugged-68718048-8e77-438b-a7e0-15675cc9e543 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:15:56 user nova-compute[75745]: WARNING nova.compute.manager [req-4fcfe627-394b-4314-aa2d-18ee607ed27c req-1af4b0e5-5689-4e82-9b42-2168b9c19547 service nova] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Received unexpected event network-vif-unplugged-68718048-8e77-438b-a7e0-15675cc9e543 for instance with vm_state active and task_state rescuing.
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Updating instance_info_cache with network_info: [{"id": "0bfa2344-df4f-4c3a-9b5d-97b85e4b2515", "address": "fa:16:3e:3a:4a:12", "network": {"id": "b40e2616-f366-491f-a652-c99fc1c6b989", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-538343107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0919015c0904a8481a5297b6aa9af40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfa2344-df", "ovs_interfaceid": "0bfa2344-df4f-4c3a-9b5d-97b85e4b2515", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-3a56aca8-ffbb-450b-a953-fc2071902486" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:15:56 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Instance destroyed successfully.
Dec 01 17:15:56 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Attempting rescue
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75745) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Instance directory exists: not creating {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Dec 01 17:15:56 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Creating image(s)
Dec 01 17:15:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "/opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "/opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "/opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.objects.instance [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lazy-loading 'trusted_certs' on Instance uuid 80962f79-dbb2-4380-b2c8-791642cfa86b {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.172s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue" returned: 0 in 0.047s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.objects.instance [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lazy-loading 'migration_context' on Instance uuid 80962f79-dbb2-4380-b2c8-791642cfa86b {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.objects.base [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Object Instance<80962f79-dbb2-4380-b2c8-791642cfa86b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Start _get_guest_xml network_info=[{"id": "68718048-8e77-438b-a7e0-15675cc9e543", "address": "fa:16:3e:bf:09:08", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "vif_mac": "fa:16:3e:bf:09:08"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68718048-8e", "ovs_interfaceid": "68718048-8e77-438b-a7e0-15675cc9e543", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.objects.instance [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lazy-loading 'resources' on Instance uuid 80962f79-dbb2-4380-b2c8-791642cfa86b {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.objects.base [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Object Instance<80962f79-dbb2-4380-b2c8-791642cfa86b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.objects.instance [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lazy-loading 'numa_topology' on Instance uuid 80962f79-dbb2-4380-b2c8-791642cfa86b {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.objects.base [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Object Instance<80962f79-dbb2-4380-b2c8-791642cfa86b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:15:56 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:15:56 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.objects.instance [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lazy-loading 'vcpu_model' on Instance uuid 80962f79-dbb2-4380-b2c8-791642cfa86b {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.objects.base [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Object Instance<80962f79-dbb2-4380-b2c8-791642cfa86b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:14:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1242750524',display_name='tempest-ServerRescueNegativeTestJSON-server-1242750524',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1242750524',id=23,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:14:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4542114c14774241bb138dfafe3441ad',ramdisk_id='',reservation_id='r-6q139kig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1719994145',owner_user_name='tempest-ServerRescueNegativeTestJSON-1719994145-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:14:13Z,user_data=None,user_id='7bd90117cc3c433d953b7e0de3718f0d',uuid=80962f79-dbb2-4380-b2c8-791642cfa86b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68718048-8e77-438b-a7e0-15675cc9e543", "address": "fa:16:3e:bf:09:08", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "vif_mac": "fa:16:3e:bf:09:08"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68718048-8e", "ovs_interfaceid": "68718048-8e77-438b-a7e0-15675cc9e543", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Converting VIF {"id": "68718048-8e77-438b-a7e0-15675cc9e543", "address": "fa:16:3e:bf:09:08", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "vif_mac": "fa:16:3e:bf:09:08"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68718048-8e", "ovs_interfaceid": "68718048-8e77-438b-a7e0-15675cc9e543", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:09:08,bridge_name='br-int',has_traffic_filtering=True,id=68718048-8e77-438b-a7e0-15675cc9e543,network=Network(fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68718048-8e') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.objects.instance [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lazy-loading 'pci_devices' on Instance uuid 80962f79-dbb2-4380-b2c8-791642cfa86b {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.objects.base [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Object Instance<80962f79-dbb2-4380-b2c8-791642cfa86b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:15:56 user nova-compute[75745]:   <uuid>80962f79-dbb2-4380-b2c8-791642cfa86b</uuid>
Dec 01 17:15:56 user nova-compute[75745]:   <name>instance-00000017</name>
Dec 01 17:15:56 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:15:56 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:15:56 user nova-compute[75745]:   <metadata>
Dec 01 17:15:56 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:15:56 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:15:56 user nova-compute[75745]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1242750524</nova:name>
Dec 01 17:15:56 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:15:56</nova:creationTime>
Dec 01 17:15:56 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:15:56 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:15:56 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:15:56 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:15:56 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:15:56 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:15:56 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:15:56 user nova-compute[75745]:       <nova:owner>
Dec 01 17:15:56 user nova-compute[75745]:         <nova:user uuid="7bd90117cc3c433d953b7e0de3718f0d">tempest-ServerRescueNegativeTestJSON-1719994145-project-member</nova:user>
Dec 01 17:15:56 user nova-compute[75745]:         <nova:project uuid="4542114c14774241bb138dfafe3441ad">tempest-ServerRescueNegativeTestJSON-1719994145</nova:project>
Dec 01 17:15:56 user nova-compute[75745]:       </nova:owner>
Dec 01 17:15:56 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:15:56 user nova-compute[75745]:       <nova:ports>
Dec 01 17:15:56 user nova-compute[75745]:         <nova:port uuid="68718048-8e77-438b-a7e0-15675cc9e543">
Dec 01 17:15:56 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 01 17:15:56 user nova-compute[75745]:         </nova:port>
Dec 01 17:15:56 user nova-compute[75745]:       </nova:ports>
Dec 01 17:15:56 user nova-compute[75745]:     </nova:instance>
Dec 01 17:15:56 user nova-compute[75745]:   </metadata>
Dec 01 17:15:56 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:15:56 user nova-compute[75745]:     <system>
Dec 01 17:15:56 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:15:56 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:15:56 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:15:56 user nova-compute[75745]:       <entry name="serial">80962f79-dbb2-4380-b2c8-791642cfa86b</entry>
Dec 01 17:15:56 user nova-compute[75745]:       <entry name="uuid">80962f79-dbb2-4380-b2c8-791642cfa86b</entry>
Dec 01 17:15:56 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:15:56 user nova-compute[75745]:     </system>
Dec 01 17:15:56 user nova-compute[75745]:   </sysinfo>
Dec 01 17:15:56 user nova-compute[75745]:   <os>
Dec 01 17:15:56 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:15:56 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:15:56 user nova-compute[75745]:   </os>
Dec 01 17:15:56 user nova-compute[75745]:   <features>
Dec 01 17:15:56 user nova-compute[75745]:     <acpi/>
Dec 01 17:15:56 user nova-compute[75745]:     <apic/>
Dec 01 17:15:56 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:15:56 user nova-compute[75745]:   </features>
Dec 01 17:15:56 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:15:56 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:15:56 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:15:56 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:15:56 user nova-compute[75745]:   </clock>
Dec 01 17:15:56 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:15:56 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:15:56 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:15:56 user nova-compute[75745]:   </cpu>
Dec 01 17:15:56 user nova-compute[75745]:   <devices>
Dec 01 17:15:56 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:15:56 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:15:56 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue"/>
Dec 01 17:15:56 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:15:56 user nova-compute[75745]:     </disk>
Dec 01 17:15:56 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:15:56 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:15:56 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk"/>
Dec 01 17:15:56 user nova-compute[75745]:       <target dev="vdb" bus="virtio"/>
Dec 01 17:15:56 user nova-compute[75745]:     </disk>
Dec 01 17:15:56 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:15:56 user nova-compute[75745]:       <mac address="fa:16:3e:bf:09:08"/>
Dec 01 17:15:56 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:15:56 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:15:56 user nova-compute[75745]:       <target dev="tap68718048-8e"/>
Dec 01 17:15:56 user nova-compute[75745]:     </interface>
Dec 01 17:15:56 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:15:56 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/console.log" append="off"/>
Dec 01 17:15:56 user nova-compute[75745]:     </serial>
Dec 01 17:15:56 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:15:56 user nova-compute[75745]:     <video>
Dec 01 17:15:56 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:15:56 user nova-compute[75745]:     </video>
Dec 01 17:15:56 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:15:56 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:15:56 user nova-compute[75745]:     </rng>
Dec 01 17:15:56 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:15:56 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:15:56 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:15:56 user nova-compute[75745]:     </memballoon>
Dec 01 17:15:56 user nova-compute[75745]:   </devices>
Dec 01 17:15:56 user nova-compute[75745]: </domain>
Dec 01 17:15:56 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:15:56 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Instance destroyed successfully.
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:15:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] No VIF found with MAC fa:16:3e:bf:09:08, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:15:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-9ede8888-8e96-41ae-9f98-20d6e8dba539 req-de8514ea-1c0a-4889-975b-d7a0627ca301 service nova] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Received event network-vif-plugged-68718048-8e77-438b-a7e0-15675cc9e543 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:15:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-9ede8888-8e96-41ae-9f98-20d6e8dba539 req-de8514ea-1c0a-4889-975b-d7a0627ca301 service nova] Acquiring lock "80962f79-dbb2-4380-b2c8-791642cfa86b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:15:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-9ede8888-8e96-41ae-9f98-20d6e8dba539 req-de8514ea-1c0a-4889-975b-d7a0627ca301 service nova] Lock "80962f79-dbb2-4380-b2c8-791642cfa86b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:15:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-9ede8888-8e96-41ae-9f98-20d6e8dba539 req-de8514ea-1c0a-4889-975b-d7a0627ca301 service nova] Lock "80962f79-dbb2-4380-b2c8-791642cfa86b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:15:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-9ede8888-8e96-41ae-9f98-20d6e8dba539 req-de8514ea-1c0a-4889-975b-d7a0627ca301 service nova] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] No waiting events found dispatching network-vif-plugged-68718048-8e77-438b-a7e0-15675cc9e543 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:15:58 user nova-compute[75745]: WARNING nova.compute.manager [req-9ede8888-8e96-41ae-9f98-20d6e8dba539 req-de8514ea-1c0a-4889-975b-d7a0627ca301 service nova] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Received unexpected event network-vif-plugged-68718048-8e77-438b-a7e0-15675cc9e543 for instance with vm_state active and task_state rescuing.
Dec 01 17:15:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:15:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG nova.compute.manager [None req-259ad665-111d-4a51-9e7b-0fd870ff412d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG nova.compute.manager [req-c85cac31-87b6-4a87-8df2-eafab30a6441 req-4d9ce03f-1956-4889-a04d-014d15cb9e66 service nova] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Received event network-vif-plugged-68718048-8e77-438b-a7e0-15675cc9e543 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c85cac31-87b6-4a87-8df2-eafab30a6441 req-4d9ce03f-1956-4889-a04d-014d15cb9e66 service nova] Acquiring lock "80962f79-dbb2-4380-b2c8-791642cfa86b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c85cac31-87b6-4a87-8df2-eafab30a6441 req-4d9ce03f-1956-4889-a04d-014d15cb9e66 service nova] Lock "80962f79-dbb2-4380-b2c8-791642cfa86b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c85cac31-87b6-4a87-8df2-eafab30a6441 req-4d9ce03f-1956-4889-a04d-014d15cb9e66 service nova] Lock "80962f79-dbb2-4380-b2c8-791642cfa86b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG nova.compute.manager [req-c85cac31-87b6-4a87-8df2-eafab30a6441 req-4d9ce03f-1956-4889-a04d-014d15cb9e66 service nova] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] No waiting events found dispatching network-vif-plugged-68718048-8e77-438b-a7e0-15675cc9e543 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:16:00 user nova-compute[75745]: WARNING nova.compute.manager [req-c85cac31-87b6-4a87-8df2-eafab30a6441 req-4d9ce03f-1956-4889-a04d-014d15cb9e66 service nova] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Received unexpected event network-vif-plugged-68718048-8e77-438b-a7e0-15675cc9e543 for instance with vm_state active and task_state rescuing.
Dec 01 17:16:00 user nova-compute[75745]: DEBUG nova.compute.manager [req-c85cac31-87b6-4a87-8df2-eafab30a6441 req-4d9ce03f-1956-4889-a04d-014d15cb9e66 service nova] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Received event network-vif-plugged-68718048-8e77-438b-a7e0-15675cc9e543 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c85cac31-87b6-4a87-8df2-eafab30a6441 req-4d9ce03f-1956-4889-a04d-014d15cb9e66 service nova] Acquiring lock "80962f79-dbb2-4380-b2c8-791642cfa86b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c85cac31-87b6-4a87-8df2-eafab30a6441 req-4d9ce03f-1956-4889-a04d-014d15cb9e66 service nova] Lock "80962f79-dbb2-4380-b2c8-791642cfa86b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c85cac31-87b6-4a87-8df2-eafab30a6441 req-4d9ce03f-1956-4889-a04d-014d15cb9e66 service nova] Lock "80962f79-dbb2-4380-b2c8-791642cfa86b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG nova.compute.manager [req-c85cac31-87b6-4a87-8df2-eafab30a6441 req-4d9ce03f-1956-4889-a04d-014d15cb9e66 service nova] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] No waiting events found dispatching network-vif-plugged-68718048-8e77-438b-a7e0-15675cc9e543 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:16:00 user nova-compute[75745]: WARNING nova.compute.manager [req-c85cac31-87b6-4a87-8df2-eafab30a6441 req-4d9ce03f-1956-4889-a04d-014d15cb9e66 service nova] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Received unexpected event network-vif-plugged-68718048-8e77-438b-a7e0-15675cc9e543 for instance with vm_state active and task_state rescuing.
Dec 01 17:16:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PuqZaIch', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:16:00 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:16:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:16:00 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:16:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:16:00 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe219373-239d-4cf6-b599-f1fcec14aee0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:16:00 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[808d0742-ec44-4403-b14b-160eafff4083]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127] added
Dec 01 17:16:00 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ff3979-4a90-4e3e-99d1-16ca32e09bf6]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[11519532-7e2a-4b40-8d77-ef927485e9eb]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PuqZaIch {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PuqZaIch" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65ef52b-b669-4a41-bfcc-a00a167bb86c]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PuqZaIch'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8668f91d-a1b1-47f0-86be-0b88725bf9e7]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b372c60-8539-4a2a-a46d-776c161ef23d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:16:00 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:16:00 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e561e4c-e9a4-4e36-ad65-4c23d60d9122]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127, portal: 172.16.0.220,3260]
Dec 01 17:16:00 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127, portal: 172.16.0.220,3260] successful.
Dec 01 17:16:00 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74cd9fd-50d8-4586-a162-67e685023e8b]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[99200df7-9ffb-456e-8ef7-3bdf5cc54205]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:16:00 user nova-compute[75745]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127 (non-flash)
Dec 01 17:16:00 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:16:00 user nova-compute[75745]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127 (non-flash)
Dec 01 17:16:00 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe5aaa2-7541-4da1-a608-3c72da1b3688]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:16:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PuqZaIch', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:16:01 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:16:01 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26264356537373137', 'path': '/dev/sdc'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:16:01 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264356537373137', 'path': '/dev/sdc'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:16:01 user nova-compute[75745]: DEBUG nova.objects.instance [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lazy-loading 'flavor' on Instance uuid 0ab0c115-74aa-4e55-92a3-6fa91ba753e3 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:16:01 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 17:16:01 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:16:01 user nova-compute[75745]:   <source dev="/dev/sdc"/>
Dec 01 17:16:01 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:16:01 user nova-compute[75745]:   <serial>1946fef7-8668-4826-b747-aee6dfef5127</serial>
Dec 01 17:16:01 user nova-compute[75745]: </disk>
Dec 01 17:16:01 user nova-compute[75745]:  {{(pid=75745) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 17:16:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:16:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:16:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] No VIF found with MAC fa:16:3e:f5:29:5f, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:16:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-baf4f869-fa02-4420-8b14-cc40880ae470 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.142s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:16:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Acquiring lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:16:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:16:04 user nova-compute[75745]: INFO nova.compute.manager [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Detaching volume 1946fef7-8668-4826-b747-aee6dfef5127
Dec 01 17:16:04 user nova-compute[75745]: INFO nova.virt.block_device [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Attempting to driver detach volume 1946fef7-8668-4826-b747-aee6dfef5127 from mountpoint /dev/vdb
Dec 01 17:16:04 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Attempting to detach device vdb from instance 0ab0c115-74aa-4e55-92a3-6fa91ba753e3 from the persistent domain config. {{(pid=75745) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 17:16:04 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:16:04 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:16:04 user nova-compute[75745]:   <source dev="/dev/sdc"/>
Dec 01 17:16:04 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:16:04 user nova-compute[75745]:   <serial>1946fef7-8668-4826-b747-aee6dfef5127</serial>
Dec 01 17:16:04 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 17:16:04 user nova-compute[75745]: </disk>
Dec 01 17:16:04 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:16:04 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Successfully detached device vdb from instance 0ab0c115-74aa-4e55-92a3-6fa91ba753e3 from the persistent domain config.
Dec 01 17:16:04 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0ab0c115-74aa-4e55-92a3-6fa91ba753e3 from the live domain config. {{(pid=75745) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 17:16:04 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:16:04 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:16:04 user nova-compute[75745]:   <source dev="/dev/sdc"/>
Dec 01 17:16:04 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:16:04 user nova-compute[75745]:   <serial>1946fef7-8668-4826-b747-aee6dfef5127</serial>
Dec 01 17:16:04 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 17:16:04 user nova-compute[75745]: </disk>
Dec 01 17:16:04 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:16:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:04 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0ab0c115-74aa-4e55-92a3-6fa91ba753e3 {{(pid=75745) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 17:16:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Acquiring lock "ce212884-ddef-4db5-8b22-9f2e1502fadd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:16:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Lock "ce212884-ddef-4db5-8b22-9f2e1502fadd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:16:08 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:16:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:16:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:16:08 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:16:08 user nova-compute[75745]: INFO nova.compute.claims [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Claim successful on node user
Dec 01 17:16:08 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:16:08 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:16:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.371s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:16:08 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:16:09 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:16:09 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:16:09 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:16:09 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:16:09 user nova-compute[75745]: DEBUG nova.policy [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8b524e70f3794e81a2111cd12cab9abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0d8924495d400d978d7107a78b3167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:16:09 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:16:09 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:16:09 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Creating image(s)
Dec 01 17:16:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce212884-ddef-4db5-8b22-9f2e1502fadd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:16:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Lock "/opt/stack/data/nova/instances/ce212884-ddef-4db5-8b22-9f2e1502fadd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:16:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Lock "/opt/stack/data/nova/instances/ce212884-ddef-4db5-8b22-9f2e1502fadd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:16:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.175s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:16:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:16:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.178s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/ce212884-ddef-4db5-8b22-9f2e1502fadd/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/ce212884-ddef-4db5-8b22-9f2e1502fadd/disk 1073741824" returned: 0 in 0.051s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:16:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.172s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:09 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ce212884-ddef-4db5-8b22-9f2e1502fadd/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:16:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce212884-ddef-4db5-8b22-9f2e1502fadd/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:09 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Successfully created port: d242e0a1-01b7-44b9-8c6a-446c1c6e8876 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:16:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce212884-ddef-4db5-8b22-9f2e1502fadd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:09 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Cannot resize image /opt/stack/data/nova/instances/ce212884-ddef-4db5-8b22-9f2e1502fadd/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:16:09 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:16:09 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Ensure instance console log exists: /opt/stack/data/nova/instances/ce212884-ddef-4db5-8b22-9f2e1502fadd/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:16:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:16:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:16:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Successfully updated port: d242e0a1-01b7-44b9-8c6a-446c1c6e8876 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Acquiring lock "refresh_cache-ce212884-ddef-4db5-8b22-9f2e1502fadd" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Acquired lock "refresh_cache-ce212884-ddef-4db5-8b22-9f2e1502fadd" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG nova.compute.manager [req-de3de5b6-6274-4193-b089-051cbdd7c80c req-75ce0d28-c4d5-4271-a4a3-5473c8393f21 service nova] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Received event network-changed-d242e0a1-01b7-44b9-8c6a-446c1c6e8876 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG nova.compute.manager [req-de3de5b6-6274-4193-b089-051cbdd7c80c req-75ce0d28-c4d5-4271-a4a3-5473c8393f21 service nova] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Refreshing instance network info cache due to event network-changed-d242e0a1-01b7-44b9-8c6a-446c1c6e8876. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-de3de5b6-6274-4193-b089-051cbdd7c80c req-75ce0d28-c4d5-4271-a4a3-5473c8393f21 service nova] Acquiring lock "refresh_cache-ce212884-ddef-4db5-8b22-9f2e1502fadd" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Updating instance_info_cache with network_info: [{"id": "d242e0a1-01b7-44b9-8c6a-446c1c6e8876", "address": "fa:16:3e:d0:7e:f8", "network": {"id": "3b2feb84-7495-4ea1-8eb4-6fcb4763a75a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1599091175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0d8924495d400d978d7107a78b3167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd242e0a1-01", "ovs_interfaceid": "d242e0a1-01b7-44b9-8c6a-446c1c6e8876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Releasing lock "refresh_cache-ce212884-ddef-4db5-8b22-9f2e1502fadd" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Instance network_info: |[{"id": "d242e0a1-01b7-44b9-8c6a-446c1c6e8876", "address": "fa:16:3e:d0:7e:f8", "network": {"id": "3b2feb84-7495-4ea1-8eb4-6fcb4763a75a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1599091175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0d8924495d400d978d7107a78b3167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd242e0a1-01", "ovs_interfaceid": "d242e0a1-01b7-44b9-8c6a-446c1c6e8876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-de3de5b6-6274-4193-b089-051cbdd7c80c req-75ce0d28-c4d5-4271-a4a3-5473c8393f21 service nova] Acquired lock "refresh_cache-ce212884-ddef-4db5-8b22-9f2e1502fadd" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG nova.network.neutron [req-de3de5b6-6274-4193-b089-051cbdd7c80c req-75ce0d28-c4d5-4271-a4a3-5473c8393f21 service nova] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Refreshing network info cache for port d242e0a1-01b7-44b9-8c6a-446c1c6e8876 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Start _get_guest_xml network_info=[{"id": "d242e0a1-01b7-44b9-8c6a-446c1c6e8876", "address": "fa:16:3e:d0:7e:f8", "network": {"id": "3b2feb84-7495-4ea1-8eb4-6fcb4763a75a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1599091175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0d8924495d400d978d7107a78b3167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd242e0a1-01", "ovs_interfaceid": "d242e0a1-01b7-44b9-8c6a-446c1c6e8876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:16:10 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:16:10 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:16:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-466238503',display_name='tempest-ServersNegativeTestJSON-server-466238503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-466238503',id=27,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d0d8924495d400d978d7107a78b3167',ramdisk_id='',reservation_id='r-u7mqmks8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-67621407',owner_user_name='tempest-ServersNegativeTestJSON-67621407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:16:09Z,user_data=None,user_id='8b524e70f3794e81a2111cd12cab9abc',uuid=ce212884-ddef-4db5-8b22-9f2e1502fadd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d242e0a1-01b7-44b9-8c6a-446c1c6e8876", "address": "fa:16:3e:d0:7e:f8", "network": {"id": "3b2feb84-7495-4ea1-8eb4-6fcb4763a75a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1599091175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0d8924495d400d978d7107a78b3167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd242e0a1-01", "ovs_interfaceid": "d242e0a1-01b7-44b9-8c6a-446c1c6e8876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Converting VIF {"id": "d242e0a1-01b7-44b9-8c6a-446c1c6e8876", "address": "fa:16:3e:d0:7e:f8", "network": {"id": "3b2feb84-7495-4ea1-8eb4-6fcb4763a75a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1599091175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0d8924495d400d978d7107a78b3167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd242e0a1-01", "ovs_interfaceid": "d242e0a1-01b7-44b9-8c6a-446c1c6e8876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:7e:f8,bridge_name='br-int',has_traffic_filtering=True,id=d242e0a1-01b7-44b9-8c6a-446c1c6e8876,network=Network(3b2feb84-7495-4ea1-8eb4-6fcb4763a75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd242e0a1-01') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG nova.objects.instance [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Lazy-loading 'pci_devices' on Instance uuid ce212884-ddef-4db5-8b22-9f2e1502fadd {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:16:10 user nova-compute[75745]:   <uuid>ce212884-ddef-4db5-8b22-9f2e1502fadd</uuid>
Dec 01 17:16:10 user nova-compute[75745]:   <name>instance-0000001b</name>
Dec 01 17:16:10 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:16:10 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:16:10 user nova-compute[75745]:   <metadata>
Dec 01 17:16:10 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:16:10 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:16:10 user nova-compute[75745]:       <nova:name>tempest-ServersNegativeTestJSON-server-466238503</nova:name>
Dec 01 17:16:10 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:16:10</nova:creationTime>
Dec 01 17:16:10 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:16:10 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:16:10 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:16:10 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:16:10 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:16:10 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:16:10 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:16:10 user nova-compute[75745]:       <nova:owner>
Dec 01 17:16:10 user nova-compute[75745]:         <nova:user uuid="8b524e70f3794e81a2111cd12cab9abc">tempest-ServersNegativeTestJSON-67621407-project-member</nova:user>
Dec 01 17:16:10 user nova-compute[75745]:         <nova:project uuid="8d0d8924495d400d978d7107a78b3167">tempest-ServersNegativeTestJSON-67621407</nova:project>
Dec 01 17:16:10 user nova-compute[75745]:       </nova:owner>
Dec 01 17:16:10 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:16:10 user nova-compute[75745]:       <nova:ports>
Dec 01 17:16:10 user nova-compute[75745]:         <nova:port uuid="d242e0a1-01b7-44b9-8c6a-446c1c6e8876">
Dec 01 17:16:10 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 01 17:16:10 user nova-compute[75745]:         </nova:port>
Dec 01 17:16:10 user nova-compute[75745]:       </nova:ports>
Dec 01 17:16:10 user nova-compute[75745]:     </nova:instance>
Dec 01 17:16:10 user nova-compute[75745]:   </metadata>
Dec 01 17:16:10 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:16:10 user nova-compute[75745]:     <system>
Dec 01 17:16:10 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:16:10 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:16:10 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:16:10 user nova-compute[75745]:       <entry name="serial">ce212884-ddef-4db5-8b22-9f2e1502fadd</entry>
Dec 01 17:16:10 user nova-compute[75745]:       <entry name="uuid">ce212884-ddef-4db5-8b22-9f2e1502fadd</entry>
Dec 01 17:16:10 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:16:10 user nova-compute[75745]:     </system>
Dec 01 17:16:10 user nova-compute[75745]:   </sysinfo>
Dec 01 17:16:10 user nova-compute[75745]:   <os>
Dec 01 17:16:10 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:16:10 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:16:10 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:16:10 user nova-compute[75745]:   </os>
Dec 01 17:16:10 user nova-compute[75745]:   <features>
Dec 01 17:16:10 user nova-compute[75745]:     <acpi/>
Dec 01 17:16:10 user nova-compute[75745]:     <apic/>
Dec 01 17:16:10 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:16:10 user nova-compute[75745]:   </features>
Dec 01 17:16:10 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:16:10 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:16:10 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:16:10 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:16:10 user nova-compute[75745]:   </clock>
Dec 01 17:16:10 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:16:10 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:16:10 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:16:10 user nova-compute[75745]:   </cpu>
Dec 01 17:16:10 user nova-compute[75745]:   <devices>
Dec 01 17:16:10 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:16:10 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:16:10 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/ce212884-ddef-4db5-8b22-9f2e1502fadd/disk"/>
Dec 01 17:16:10 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:16:10 user nova-compute[75745]:     </disk>
Dec 01 17:16:10 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:16:10 user nova-compute[75745]:       <mac address="fa:16:3e:d0:7e:f8"/>
Dec 01 17:16:10 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:16:10 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:16:10 user nova-compute[75745]:       <target dev="tapd242e0a1-01"/>
Dec 01 17:16:10 user nova-compute[75745]:     </interface>
Dec 01 17:16:10 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:16:10 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/ce212884-ddef-4db5-8b22-9f2e1502fadd/console.log" append="off"/>
Dec 01 17:16:10 user nova-compute[75745]:     </serial>
Dec 01 17:16:10 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:16:10 user nova-compute[75745]:     <video>
Dec 01 17:16:10 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:16:10 user nova-compute[75745]:     </video>
Dec 01 17:16:10 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:16:10 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:16:10 user nova-compute[75745]:     </rng>
Dec 01 17:16:10 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:16:10 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:16:10 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:16:10 user nova-compute[75745]:     </memballoon>
Dec 01 17:16:10 user nova-compute[75745]:   </devices>
Dec 01 17:16:10 user nova-compute[75745]: </domain>
Dec 01 17:16:10 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-466238503',display_name='tempest-ServersNegativeTestJSON-server-466238503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-466238503',id=27,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d0d8924495d400d978d7107a78b3167',ramdisk_id='',reservation_id='r-u7mqmks8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-67621407',owner_user_name='tempest-ServersNegativeTestJSON-67621407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:16:09Z,user_data=None,user_id='8b524e70f3794e81a2111cd12cab9abc',uuid=ce212884-ddef-4db5-8b22-9f2e1502fadd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d242e0a1-01b7-44b9-8c6a-446c1c6e8876", "address": "fa:16:3e:d0:7e:f8", "network": {"id": "3b2feb84-7495-4ea1-8eb4-6fcb4763a75a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1599091175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0d8924495d400d978d7107a78b3167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd242e0a1-01", "ovs_interfaceid": "d242e0a1-01b7-44b9-8c6a-446c1c6e8876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Converting VIF {"id": "d242e0a1-01b7-44b9-8c6a-446c1c6e8876", "address": "fa:16:3e:d0:7e:f8", "network": {"id": "3b2feb84-7495-4ea1-8eb4-6fcb4763a75a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1599091175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0d8924495d400d978d7107a78b3167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd242e0a1-01", "ovs_interfaceid": "d242e0a1-01b7-44b9-8c6a-446c1c6e8876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:7e:f8,bridge_name='br-int',has_traffic_filtering=True,id=d242e0a1-01b7-44b9-8c6a-446c1c6e8876,network=Network(3b2feb84-7495-4ea1-8eb4-6fcb4763a75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd242e0a1-01') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG os_vif [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:7e:f8,bridge_name='br-int',has_traffic_filtering=True,id=d242e0a1-01b7-44b9-8c6a-446c1c6e8876,network=Network(3b2feb84-7495-4ea1-8eb4-6fcb4763a75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd242e0a1-01') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d5fc9ad-c21d-5284-a1cf-2d074c58f559', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd242e0a1-01, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd242e0a1-01, col_values=(('qos', UUID('0f39bdcb-1a91-4f6d-af8d-ea39908eac0d')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd242e0a1-01, col_values=(('external_ids', {'iface-id': 'd242e0a1-01b7-44b9-8c6a-446c1c6e8876', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:7e:f8', 'vm-uuid': 'ce212884-ddef-4db5-8b22-9f2e1502fadd'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:10 user nova-compute[75745]: INFO os_vif [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:7e:f8,bridge_name='br-int',has_traffic_filtering=True,id=d242e0a1-01b7-44b9-8c6a-446c1c6e8876,network=Network(3b2feb84-7495-4ea1-8eb4-6fcb4763a75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd242e0a1-01')
Dec 01 17:16:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:16:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] No VIF found with MAC fa:16:3e:d0:7e:f8, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:16:11 user nova-compute[75745]: DEBUG nova.network.neutron [req-de3de5b6-6274-4193-b089-051cbdd7c80c req-75ce0d28-c4d5-4271-a4a3-5473c8393f21 service nova] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Updated VIF entry in instance network info cache for port d242e0a1-01b7-44b9-8c6a-446c1c6e8876. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:16:11 user nova-compute[75745]: DEBUG nova.network.neutron [req-de3de5b6-6274-4193-b089-051cbdd7c80c req-75ce0d28-c4d5-4271-a4a3-5473c8393f21 service nova] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Updating instance_info_cache with network_info: [{"id": "d242e0a1-01b7-44b9-8c6a-446c1c6e8876", "address": "fa:16:3e:d0:7e:f8", "network": {"id": "3b2feb84-7495-4ea1-8eb4-6fcb4763a75a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1599091175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0d8924495d400d978d7107a78b3167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd242e0a1-01", "ovs_interfaceid": "d242e0a1-01b7-44b9-8c6a-446c1c6e8876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:16:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-de3de5b6-6274-4193-b089-051cbdd7c80c req-75ce0d28-c4d5-4271-a4a3-5473c8393f21 service nova] Releasing lock "refresh_cache-ce212884-ddef-4db5-8b22-9f2e1502fadd" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:16:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:12 user nova-compute[75745]: DEBUG nova.compute.manager [req-ca2b8f81-757f-4865-a6c8-a70066f1ed44 req-65821135-ed66-41c2-9ae9-6ff8106bbe0a service nova] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Received event network-vif-plugged-d242e0a1-01b7-44b9-8c6a-446c1c6e8876 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:16:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ca2b8f81-757f-4865-a6c8-a70066f1ed44 req-65821135-ed66-41c2-9ae9-6ff8106bbe0a service nova] Acquiring lock "ce212884-ddef-4db5-8b22-9f2e1502fadd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:16:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ca2b8f81-757f-4865-a6c8-a70066f1ed44 req-65821135-ed66-41c2-9ae9-6ff8106bbe0a service nova] Lock "ce212884-ddef-4db5-8b22-9f2e1502fadd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:16:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ca2b8f81-757f-4865-a6c8-a70066f1ed44 req-65821135-ed66-41c2-9ae9-6ff8106bbe0a service nova] Lock "ce212884-ddef-4db5-8b22-9f2e1502fadd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:16:12 user nova-compute[75745]: DEBUG nova.compute.manager [req-ca2b8f81-757f-4865-a6c8-a70066f1ed44 req-65821135-ed66-41c2-9ae9-6ff8106bbe0a service nova] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] No waiting events found dispatching network-vif-plugged-d242e0a1-01b7-44b9-8c6a-446c1c6e8876 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:16:12 user nova-compute[75745]: WARNING nova.compute.manager [req-ca2b8f81-757f-4865-a6c8-a70066f1ed44 req-65821135-ed66-41c2-9ae9-6ff8106bbe0a service nova] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Received unexpected event network-vif-plugged-d242e0a1-01b7-44b9-8c6a-446c1c6e8876 for instance with vm_state building and task_state spawning.
Dec 01 17:16:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:14 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:16:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:16:14 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Instance spawned successfully.
Dec 01 17:16:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:16:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:16:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:16:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:16:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:16:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:16:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:16:14 user nova-compute[75745]: INFO nova.compute.manager [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Took 5.33 seconds to spawn the instance on the hypervisor.
Dec 01 17:16:14 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:16:14 user nova-compute[75745]: DEBUG nova.compute.manager [req-22d63e1e-acf2-46b3-8e4b-c4ba7635729c req-83c6fbe8-8b60-4477-ba86-efa7aec52e42 service nova] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Received event network-vif-plugged-d242e0a1-01b7-44b9-8c6a-446c1c6e8876 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:16:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-22d63e1e-acf2-46b3-8e4b-c4ba7635729c req-83c6fbe8-8b60-4477-ba86-efa7aec52e42 service nova] Acquiring lock "ce212884-ddef-4db5-8b22-9f2e1502fadd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:16:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-22d63e1e-acf2-46b3-8e4b-c4ba7635729c req-83c6fbe8-8b60-4477-ba86-efa7aec52e42 service nova] Lock "ce212884-ddef-4db5-8b22-9f2e1502fadd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:16:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-22d63e1e-acf2-46b3-8e4b-c4ba7635729c req-83c6fbe8-8b60-4477-ba86-efa7aec52e42 service nova] Lock "ce212884-ddef-4db5-8b22-9f2e1502fadd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:16:14 user nova-compute[75745]: DEBUG nova.compute.manager [req-22d63e1e-acf2-46b3-8e4b-c4ba7635729c req-83c6fbe8-8b60-4477-ba86-efa7aec52e42 service nova] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] No waiting events found dispatching network-vif-plugged-d242e0a1-01b7-44b9-8c6a-446c1c6e8876 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:16:14 user nova-compute[75745]: WARNING nova.compute.manager [req-22d63e1e-acf2-46b3-8e4b-c4ba7635729c req-83c6fbe8-8b60-4477-ba86-efa7aec52e42 service nova] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Received unexpected event network-vif-plugged-d242e0a1-01b7-44b9-8c6a-446c1c6e8876 for instance with vm_state building and task_state spawning.
Dec 01 17:16:14 user nova-compute[75745]: INFO nova.compute.manager [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Took 6.01 seconds to build instance.
Dec 01 17:16:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d267bcc5-0cd4-4dda-a2e0-04c8d04ebf5d tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Lock "ce212884-ddef-4db5-8b22-9f2e1502fadd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.103s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:16:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-94d10511-ea2d-49d4-9513-a59c0f907487 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Acquiring lock "308f5fad-3a32-4104-b9ec-c51ed08f2a3c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:16:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-94d10511-ea2d-49d4-9513-a59c0f907487 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "308f5fad-3a32-4104-b9ec-c51ed08f2a3c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:16:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-94d10511-ea2d-49d4-9513-a59c0f907487 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Acquiring lock "308f5fad-3a32-4104-b9ec-c51ed08f2a3c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:16:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-94d10511-ea2d-49d4-9513-a59c0f907487 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "308f5fad-3a32-4104-b9ec-c51ed08f2a3c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:16:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-94d10511-ea2d-49d4-9513-a59c0f907487 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "308f5fad-3a32-4104-b9ec-c51ed08f2a3c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:16:16 user nova-compute[75745]: INFO nova.compute.manager [None req-94d10511-ea2d-49d4-9513-a59c0f907487 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Terminating instance
Dec 01 17:16:16 user nova-compute[75745]: DEBUG nova.compute.manager [None req-94d10511-ea2d-49d4-9513-a59c0f907487 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:16:17 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:17 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:17 user nova-compute[75745]: DEBUG nova.compute.manager [req-9d8dd6e6-5d6a-41fe-ac2f-27e582b0b886 req-a964e54b-d03d-4109-8ab1-e31d144d82cb service nova] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Received event network-vif-unplugged-2e05fcb5-20a6-4606-8b27-a1592a9ea51c {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:16:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-9d8dd6e6-5d6a-41fe-ac2f-27e582b0b886 req-a964e54b-d03d-4109-8ab1-e31d144d82cb service nova] Acquiring lock "308f5fad-3a32-4104-b9ec-c51ed08f2a3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:16:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-9d8dd6e6-5d6a-41fe-ac2f-27e582b0b886 req-a964e54b-d03d-4109-8ab1-e31d144d82cb service nova] Lock "308f5fad-3a32-4104-b9ec-c51ed08f2a3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:16:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-9d8dd6e6-5d6a-41fe-ac2f-27e582b0b886 req-a964e54b-d03d-4109-8ab1-e31d144d82cb service nova] Lock "308f5fad-3a32-4104-b9ec-c51ed08f2a3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:16:17 user nova-compute[75745]: DEBUG nova.compute.manager [req-9d8dd6e6-5d6a-41fe-ac2f-27e582b0b886 req-a964e54b-d03d-4109-8ab1-e31d144d82cb service nova] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] No waiting events found dispatching network-vif-unplugged-2e05fcb5-20a6-4606-8b27-a1592a9ea51c {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:16:17 user nova-compute[75745]: DEBUG nova.compute.manager [req-9d8dd6e6-5d6a-41fe-ac2f-27e582b0b886 req-a964e54b-d03d-4109-8ab1-e31d144d82cb service nova] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Received event network-vif-unplugged-2e05fcb5-20a6-4606-8b27-a1592a9ea51c for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:16:17 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:17 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:17 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Instance destroyed successfully.
Dec 01 17:16:17 user nova-compute[75745]: DEBUG nova.objects.instance [None req-94d10511-ea2d-49d4-9513-a59c0f907487 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lazy-loading 'resources' on Instance uuid 308f5fad-3a32-4104-b9ec-c51ed08f2a3c {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:16:17 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-94d10511-ea2d-49d4-9513-a59c0f907487 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:14:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1857569411',display_name='tempest-VolumesAdminNegativeTest-server-1857569411',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1857569411',id=25,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:14:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0919015c0904a8481a5297b6aa9af40',ramdisk_id='',reservation_id='r-91o1j5n2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-483419746',owner_user_name='tempest-VolumesAdminNegativeTest-483419746-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:14:27Z,user_data=None,user_id='c4522c1762bd4fea8ee7190642b63e06',uuid=308f5fad-3a32-4104-b9ec-c51ed08f2a3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e05fcb5-20a6-4606-8b27-a1592a9ea51c", "address": "fa:16:3e:7c:6d:45", "network": {"id": "b40e2616-f366-491f-a652-c99fc1c6b989", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-538343107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0919015c0904a8481a5297b6aa9af40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e05fcb5-20", "ovs_interfaceid": "2e05fcb5-20a6-4606-8b27-a1592a9ea51c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:16:17 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-94d10511-ea2d-49d4-9513-a59c0f907487 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Converting VIF {"id": "2e05fcb5-20a6-4606-8b27-a1592a9ea51c", "address": "fa:16:3e:7c:6d:45", "network": {"id": "b40e2616-f366-491f-a652-c99fc1c6b989", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-538343107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0919015c0904a8481a5297b6aa9af40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e05fcb5-20", "ovs_interfaceid": "2e05fcb5-20a6-4606-8b27-a1592a9ea51c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:16:17 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-94d10511-ea2d-49d4-9513-a59c0f907487 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:6d:45,bridge_name='br-int',has_traffic_filtering=True,id=2e05fcb5-20a6-4606-8b27-a1592a9ea51c,network=Network(b40e2616-f366-491f-a652-c99fc1c6b989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e05fcb5-20') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:16:17 user nova-compute[75745]: DEBUG os_vif [None req-94d10511-ea2d-49d4-9513-a59c0f907487 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:6d:45,bridge_name='br-int',has_traffic_filtering=True,id=2e05fcb5-20a6-4606-8b27-a1592a9ea51c,network=Network(b40e2616-f366-491f-a652-c99fc1c6b989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e05fcb5-20') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:16:17 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:17 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e05fcb5-20, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:16:17 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:17 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:16:17 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:17 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=154d4a57-b851-4fba-9523-14c8abc9f87d) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:16:17 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:17 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:16:17 user nova-compute[75745]: INFO os_vif [None req-94d10511-ea2d-49d4-9513-a59c0f907487 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:6d:45,bridge_name='br-int',has_traffic_filtering=True,id=2e05fcb5-20a6-4606-8b27-a1592a9ea51c,network=Network(b40e2616-f366-491f-a652-c99fc1c6b989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e05fcb5-20')
Dec 01 17:16:17 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-94d10511-ea2d-49d4-9513-a59c0f907487 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Deleting instance files /opt/stack/data/nova/instances/308f5fad-3a32-4104-b9ec-c51ed08f2a3c_del
Dec 01 17:16:17 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-94d10511-ea2d-49d4-9513-a59c0f907487 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Deletion of /opt/stack/data/nova/instances/308f5fad-3a32-4104-b9ec-c51ed08f2a3c_del complete
Dec 01 17:16:17 user nova-compute[75745]: INFO nova.compute.manager [None req-94d10511-ea2d-49d4-9513-a59c0f907487 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Took 0.91 seconds to destroy the instance on the hypervisor.
Dec 01 17:16:17 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-94d10511-ea2d-49d4-9513-a59c0f907487 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:16:17 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:16:17 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:16:18 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:16:18 user nova-compute[75745]: DEBUG nova.compute.manager [req-be38c791-326b-44f8-b236-d8cb80116a97 req-2d394910-61bf-415b-8dad-25d4711b7c1f service nova] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Received event network-vif-deleted-2e05fcb5-20a6-4606-8b27-a1592a9ea51c {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:16:18 user nova-compute[75745]: INFO nova.compute.manager [req-be38c791-326b-44f8-b236-d8cb80116a97 req-2d394910-61bf-415b-8dad-25d4711b7c1f service nova] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Neutron deleted interface 2e05fcb5-20a6-4606-8b27-a1592a9ea51c; detaching it from the instance and deleting it from the info cache
Dec 01 17:16:18 user nova-compute[75745]: DEBUG nova.network.neutron [req-be38c791-326b-44f8-b236-d8cb80116a97 req-2d394910-61bf-415b-8dad-25d4711b7c1f service nova] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:16:18 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Took 0.80 seconds to deallocate network for instance.
Dec 01 17:16:18 user nova-compute[75745]: DEBUG nova.compute.manager [req-be38c791-326b-44f8-b236-d8cb80116a97 req-2d394910-61bf-415b-8dad-25d4711b7c1f service nova] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Detach interface failed, port_id=2e05fcb5-20a6-4606-8b27-a1592a9ea51c, reason: Instance 308f5fad-3a32-4104-b9ec-c51ed08f2a3c could not be found. {{(pid=75745) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 17:16:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-94d10511-ea2d-49d4-9513-a59c0f907487 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:16:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-94d10511-ea2d-49d4-9513-a59c0f907487 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:16:19 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-94d10511-ea2d-49d4-9513-a59c0f907487 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:16:19 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-94d10511-ea2d-49d4-9513-a59c0f907487 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:16:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-94d10511-ea2d-49d4-9513-a59c0f907487 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:16:19 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-94d10511-ea2d-49d4-9513-a59c0f907487 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Deleted allocations for instance 308f5fad-3a32-4104-b9ec-c51ed08f2a3c
Dec 01 17:16:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-94d10511-ea2d-49d4-9513-a59c0f907487 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "308f5fad-3a32-4104-b9ec-c51ed08f2a3c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.288s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:16:19 user nova-compute[75745]: DEBUG nova.compute.manager [req-3fd8a9bb-484d-4605-be58-5263fe8e5ede req-60101b76-3bb4-411b-8887-2567fd32e281 service nova] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Received event network-vif-plugged-2e05fcb5-20a6-4606-8b27-a1592a9ea51c {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:16:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3fd8a9bb-484d-4605-be58-5263fe8e5ede req-60101b76-3bb4-411b-8887-2567fd32e281 service nova] Acquiring lock "308f5fad-3a32-4104-b9ec-c51ed08f2a3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:16:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3fd8a9bb-484d-4605-be58-5263fe8e5ede req-60101b76-3bb4-411b-8887-2567fd32e281 service nova] Lock "308f5fad-3a32-4104-b9ec-c51ed08f2a3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:16:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3fd8a9bb-484d-4605-be58-5263fe8e5ede req-60101b76-3bb4-411b-8887-2567fd32e281 service nova] Lock "308f5fad-3a32-4104-b9ec-c51ed08f2a3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:16:19 user nova-compute[75745]: DEBUG nova.compute.manager [req-3fd8a9bb-484d-4605-be58-5263fe8e5ede req-60101b76-3bb4-411b-8887-2567fd32e281 service nova] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] No waiting events found dispatching network-vif-plugged-2e05fcb5-20a6-4606-8b27-a1592a9ea51c {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:16:19 user nova-compute[75745]: WARNING nova.compute.manager [req-3fd8a9bb-484d-4605-be58-5263fe8e5ede req-60101b76-3bb4-411b-8887-2567fd32e281 service nova] [instance: 308f5fad-3a32-4104-b9ec-c51ed08f2a3c] Received unexpected event network-vif-plugged-2e05fcb5-20a6-4606-8b27-a1592a9ea51c for instance with vm_state deleted and task_state None.
Dec 01 17:16:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "e0959ad6-3d88-47d7-bf74-58fcb727fb3e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:16:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "e0959ad6-3d88-47d7-bf74-58fcb727fb3e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:16:19 user nova-compute[75745]: DEBUG nova.compute.manager [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:16:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:16:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:16:19 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:16:19 user nova-compute[75745]: INFO nova.compute.claims [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Claim successful on node user
Dec 01 17:16:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:19 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:16:20 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:16:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:16:20 user nova-compute[75745]: DEBUG nova.compute.manager [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:16:20 user nova-compute[75745]: DEBUG nova.compute.manager [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:16:20 user nova-compute[75745]: DEBUG nova.network.neutron [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:16:20 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:16:20 user nova-compute[75745]: DEBUG nova.compute.manager [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:16:20 user nova-compute[75745]: DEBUG nova.policy [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76845c98f91449df9196e19187b1b786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1730419061445f98680b8c81753a4f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:16:20 user nova-compute[75745]: DEBUG nova.compute.manager [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:16:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:16:20 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Creating image(s)
Dec 01 17:16:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "/opt/stack/data/nova/instances/e0959ad6-3d88-47d7-bf74-58fcb727fb3e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:16:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "/opt/stack/data/nova/instances/e0959ad6-3d88-47d7-bf74-58fcb727fb3e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:16:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "/opt/stack/data/nova/instances/e0959ad6-3d88-47d7-bf74-58fcb727fb3e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:16:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.178s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:16:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:16:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.188s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/e0959ad6-3d88-47d7-bf74-58fcb727fb3e/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/e0959ad6-3d88-47d7-bf74-58fcb727fb3e/disk 1073741824" returned: 0 in 0.048s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:16:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:20 user nova-compute[75745]: DEBUG nova.network.neutron [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Successfully created port: 1af2d3d8-d2bb-4203-a6e2-f179af1228be {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:16:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.184s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:20 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e0959ad6-3d88-47d7-bf74-58fcb727fb3e/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:16:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0959ad6-3d88-47d7-bf74-58fcb727fb3e/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0959ad6-3d88-47d7-bf74-58fcb727fb3e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Cannot resize image /opt/stack/data/nova/instances/e0959ad6-3d88-47d7-bf74-58fcb727fb3e/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Ensure instance console log exists: /opt/stack/data/nova/instances/e0959ad6-3d88-47d7-bf74-58fcb727fb3e/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.network.neutron [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Successfully updated port: 1af2d3d8-d2bb-4203-a6e2-f179af1228be {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "refresh_cache-e0959ad6-3d88-47d7-bf74-58fcb727fb3e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquired lock "refresh_cache-e0959ad6-3d88-47d7-bf74-58fcb727fb3e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.network.neutron [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.compute.manager [req-f7c03bd7-ac7c-44c0-8e0d-801f42fa11f5 req-7418dcb2-59d3-4028-b905-f380577b4509 service nova] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Received event network-changed-1af2d3d8-d2bb-4203-a6e2-f179af1228be {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.compute.manager [req-f7c03bd7-ac7c-44c0-8e0d-801f42fa11f5 req-7418dcb2-59d3-4028-b905-f380577b4509 service nova] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Refreshing instance network info cache due to event network-changed-1af2d3d8-d2bb-4203-a6e2-f179af1228be. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-f7c03bd7-ac7c-44c0-8e0d-801f42fa11f5 req-7418dcb2-59d3-4028-b905-f380577b4509 service nova] Acquiring lock "refresh_cache-e0959ad6-3d88-47d7-bf74-58fcb727fb3e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.network.neutron [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.network.neutron [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Updating instance_info_cache with network_info: [{"id": "1af2d3d8-d2bb-4203-a6e2-f179af1228be", "address": "fa:16:3e:26:bd:7c", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1af2d3d8-d2", "ovs_interfaceid": "1af2d3d8-d2bb-4203-a6e2-f179af1228be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Releasing lock "refresh_cache-e0959ad6-3d88-47d7-bf74-58fcb727fb3e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.compute.manager [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Instance network_info: |[{"id": "1af2d3d8-d2bb-4203-a6e2-f179af1228be", "address": "fa:16:3e:26:bd:7c", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1af2d3d8-d2", "ovs_interfaceid": "1af2d3d8-d2bb-4203-a6e2-f179af1228be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-f7c03bd7-ac7c-44c0-8e0d-801f42fa11f5 req-7418dcb2-59d3-4028-b905-f380577b4509 service nova] Acquired lock "refresh_cache-e0959ad6-3d88-47d7-bf74-58fcb727fb3e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.network.neutron [req-f7c03bd7-ac7c-44c0-8e0d-801f42fa11f5 req-7418dcb2-59d3-4028-b905-f380577b4509 service nova] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Refreshing network info cache for port 1af2d3d8-d2bb-4203-a6e2-f179af1228be {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Start _get_guest_xml network_info=[{"id": "1af2d3d8-d2bb-4203-a6e2-f179af1228be", "address": "fa:16:3e:26:bd:7c", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1af2d3d8-d2", "ovs_interfaceid": "1af2d3d8-d2bb-4203-a6e2-f179af1228be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:16:21 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:16:21 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:16:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-687059891',display_name='tempest-AttachVolumeNegativeTest-server-687059891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-687059891',id=28,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDoR9Tf7o8dlfSMjbqP7HcirYiwZT/0IQXHhK1XGkYS+ckNMaT2cVkzTsledS5Pqf9BaLyecjIQMcK58DbD/lGi/UDivWFksvgQMLiSpUtR3oIFLFJeQ5QgYkcxdW2ntA==',key_name='tempest-keypair-1533402473',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1730419061445f98680b8c81753a4f3',ramdisk_id='',reservation_id='r-lpj9kjei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1227943771',owner_user_name='tempest-AttachVolumeNegativeTest-1227943771-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:16:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76845c98f91449df9196e19187b1b786',uuid=e0959ad6-3d88-47d7-bf74-58fcb727fb3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1af2d3d8-d2bb-4203-a6e2-f179af1228be", "address": "fa:16:3e:26:bd:7c", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1af2d3d8-d2", "ovs_interfaceid": "1af2d3d8-d2bb-4203-a6e2-f179af1228be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Converting VIF {"id": "1af2d3d8-d2bb-4203-a6e2-f179af1228be", "address": "fa:16:3e:26:bd:7c", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1af2d3d8-d2", "ovs_interfaceid": "1af2d3d8-d2bb-4203-a6e2-f179af1228be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:bd:7c,bridge_name='br-int',has_traffic_filtering=True,id=1af2d3d8-d2bb-4203-a6e2-f179af1228be,network=Network(8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1af2d3d8-d2') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.objects.instance [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lazy-loading 'pci_devices' on Instance uuid e0959ad6-3d88-47d7-bf74-58fcb727fb3e {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:16:21 user nova-compute[75745]:   <uuid>e0959ad6-3d88-47d7-bf74-58fcb727fb3e</uuid>
Dec 01 17:16:21 user nova-compute[75745]:   <name>instance-0000001c</name>
Dec 01 17:16:21 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:16:21 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:16:21 user nova-compute[75745]:   <metadata>
Dec 01 17:16:21 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:16:21 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:16:21 user nova-compute[75745]:       <nova:name>tempest-AttachVolumeNegativeTest-server-687059891</nova:name>
Dec 01 17:16:21 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:16:21</nova:creationTime>
Dec 01 17:16:21 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:16:21 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:16:21 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:16:21 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:16:21 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:16:21 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:16:21 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:16:21 user nova-compute[75745]:       <nova:owner>
Dec 01 17:16:21 user nova-compute[75745]:         <nova:user uuid="76845c98f91449df9196e19187b1b786">tempest-AttachVolumeNegativeTest-1227943771-project-member</nova:user>
Dec 01 17:16:21 user nova-compute[75745]:         <nova:project uuid="c1730419061445f98680b8c81753a4f3">tempest-AttachVolumeNegativeTest-1227943771</nova:project>
Dec 01 17:16:21 user nova-compute[75745]:       </nova:owner>
Dec 01 17:16:21 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:16:21 user nova-compute[75745]:       <nova:ports>
Dec 01 17:16:21 user nova-compute[75745]:         <nova:port uuid="1af2d3d8-d2bb-4203-a6e2-f179af1228be">
Dec 01 17:16:21 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 01 17:16:21 user nova-compute[75745]:         </nova:port>
Dec 01 17:16:21 user nova-compute[75745]:       </nova:ports>
Dec 01 17:16:21 user nova-compute[75745]:     </nova:instance>
Dec 01 17:16:21 user nova-compute[75745]:   </metadata>
Dec 01 17:16:21 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:16:21 user nova-compute[75745]:     <system>
Dec 01 17:16:21 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:16:21 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:16:21 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:16:21 user nova-compute[75745]:       <entry name="serial">e0959ad6-3d88-47d7-bf74-58fcb727fb3e</entry>
Dec 01 17:16:21 user nova-compute[75745]:       <entry name="uuid">e0959ad6-3d88-47d7-bf74-58fcb727fb3e</entry>
Dec 01 17:16:21 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:16:21 user nova-compute[75745]:     </system>
Dec 01 17:16:21 user nova-compute[75745]:   </sysinfo>
Dec 01 17:16:21 user nova-compute[75745]:   <os>
Dec 01 17:16:21 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:16:21 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:16:21 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:16:21 user nova-compute[75745]:   </os>
Dec 01 17:16:21 user nova-compute[75745]:   <features>
Dec 01 17:16:21 user nova-compute[75745]:     <acpi/>
Dec 01 17:16:21 user nova-compute[75745]:     <apic/>
Dec 01 17:16:21 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:16:21 user nova-compute[75745]:   </features>
Dec 01 17:16:21 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:16:21 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:16:21 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:16:21 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:16:21 user nova-compute[75745]:   </clock>
Dec 01 17:16:21 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:16:21 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:16:21 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:16:21 user nova-compute[75745]:   </cpu>
Dec 01 17:16:21 user nova-compute[75745]:   <devices>
Dec 01 17:16:21 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:16:21 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:16:21 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/e0959ad6-3d88-47d7-bf74-58fcb727fb3e/disk"/>
Dec 01 17:16:21 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:16:21 user nova-compute[75745]:     </disk>
Dec 01 17:16:21 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:16:21 user nova-compute[75745]:       <mac address="fa:16:3e:26:bd:7c"/>
Dec 01 17:16:21 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:16:21 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:16:21 user nova-compute[75745]:       <target dev="tap1af2d3d8-d2"/>
Dec 01 17:16:21 user nova-compute[75745]:     </interface>
Dec 01 17:16:21 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:16:21 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/e0959ad6-3d88-47d7-bf74-58fcb727fb3e/console.log" append="off"/>
Dec 01 17:16:21 user nova-compute[75745]:     </serial>
Dec 01 17:16:21 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:16:21 user nova-compute[75745]:     <video>
Dec 01 17:16:21 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:16:21 user nova-compute[75745]:     </video>
Dec 01 17:16:21 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:16:21 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:16:21 user nova-compute[75745]:     </rng>
Dec 01 17:16:21 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:16:21 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:16:21 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:16:21 user nova-compute[75745]:     </memballoon>
Dec 01 17:16:21 user nova-compute[75745]:   </devices>
Dec 01 17:16:21 user nova-compute[75745]: </domain>
Dec 01 17:16:21 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:16:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-687059891',display_name='tempest-AttachVolumeNegativeTest-server-687059891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-687059891',id=28,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDoR9Tf7o8dlfSMjbqP7HcirYiwZT/0IQXHhK1XGkYS+ckNMaT2cVkzTsledS5Pqf9BaLyecjIQMcK58DbD/lGi/UDivWFksvgQMLiSpUtR3oIFLFJeQ5QgYkcxdW2ntA==',key_name='tempest-keypair-1533402473',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1730419061445f98680b8c81753a4f3',ramdisk_id='',reservation_id='r-lpj9kjei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1227943771',owner_user_name='tempest-AttachVolumeNegativeTest-1227943771-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:16:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76845c98f91449df9196e19187b1b786',uuid=e0959ad6-3d88-47d7-bf74-58fcb727fb3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1af2d3d8-d2bb-4203-a6e2-f179af1228be", "address": "fa:16:3e:26:bd:7c", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1af2d3d8-d2", "ovs_interfaceid": "1af2d3d8-d2bb-4203-a6e2-f179af1228be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Converting VIF {"id": "1af2d3d8-d2bb-4203-a6e2-f179af1228be", "address": "fa:16:3e:26:bd:7c", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1af2d3d8-d2", "ovs_interfaceid": "1af2d3d8-d2bb-4203-a6e2-f179af1228be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:bd:7c,bridge_name='br-int',has_traffic_filtering=True,id=1af2d3d8-d2bb-4203-a6e2-f179af1228be,network=Network(8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1af2d3d8-d2') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG os_vif [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:bd:7c,bridge_name='br-int',has_traffic_filtering=True,id=1af2d3d8-d2bb-4203-a6e2-f179af1228be,network=Network(8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1af2d3d8-d2') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '957407f6-8683-5a69-9314-ff03584ddbe4', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1af2d3d8-d2, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1af2d3d8-d2, col_values=(('qos', UUID('8f72f7c0-c510-4bbc-8156-acb9b68ce523')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1af2d3d8-d2, col_values=(('external_ids', {'iface-id': '1af2d3d8-d2bb-4203-a6e2-f179af1228be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:bd:7c', 'vm-uuid': 'e0959ad6-3d88-47d7-bf74-58fcb727fb3e'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:21 user nova-compute[75745]: INFO os_vif [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:bd:7c,bridge_name='br-int',has_traffic_filtering=True,id=1af2d3d8-d2bb-4203-a6e2-f179af1228be,network=Network(8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1af2d3d8-d2')
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:16:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] No VIF found with MAC fa:16:3e:26:bd:7c, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:16:22 user nova-compute[75745]: DEBUG nova.network.neutron [req-f7c03bd7-ac7c-44c0-8e0d-801f42fa11f5 req-7418dcb2-59d3-4028-b905-f380577b4509 service nova] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Updated VIF entry in instance network info cache for port 1af2d3d8-d2bb-4203-a6e2-f179af1228be. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:16:22 user nova-compute[75745]: DEBUG nova.network.neutron [req-f7c03bd7-ac7c-44c0-8e0d-801f42fa11f5 req-7418dcb2-59d3-4028-b905-f380577b4509 service nova] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Updating instance_info_cache with network_info: [{"id": "1af2d3d8-d2bb-4203-a6e2-f179af1228be", "address": "fa:16:3e:26:bd:7c", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1af2d3d8-d2", "ovs_interfaceid": "1af2d3d8-d2bb-4203-a6e2-f179af1228be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:16:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-f7c03bd7-ac7c-44c0-8e0d-801f42fa11f5 req-7418dcb2-59d3-4028-b905-f380577b4509 service nova] Releasing lock "refresh_cache-e0959ad6-3d88-47d7-bf74-58fcb727fb3e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:16:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:23 user nova-compute[75745]: DEBUG nova.compute.manager [req-80df845e-cf7b-4ccf-be36-dbb10953add9 req-7ec71d97-bd4f-47fb-9de7-f696c1ea6610 service nova] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Received event network-vif-plugged-1af2d3d8-d2bb-4203-a6e2-f179af1228be {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:16:23 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-80df845e-cf7b-4ccf-be36-dbb10953add9 req-7ec71d97-bd4f-47fb-9de7-f696c1ea6610 service nova] Acquiring lock "e0959ad6-3d88-47d7-bf74-58fcb727fb3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:16:23 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-80df845e-cf7b-4ccf-be36-dbb10953add9 req-7ec71d97-bd4f-47fb-9de7-f696c1ea6610 service nova] Lock "e0959ad6-3d88-47d7-bf74-58fcb727fb3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:16:23 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-80df845e-cf7b-4ccf-be36-dbb10953add9 req-7ec71d97-bd4f-47fb-9de7-f696c1ea6610 service nova] Lock "e0959ad6-3d88-47d7-bf74-58fcb727fb3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:16:23 user nova-compute[75745]: DEBUG nova.compute.manager [req-80df845e-cf7b-4ccf-be36-dbb10953add9 req-7ec71d97-bd4f-47fb-9de7-f696c1ea6610 service nova] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] No waiting events found dispatching network-vif-plugged-1af2d3d8-d2bb-4203-a6e2-f179af1228be {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:16:23 user nova-compute[75745]: WARNING nova.compute.manager [req-80df845e-cf7b-4ccf-be36-dbb10953add9 req-7ec71d97-bd4f-47fb-9de7-f696c1ea6610 service nova] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Received unexpected event network-vif-plugged-1af2d3d8-d2bb-4203-a6e2-f179af1228be for instance with vm_state building and task_state spawning.
Dec 01 17:16:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:24 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0ab0c115-74aa-4e55-92a3-6fa91ba753e3 is timed out.
Dec 01 17:16:24 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Successfully detached device vdb from instance 0ab0c115-74aa-4e55-92a3-6fa91ba753e3 from the live domain config.
Dec 01 17:16:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:16:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PuqZaIch', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:16:24 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:16:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:16:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:16:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:24 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c53d14e-69ca-4d24-8dc4-af2a0d983e85]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:16:24 user nova-compute[75745]: No targets found.
Dec 01 17:16:24 user nova-compute[75745]: iSNS:
Dec 01 17:16:24 user nova-compute[75745]: No targets found.
Dec 01 17:16:24 user nova-compute[75745]: STATIC:
Dec 01 17:16:24 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127
Dec 01 17:16:24 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:16:24 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:16:24 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0
Dec 01 17:16:24 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:16:24 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:16:24 user nova-compute[75745]: FIRMWARE:
Dec 01 17:16:24 user nova-compute[75745]: No targets found.
Dec 01 17:16:24 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:16:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:16:24 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:16:24 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:16:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:16:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:24 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5a5df2-e79f-43c8-bca6-7cedd80d78d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:24 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77f5fa5-72c2-4251-b05f-3fbcb5749b18]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:16:24 user nova-compute[75745]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127 (non-flash)
Dec 01 17:16:24 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:16:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:16:24 user nova-compute[75745]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127 (non-flash)
Dec 01 17:16:24 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:16:24 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f249868e950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127'): ({'sdc'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:16:24 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Removing single pathed devices sdc {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:16:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:24 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[71037154-c0f9-4111-b3f4-a6bb4dfd6f70]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:24 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[494ea33d-2458-4385-bdff-fbbf0b4f8975]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Flushing IO for device /dev/sdc {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8ef492-df14-41e6-ab9b-b07aaeb1cf71]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc839863-d327-403a-b617-1f9063629c45]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] SCSI volumes sdc have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77e8f24-7789-431f-ad96-5b43a63490cc]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127 -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ef1c87-8a23-4ee0-b5fd-15474552e407]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127, portal: 172.16.0.220,3260]
Dec 01 17:16:25 user nova-compute[75745]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127, portal: 172.16.0.220,3260] successful.
Dec 01 17:16:25 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1946fef7-8668-4826-b747-aee6dfef5127 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[791293f8-0ce4-45fa-811f-2cb2734aa2e4]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] <== disconnect_volume: return (285ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG nova.compute.manager [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:16:25 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Instance spawned successfully.
Dec 01 17:16:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:16:25 user nova-compute[75745]: INFO nova.compute.manager [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Took 5.06 seconds to spawn the instance on the hypervisor.
Dec 01 17:16:25 user nova-compute[75745]: DEBUG nova.compute.manager [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:16:25 user nova-compute[75745]: INFO nova.compute.manager [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Took 5.87 seconds to build instance.
Dec 01 17:16:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9a6c0b22-2470-47ef-8732-276d9f83ffda tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "e0959ad6-3d88-47d7-bf74-58fcb727fb3e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.966s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG nova.compute.manager [req-3b4dcb7c-53b0-40c6-bbcc-3ca45d307bfc req-f23ab663-7a48-4558-b036-a7545d7ce1f9 service nova] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Received event network-vif-plugged-1af2d3d8-d2bb-4203-a6e2-f179af1228be {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3b4dcb7c-53b0-40c6-bbcc-3ca45d307bfc req-f23ab663-7a48-4558-b036-a7545d7ce1f9 service nova] Acquiring lock "e0959ad6-3d88-47d7-bf74-58fcb727fb3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3b4dcb7c-53b0-40c6-bbcc-3ca45d307bfc req-f23ab663-7a48-4558-b036-a7545d7ce1f9 service nova] Lock "e0959ad6-3d88-47d7-bf74-58fcb727fb3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3b4dcb7c-53b0-40c6-bbcc-3ca45d307bfc req-f23ab663-7a48-4558-b036-a7545d7ce1f9 service nova] Lock "e0959ad6-3d88-47d7-bf74-58fcb727fb3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:16:25 user nova-compute[75745]: DEBUG nova.compute.manager [req-3b4dcb7c-53b0-40c6-bbcc-3ca45d307bfc req-f23ab663-7a48-4558-b036-a7545d7ce1f9 service nova] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] No waiting events found dispatching network-vif-plugged-1af2d3d8-d2bb-4203-a6e2-f179af1228be {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:16:25 user nova-compute[75745]: WARNING nova.compute.manager [req-3b4dcb7c-53b0-40c6-bbcc-3ca45d307bfc req-f23ab663-7a48-4558-b036-a7545d7ce1f9 service nova] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Received unexpected event network-vif-plugged-1af2d3d8-d2bb-4203-a6e2-f179af1228be for instance with vm_state active and task_state None.
Dec 01 17:16:26 user nova-compute[75745]: DEBUG nova.objects.instance [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lazy-loading 'flavor' on Instance uuid 0ab0c115-74aa-4e55-92a3-6fa91ba753e3 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:16:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-69a5e070-3145-4a9c-b85a-116462c84687 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.725s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:16:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:36 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:16:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "63cffe58-0056-4b06-86d9-bee746c2f832" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:16:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "63cffe58-0056-4b06-86d9-bee746c2f832" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:16:38 user nova-compute[75745]: DEBUG nova.compute.manager [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:16:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:16:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:16:38 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:16:38 user nova-compute[75745]: INFO nova.compute.claims [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Claim successful on node user
Dec 01 17:16:39 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:16:39 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:16:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:16:39 user nova-compute[75745]: DEBUG nova.compute.manager [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:16:39 user nova-compute[75745]: DEBUG nova.compute.manager [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:16:39 user nova-compute[75745]: DEBUG nova.network.neutron [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:16:39 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:16:39 user nova-compute[75745]: DEBUG nova.compute.manager [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:16:39 user nova-compute[75745]: DEBUG nova.policy [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e92e1fa18cc4bdaa17afd2b2db97259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4e507763844b67b588fa2509ec3aff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:16:39 user nova-compute[75745]: DEBUG nova.compute.manager [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:16:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:16:39 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Creating image(s)
Dec 01 17:16:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "/opt/stack/data/nova/instances/63cffe58-0056-4b06-86d9-bee746c2f832/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:16:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "/opt/stack/data/nova/instances/63cffe58-0056-4b06-86d9-bee746c2f832/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:16:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "/opt/stack/data/nova/instances/63cffe58-0056-4b06-86d9-bee746c2f832/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:16:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.177s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:16:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:16:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.173s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/63cffe58-0056-4b06-86d9-bee746c2f832/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/63cffe58-0056-4b06-86d9-bee746c2f832/disk 1073741824" returned: 0 in 0.052s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:16:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:39 user nova-compute[75745]: DEBUG nova.network.neutron [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Successfully created port: 643d0b0f-f36b-4107-8f2a-4efd9db2973a {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.211s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Checking if we can resize image /opt/stack/data/nova/instances/63cffe58-0056-4b06-86d9-bee746c2f832/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63cffe58-0056-4b06-86d9-bee746c2f832/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63cffe58-0056-4b06-86d9-bee746c2f832/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Cannot resize image /opt/stack/data/nova/instances/63cffe58-0056-4b06-86d9-bee746c2f832/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Ensure instance console log exists: /opt/stack/data/nova/instances/63cffe58-0056-4b06-86d9-bee746c2f832/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG nova.network.neutron [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Successfully updated port: 643d0b0f-f36b-4107-8f2a-4efd9db2973a {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "refresh_cache-63cffe58-0056-4b06-86d9-bee746c2f832" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquired lock "refresh_cache-63cffe58-0056-4b06-86d9-bee746c2f832" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG nova.network.neutron [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG nova.compute.manager [req-f87bf392-11b2-4b9f-9840-30f72e0698d3 req-c89ae641-5cdf-49e5-a6b1-d8e296fca69e service nova] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Received event network-changed-643d0b0f-f36b-4107-8f2a-4efd9db2973a {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG nova.compute.manager [req-f87bf392-11b2-4b9f-9840-30f72e0698d3 req-c89ae641-5cdf-49e5-a6b1-d8e296fca69e service nova] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Refreshing instance network info cache due to event network-changed-643d0b0f-f36b-4107-8f2a-4efd9db2973a. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-f87bf392-11b2-4b9f-9840-30f72e0698d3 req-c89ae641-5cdf-49e5-a6b1-d8e296fca69e service nova] Acquiring lock "refresh_cache-63cffe58-0056-4b06-86d9-bee746c2f832" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG nova.network.neutron [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG nova.network.neutron [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Updating instance_info_cache with network_info: [{"id": "643d0b0f-f36b-4107-8f2a-4efd9db2973a", "address": "fa:16:3e:e3:a6:76", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643d0b0f-f3", "ovs_interfaceid": "643d0b0f-f36b-4107-8f2a-4efd9db2973a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Releasing lock "refresh_cache-63cffe58-0056-4b06-86d9-bee746c2f832" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG nova.compute.manager [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Instance network_info: |[{"id": "643d0b0f-f36b-4107-8f2a-4efd9db2973a", "address": "fa:16:3e:e3:a6:76", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643d0b0f-f3", "ovs_interfaceid": "643d0b0f-f36b-4107-8f2a-4efd9db2973a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-f87bf392-11b2-4b9f-9840-30f72e0698d3 req-c89ae641-5cdf-49e5-a6b1-d8e296fca69e service nova] Acquired lock "refresh_cache-63cffe58-0056-4b06-86d9-bee746c2f832" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG nova.network.neutron [req-f87bf392-11b2-4b9f-9840-30f72e0698d3 req-c89ae641-5cdf-49e5-a6b1-d8e296fca69e service nova] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Refreshing network info cache for port 643d0b0f-f36b-4107-8f2a-4efd9db2973a {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Start _get_guest_xml network_info=[{"id": "643d0b0f-f36b-4107-8f2a-4efd9db2973a", "address": "fa:16:3e:e3:a6:76", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643d0b0f-f3", "ovs_interfaceid": "643d0b0f-f36b-4107-8f2a-4efd9db2973a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:16:40 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:16:40 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:16:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:16:40 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:16:41 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:16:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-662811475',display_name='tempest-AttachVolumeTestJSON-server-662811475',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-662811475',id=29,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcaJ8xRX+d/Sg0b7vw2KL4t+17as5hlZUvo/uJwu0cc017UFPCChc+lXLkQwr97GvTWm6mMuXXOWRHejNFICInkRHWP2GW8pGzDIvbWuIr81+KgTpsQ72ReG3zW1z7SZA==',key_name='tempest-keypair-871035478',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c4e507763844b67b588fa2509ec3aff',ramdisk_id='',reservation_id='r-u0d12hnd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-712829532',owner_user_name='tempest-AttachVolumeTestJSON-712829532-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:16:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e92e1fa18cc4bdaa17afd2b2db97259',uuid=63cffe58-0056-4b06-86d9-bee746c2f832,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "643d0b0f-f36b-4107-8f2a-4efd9db2973a", "address": "fa:16:3e:e3:a6:76", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643d0b0f-f3", "ovs_interfaceid": "643d0b0f-f36b-4107-8f2a-4efd9db2973a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:16:41 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Converting VIF {"id": "643d0b0f-f36b-4107-8f2a-4efd9db2973a", "address": "fa:16:3e:e3:a6:76", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643d0b0f-f3", "ovs_interfaceid": "643d0b0f-f36b-4107-8f2a-4efd9db2973a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:16:41 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:a6:76,bridge_name='br-int',has_traffic_filtering=True,id=643d0b0f-f36b-4107-8f2a-4efd9db2973a,network=Network(b2b1c054-5370-4c64-9fb7-b98791c8f5ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap643d0b0f-f3') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:16:41 user nova-compute[75745]: DEBUG nova.objects.instance [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lazy-loading 'pci_devices' on Instance uuid 63cffe58-0056-4b06-86d9-bee746c2f832 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:16:41 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:16:41 user nova-compute[75745]:   <uuid>63cffe58-0056-4b06-86d9-bee746c2f832</uuid>
Dec 01 17:16:41 user nova-compute[75745]:   <name>instance-0000001d</name>
Dec 01 17:16:41 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:16:41 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:16:41 user nova-compute[75745]:   <metadata>
Dec 01 17:16:41 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:16:41 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:16:41 user nova-compute[75745]:       <nova:name>tempest-AttachVolumeTestJSON-server-662811475</nova:name>
Dec 01 17:16:41 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:16:40</nova:creationTime>
Dec 01 17:16:41 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:16:41 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:16:41 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:16:41 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:16:41 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:16:41 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:16:41 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:16:41 user nova-compute[75745]:       <nova:owner>
Dec 01 17:16:41 user nova-compute[75745]:         <nova:user uuid="7e92e1fa18cc4bdaa17afd2b2db97259">tempest-AttachVolumeTestJSON-712829532-project-member</nova:user>
Dec 01 17:16:41 user nova-compute[75745]:         <nova:project uuid="7c4e507763844b67b588fa2509ec3aff">tempest-AttachVolumeTestJSON-712829532</nova:project>
Dec 01 17:16:41 user nova-compute[75745]:       </nova:owner>
Dec 01 17:16:41 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:16:41 user nova-compute[75745]:       <nova:ports>
Dec 01 17:16:41 user nova-compute[75745]:         <nova:port uuid="643d0b0f-f36b-4107-8f2a-4efd9db2973a">
Dec 01 17:16:41 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 01 17:16:41 user nova-compute[75745]:         </nova:port>
Dec 01 17:16:41 user nova-compute[75745]:       </nova:ports>
Dec 01 17:16:41 user nova-compute[75745]:     </nova:instance>
Dec 01 17:16:41 user nova-compute[75745]:   </metadata>
Dec 01 17:16:41 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:16:41 user nova-compute[75745]:     <system>
Dec 01 17:16:41 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:16:41 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:16:41 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:16:41 user nova-compute[75745]:       <entry name="serial">63cffe58-0056-4b06-86d9-bee746c2f832</entry>
Dec 01 17:16:41 user nova-compute[75745]:       <entry name="uuid">63cffe58-0056-4b06-86d9-bee746c2f832</entry>
Dec 01 17:16:41 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:16:41 user nova-compute[75745]:     </system>
Dec 01 17:16:41 user nova-compute[75745]:   </sysinfo>
Dec 01 17:16:41 user nova-compute[75745]:   <os>
Dec 01 17:16:41 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:16:41 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:16:41 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:16:41 user nova-compute[75745]:   </os>
Dec 01 17:16:41 user nova-compute[75745]:   <features>
Dec 01 17:16:41 user nova-compute[75745]:     <acpi/>
Dec 01 17:16:41 user nova-compute[75745]:     <apic/>
Dec 01 17:16:41 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:16:41 user nova-compute[75745]:   </features>
Dec 01 17:16:41 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:16:41 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:16:41 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:16:41 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:16:41 user nova-compute[75745]:   </clock>
Dec 01 17:16:41 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:16:41 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:16:41 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:16:41 user nova-compute[75745]:   </cpu>
Dec 01 17:16:41 user nova-compute[75745]:   <devices>
Dec 01 17:16:41 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:16:41 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:16:41 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/63cffe58-0056-4b06-86d9-bee746c2f832/disk"/>
Dec 01 17:16:41 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:16:41 user nova-compute[75745]:     </disk>
Dec 01 17:16:41 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:16:41 user nova-compute[75745]:       <mac address="fa:16:3e:e3:a6:76"/>
Dec 01 17:16:41 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:16:41 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:16:41 user nova-compute[75745]:       <target dev="tap643d0b0f-f3"/>
Dec 01 17:16:41 user nova-compute[75745]:     </interface>
Dec 01 17:16:41 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:16:41 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/63cffe58-0056-4b06-86d9-bee746c2f832/console.log" append="off"/>
Dec 01 17:16:41 user nova-compute[75745]:     </serial>
Dec 01 17:16:41 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:16:41 user nova-compute[75745]:     <video>
Dec 01 17:16:41 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:16:41 user nova-compute[75745]:     </video>
Dec 01 17:16:41 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:16:41 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:16:41 user nova-compute[75745]:     </rng>
Dec 01 17:16:41 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:16:41 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:16:41 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:16:41 user nova-compute[75745]:     </memballoon>
Dec 01 17:16:41 user nova-compute[75745]:   </devices>
Dec 01 17:16:41 user nova-compute[75745]: </domain>
Dec 01 17:16:41 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:16:41 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:16:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-662811475',display_name='tempest-AttachVolumeTestJSON-server-662811475',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-662811475',id=29,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcaJ8xRX+d/Sg0b7vw2KL4t+17as5hlZUvo/uJwu0cc017UFPCChc+lXLkQwr97GvTWm6mMuXXOWRHejNFICInkRHWP2GW8pGzDIvbWuIr81+KgTpsQ72ReG3zW1z7SZA==',key_name='tempest-keypair-871035478',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c4e507763844b67b588fa2509ec3aff',ramdisk_id='',reservation_id='r-u0d12hnd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-712829532',owner_user_name='tempest-AttachVolumeTestJSON-712829532-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:16:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e92e1fa18cc4bdaa17afd2b2db97259',uuid=63cffe58-0056-4b06-86d9-bee746c2f832,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "643d0b0f-f36b-4107-8f2a-4efd9db2973a", "address": "fa:16:3e:e3:a6:76", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643d0b0f-f3", "ovs_interfaceid": "643d0b0f-f36b-4107-8f2a-4efd9db2973a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:16:41 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Converting VIF {"id": "643d0b0f-f36b-4107-8f2a-4efd9db2973a", "address": "fa:16:3e:e3:a6:76", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643d0b0f-f3", "ovs_interfaceid": "643d0b0f-f36b-4107-8f2a-4efd9db2973a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:16:41 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:a6:76,bridge_name='br-int',has_traffic_filtering=True,id=643d0b0f-f36b-4107-8f2a-4efd9db2973a,network=Network(b2b1c054-5370-4c64-9fb7-b98791c8f5ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap643d0b0f-f3') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:16:41 user nova-compute[75745]: DEBUG os_vif [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:a6:76,bridge_name='br-int',has_traffic_filtering=True,id=643d0b0f-f36b-4107-8f2a-4efd9db2973a,network=Network(b2b1c054-5370-4c64-9fb7-b98791c8f5ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap643d0b0f-f3') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:16:41 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:41 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:16:41 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:16:41 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:41 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd9478def-d784-534e-9661-39336f88dca4', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:16:41 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:41 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:41 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:41 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap643d0b0f-f3, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:16:41 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap643d0b0f-f3, col_values=(('qos', UUID('dda851e6-42d4-4014-a86a-a1ee994495c7')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:16:41 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap643d0b0f-f3, col_values=(('external_ids', {'iface-id': '643d0b0f-f36b-4107-8f2a-4efd9db2973a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:a6:76', 'vm-uuid': '63cffe58-0056-4b06-86d9-bee746c2f832'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:16:41 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:41 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:16:41 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:41 user nova-compute[75745]: INFO os_vif [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:a6:76,bridge_name='br-int',has_traffic_filtering=True,id=643d0b0f-f36b-4107-8f2a-4efd9db2973a,network=Network(b2b1c054-5370-4c64-9fb7-b98791c8f5ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap643d0b0f-f3')
Dec 01 17:16:41 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:16:41 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] No VIF found with MAC fa:16:3e:e3:a6:76, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:16:41 user nova-compute[75745]: DEBUG nova.network.neutron [req-f87bf392-11b2-4b9f-9840-30f72e0698d3 req-c89ae641-5cdf-49e5-a6b1-d8e296fca69e service nova] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Updated VIF entry in instance network info cache for port 643d0b0f-f36b-4107-8f2a-4efd9db2973a. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:16:41 user nova-compute[75745]: DEBUG nova.network.neutron [req-f87bf392-11b2-4b9f-9840-30f72e0698d3 req-c89ae641-5cdf-49e5-a6b1-d8e296fca69e service nova] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Updating instance_info_cache with network_info: [{"id": "643d0b0f-f36b-4107-8f2a-4efd9db2973a", "address": "fa:16:3e:e3:a6:76", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643d0b0f-f3", "ovs_interfaceid": "643d0b0f-f36b-4107-8f2a-4efd9db2973a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:16:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-f87bf392-11b2-4b9f-9840-30f72e0698d3 req-c89ae641-5cdf-49e5-a6b1-d8e296fca69e service nova] Releasing lock "refresh_cache-63cffe58-0056-4b06-86d9-bee746c2f832" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:16:41 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:16:41 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75745) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 01 17:16:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:42 user nova-compute[75745]: DEBUG nova.compute.manager [req-148c36c5-d53f-4d74-8149-9494051d90d4 req-f9314639-9d14-42c6-9347-05a58e99d686 service nova] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Received event network-vif-plugged-643d0b0f-f36b-4107-8f2a-4efd9db2973a {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:16:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-148c36c5-d53f-4d74-8149-9494051d90d4 req-f9314639-9d14-42c6-9347-05a58e99d686 service nova] Acquiring lock "63cffe58-0056-4b06-86d9-bee746c2f832-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:16:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-148c36c5-d53f-4d74-8149-9494051d90d4 req-f9314639-9d14-42c6-9347-05a58e99d686 service nova] Lock "63cffe58-0056-4b06-86d9-bee746c2f832-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:16:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-148c36c5-d53f-4d74-8149-9494051d90d4 req-f9314639-9d14-42c6-9347-05a58e99d686 service nova] Lock "63cffe58-0056-4b06-86d9-bee746c2f832-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:16:42 user nova-compute[75745]: DEBUG nova.compute.manager [req-148c36c5-d53f-4d74-8149-9494051d90d4 req-f9314639-9d14-42c6-9347-05a58e99d686 service nova] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] No waiting events found dispatching network-vif-plugged-643d0b0f-f36b-4107-8f2a-4efd9db2973a {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:16:42 user nova-compute[75745]: WARNING nova.compute.manager [req-148c36c5-d53f-4d74-8149-9494051d90d4 req-f9314639-9d14-42c6-9347-05a58e99d686 service nova] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Received unexpected event network-vif-plugged-643d0b0f-f36b-4107-8f2a-4efd9db2973a for instance with vm_state building and task_state spawning.
Dec 01 17:16:42 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:16:43 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:43 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:43 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:43 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:43 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:16:43 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:16:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:44 user nova-compute[75745]: DEBUG nova.compute.manager [req-286e4f2a-6028-4b1a-92ba-f2046e5cf546 req-5e7e09a9-134b-4baa-a887-8f90ab1419f2 service nova] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Received event network-vif-plugged-643d0b0f-f36b-4107-8f2a-4efd9db2973a {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:16:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-286e4f2a-6028-4b1a-92ba-f2046e5cf546 req-5e7e09a9-134b-4baa-a887-8f90ab1419f2 service nova] Acquiring lock "63cffe58-0056-4b06-86d9-bee746c2f832-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:16:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-286e4f2a-6028-4b1a-92ba-f2046e5cf546 req-5e7e09a9-134b-4baa-a887-8f90ab1419f2 service nova] Lock "63cffe58-0056-4b06-86d9-bee746c2f832-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:16:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-286e4f2a-6028-4b1a-92ba-f2046e5cf546 req-5e7e09a9-134b-4baa-a887-8f90ab1419f2 service nova] Lock "63cffe58-0056-4b06-86d9-bee746c2f832-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:16:44 user nova-compute[75745]: DEBUG nova.compute.manager [req-286e4f2a-6028-4b1a-92ba-f2046e5cf546 req-5e7e09a9-134b-4baa-a887-8f90ab1419f2 service nova] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] No waiting events found dispatching network-vif-plugged-643d0b0f-f36b-4107-8f2a-4efd9db2973a {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:16:44 user nova-compute[75745]: WARNING nova.compute.manager [req-286e4f2a-6028-4b1a-92ba-f2046e5cf546 req-5e7e09a9-134b-4baa-a887-8f90ab1419f2 service nova] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Received unexpected event network-vif-plugged-643d0b0f-f36b-4107-8f2a-4efd9db2973a for instance with vm_state building and task_state spawning.
Dec 01 17:16:44 user nova-compute[75745]: DEBUG nova.compute.manager [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:16:44 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:16:44 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Instance spawned successfully.
Dec 01 17:16:44 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:16:44 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:16:44 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:16:44 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:16:44 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:16:44 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:16:44 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:16:44 user nova-compute[75745]: INFO nova.compute.manager [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Took 5.51 seconds to spawn the instance on the hypervisor.
Dec 01 17:16:44 user nova-compute[75745]: DEBUG nova.compute.manager [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:16:45 user nova-compute[75745]: INFO nova.compute.manager [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Took 6.35 seconds to build instance.
Dec 01 17:16:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2e3b86a5-c2db-49eb-b860-e68833fb3791 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "63cffe58-0056-4b06-86d9-bee746c2f832" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.447s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:16:45 user nova-compute[75745]: DEBUG nova.compute.manager [req-5bcb3611-fbbd-40ea-ad0e-ff51dba0d806 req-c020ecbf-617c-400d-a9dc-76259424558d service nova] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Received event network-changed-30260fca-fac2-4377-b514-add8784429c4 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:16:45 user nova-compute[75745]: DEBUG nova.compute.manager [req-5bcb3611-fbbd-40ea-ad0e-ff51dba0d806 req-c020ecbf-617c-400d-a9dc-76259424558d service nova] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Refreshing instance network info cache due to event network-changed-30260fca-fac2-4377-b514-add8784429c4. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:16:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5bcb3611-fbbd-40ea-ad0e-ff51dba0d806 req-c020ecbf-617c-400d-a9dc-76259424558d service nova] Acquiring lock "refresh_cache-9aca117f-581a-4625-abf1-c7faba669572" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:16:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5bcb3611-fbbd-40ea-ad0e-ff51dba0d806 req-c020ecbf-617c-400d-a9dc-76259424558d service nova] Acquired lock "refresh_cache-9aca117f-581a-4625-abf1-c7faba669572" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:16:45 user nova-compute[75745]: DEBUG nova.network.neutron [req-5bcb3611-fbbd-40ea-ad0e-ff51dba0d806 req-c020ecbf-617c-400d-a9dc-76259424558d service nova] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Refreshing network info cache for port 30260fca-fac2-4377-b514-add8784429c4 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:16:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "9aca117f-581a-4625-abf1-c7faba669572" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:16:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "9aca117f-581a-4625-abf1-c7faba669572" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:16:45 user nova-compute[75745]: DEBUG nova.objects.instance [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lazy-loading 'flavor' on Instance uuid 9aca117f-581a-4625-abf1-c7faba669572 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:16:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "9aca117f-581a-4625-abf1-c7faba669572" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.097s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:16:45 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:16:46 user nova-compute[75745]: DEBUG nova.network.neutron [req-5bcb3611-fbbd-40ea-ad0e-ff51dba0d806 req-c020ecbf-617c-400d-a9dc-76259424558d service nova] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Updated VIF entry in instance network info cache for port 30260fca-fac2-4377-b514-add8784429c4. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:16:46 user nova-compute[75745]: DEBUG nova.network.neutron [req-5bcb3611-fbbd-40ea-ad0e-ff51dba0d806 req-c020ecbf-617c-400d-a9dc-76259424558d service nova] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Updating instance_info_cache with network_info: [{"id": "30260fca-fac2-4377-b514-add8784429c4", "address": "fa:16:3e:d6:94:e3", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30260fca-fa", "ovs_interfaceid": "30260fca-fac2-4377-b514-add8784429c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:16:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5bcb3611-fbbd-40ea-ad0e-ff51dba0d806 req-c020ecbf-617c-400d-a9dc-76259424558d service nova] Releasing lock "refresh_cache-9aca117f-581a-4625-abf1-c7faba669572" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:16:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "9aca117f-581a-4625-abf1-c7faba669572" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:16:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "9aca117f-581a-4625-abf1-c7faba669572" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:16:46 user nova-compute[75745]: INFO nova.compute.manager [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Attaching volume da9f9e8e-5434-4610-aab3-51748fb3b8fc to /dev/vdb
Dec 01 17:16:46 user nova-compute[75745]: DEBUG os_brick.utils [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:16:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:46 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b5e990-249f-47a7-ae75-55db7f19b6bb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:46 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[837c1eeb-69cd-4810-b5ac-bae731de9c10]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:46 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[189af710-84b5-4326-83d5-59d9560ff6fa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:46 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85c2502-b78f-4b95-8744-15365acf948a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:16:46 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:16:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:16:46 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:16:46 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d035c4ec-4c40-4aaa-92a9-4e12ff129465]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:46 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:16:46 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:16:46 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:16:46 user nova-compute[75745]: DEBUG os_brick.utils [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:16:46 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Updating existing volume attachment record: 3d9b891f-e179-4d99-8b43-d515394cd3da {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:16:46 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:16:48 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:16:48 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:16:48 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:16:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:49 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:16:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:16:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:16:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:16:49 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:16:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0959ad6-3d88-47d7-bf74-58fcb727fb3e/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0959ad6-3d88-47d7-bf74-58fcb727fb3e/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0959ad6-3d88-47d7-bf74-58fcb727fb3e/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0959ad6-3d88-47d7-bf74-58fcb727fb3e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce212884-ddef-4db5-8b22-9f2e1502fadd/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce212884-ddef-4db5-8b22-9f2e1502fadd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce212884-ddef-4db5-8b22-9f2e1502fadd/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce212884-ddef-4db5-8b22-9f2e1502fadd/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk --force-share --output=json" returned: 0 in 0.366s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486/disk --force-share --output=json" returned: 0 in 0.408s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486/disk --force-share --output=json" returned: 0 in 0.451s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63cffe58-0056-4b06-86d9-bee746c2f832/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63cffe58-0056-4b06-86d9-bee746c2f832/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63cffe58-0056-4b06-86d9-bee746c2f832/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63cffe58-0056-4b06-86d9-bee746c2f832/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:55 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:16:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:16:56 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:16:56 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:16:56 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=7261MB free_disk=25.324886322021484GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:16:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:16:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:16:56 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance d997cdd6-67c6-4263-814a-17cf9e27bbeb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:16:56 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 3a56aca8-ffbb-450b-a953-fc2071902486 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:16:56 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 0ab0c115-74aa-4e55-92a3-6fa91ba753e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:16:56 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance e4ffb96e-456c-4fb9-9850-9e98310d63e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:16:56 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 80962f79-dbb2-4380-b2c8-791642cfa86b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:16:56 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance a690fa65-078d-4ffd-bc62-3366aaa3d681 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:16:56 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 9aca117f-581a-4625-abf1-c7faba669572 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:16:56 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 98b29ba5-9993-4494-b196-f7eea077df7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:16:56 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance ce212884-ddef-4db5-8b22-9f2e1502fadd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:16:56 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance e0959ad6-3d88-47d7-bf74-58fcb727fb3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:16:56 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 63cffe58-0056-4b06-86d9-bee746c2f832 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:16:56 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:16:56 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMKyIbSf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:16:57 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:16:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.005s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:16:57 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:16:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:16:57 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[72212f65-42ca-4cbd-ac8b-b8e30c62be50]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:16:57 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ce7961-e754-4bce-9013-a83616f7275a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc] added
Dec 01 17:16:57 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.673s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Cleaning up deleted instances {{(pid=75745) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] There are 0 instances to clean {{(pid=75745) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc38be7-e4aa-43e6-8b7a-67733f455416]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[78af6c08-8595-4037-9cd0-4fc7ee090dff]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QMKyIbSf {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QMKyIbSf" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba55fcae-bb75-4396-83b8-a0ee2ed1e252]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QMKyIbSf'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[db24ee15-cb07-432e-a002-dae8417133d7]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[06708a31-3ff7-45b6-9430-d4e2f98014b3]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe9d70f3-a979-49fd-931b-2e0773b59e6c (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:16:57 user nova-compute[75745]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe9d70f3-a979-49fd-931b-2e0773b59e6c (non-flash)
Dec 01 17:16:57 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:16:57 user nova-compute[75745]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe9d70f3-a979-49fd-931b-2e0773b59e6c (non-flash)
Dec 01 17:16:57 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6833f4fe-9b0e-4f4d-8e3e-4e83bd26aba2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc, portal: 172.16.0.220,3260]
Dec 01 17:16:57 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc, portal: 172.16.0.220,3260] successful.
Dec 01 17:16:57 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a16f45-6655-418b-af23-542fdd8c45d0]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f12577-e461-454a-b13f-b6e356c6e31d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe9d70f3-a979-49fd-931b-2e0773b59e6c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:16:57 user nova-compute[75745]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe9d70f3-a979-49fd-931b-2e0773b59e6c (non-flash)
Dec 01 17:16:57 user nova-compute[75745]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc (non-flash)
Dec 01 17:16:57 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:16:57 user nova-compute[75745]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe9d70f3-a979-49fd-931b-2e0773b59e6c (non-flash)
Dec 01 17:16:57 user nova-compute[75745]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc (non-flash)
Dec 01 17:16:57 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff3a98d-de38-47e8-b485-42587680adaf]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMKyIbSf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-28cc8b0a-d90c-4932-a687-516bdf293bf8 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Acquiring lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-28cc8b0a-d90c-4932-a687-516bdf293bf8 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG nova.objects.instance [None req-28cc8b0a-d90c-4932-a687-516bdf293bf8 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lazy-loading 'flavor' on Instance uuid 0ab0c115-74aa-4e55-92a3-6fa91ba753e3 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-28cc8b0a-d90c-4932-a687-516bdf293bf8 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-28cc8b0a-d90c-4932-a687-516bdf293bf8 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Acquiring lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:16:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-28cc8b0a-d90c-4932-a687-516bdf293bf8 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:16:57 user nova-compute[75745]: INFO nova.compute.manager [None req-28cc8b0a-d90c-4932-a687-516bdf293bf8 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Attaching volume 41a00766-71f0-45af-9487-dcecd44349ab to /dev/vdb
Dec 01 17:16:58 user nova-compute[75745]: DEBUG os_brick.utils [None req-28cc8b0a-d90c-4932-a687-516bdf293bf8 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:16:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.048s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:58 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd405d5e-b4cb-4868-8ee9-21f1bc2c1fb9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:58 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[78143fa0-8194-4d89-b5bb-cfa61b6e2d83]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:16:58 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6dea8b-b65a-4b1e-b1ce-49ff1f62e3d8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:58 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18e70f8-cf21-4564-9fc1-281afcf4a093]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-28cc8b0a-d90c-4932-a687-516bdf293bf8 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-28cc8b0a-d90c-4932-a687-516bdf293bf8 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:16:58 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-28cc8b0a-d90c-4932-a687-516bdf293bf8 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:16:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:16:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:16:58 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:16:58 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef15deab-a162-4fb3-aafb-72d99e733335]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:16:58 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-28cc8b0a-d90c-4932-a687-516bdf293bf8 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:16:58 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-28cc8b0a-d90c-4932-a687-516bdf293bf8 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:16:58 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-28cc8b0a-d90c-4932-a687-516bdf293bf8 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:16:58 user nova-compute[75745]: DEBUG os_brick.utils [None req-28cc8b0a-d90c-4932-a687-516bdf293bf8 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:16:58 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-28cc8b0a-d90c-4932-a687-516bdf293bf8 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Updating existing volume attachment record: fbbdf245-6f1e-4b65-a351-4a4dbcbafb9e {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:16:58 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:16:58 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23934393335343434', 'path': '/dev/sdd'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:16:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934393335343434', 'path': '/dev/sdd'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:16:58 user nova-compute[75745]: DEBUG nova.objects.instance [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lazy-loading 'flavor' on Instance uuid 9aca117f-581a-4625-abf1-c7faba669572 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:16:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 17:16:58 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:16:58 user nova-compute[75745]:   <source dev="/dev/sdd"/>
Dec 01 17:16:58 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:16:58 user nova-compute[75745]:   <serial>da9f9e8e-5434-4610-aab3-51748fb3b8fc</serial>
Dec 01 17:16:58 user nova-compute[75745]: </disk>
Dec 01 17:16:58 user nova-compute[75745]:  {{(pid=75745) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 17:16:59 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:16:59 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:16:59 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Didn't find any instances for network info cache update. {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 17:16:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:16:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:16:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] No VIF found with MAC fa:16:3e:d6:94:e3, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:16:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0158f890-8f5f-4a98-a05e-dea9b43869d4 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "9aca117f-581a-4625-abf1-c7faba669572" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.102s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:17:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:01 user nova-compute[75745]: INFO nova.compute.manager [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Rebuilding instance
Dec 01 17:17:02 user nova-compute[75745]: DEBUG nova.compute.manager [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:17:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:02 user nova-compute[75745]: DEBUG nova.compute.manager [req-bef11d9f-b0ea-4573-b14c-ee483c8c45cf req-a2ecaa80-7493-4d1f-97a5-7ef21992c6d4 service nova] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Received event network-vif-unplugged-30260fca-fac2-4377-b514-add8784429c4 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:17:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-bef11d9f-b0ea-4573-b14c-ee483c8c45cf req-a2ecaa80-7493-4d1f-97a5-7ef21992c6d4 service nova] Acquiring lock "9aca117f-581a-4625-abf1-c7faba669572-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:17:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-bef11d9f-b0ea-4573-b14c-ee483c8c45cf req-a2ecaa80-7493-4d1f-97a5-7ef21992c6d4 service nova] Lock "9aca117f-581a-4625-abf1-c7faba669572-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:17:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-bef11d9f-b0ea-4573-b14c-ee483c8c45cf req-a2ecaa80-7493-4d1f-97a5-7ef21992c6d4 service nova] Lock "9aca117f-581a-4625-abf1-c7faba669572-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:17:02 user nova-compute[75745]: DEBUG nova.compute.manager [req-bef11d9f-b0ea-4573-b14c-ee483c8c45cf req-a2ecaa80-7493-4d1f-97a5-7ef21992c6d4 service nova] [instance: 9aca117f-581a-4625-abf1-c7faba669572] No waiting events found dispatching network-vif-unplugged-30260fca-fac2-4377-b514-add8784429c4 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:17:02 user nova-compute[75745]: WARNING nova.compute.manager [req-bef11d9f-b0ea-4573-b14c-ee483c8c45cf req-a2ecaa80-7493-4d1f-97a5-7ef21992c6d4 service nova] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Received unexpected event network-vif-unplugged-30260fca-fac2-4377-b514-add8784429c4 for instance with vm_state active and task_state rebuilding.
Dec 01 17:17:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:02 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Instance destroyed successfully.
Dec 01 17:17:03 user nova-compute[75745]: INFO nova.compute.manager [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Detaching volume da9f9e8e-5434-4610-aab3-51748fb3b8fc
Dec 01 17:17:03 user nova-compute[75745]: INFO nova.virt.block_device [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Attempting to driver detach volume da9f9e8e-5434-4610-aab3-51748fb3b8fc from mountpoint /dev/vdb
Dec 01 17:17:03 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Attempting to detach device vdb from instance 9aca117f-581a-4625-abf1-c7faba669572 from the persistent domain config. {{(pid=75745) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:17:03 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:17:03 user nova-compute[75745]:   <source dev="/dev/sdd"/>
Dec 01 17:17:03 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:17:03 user nova-compute[75745]:   <serial>da9f9e8e-5434-4610-aab3-51748fb3b8fc</serial>
Dec 01 17:17:03 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 17:17:03 user nova-compute[75745]: </disk>
Dec 01 17:17:03 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:17:03 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Successfully detached device vdb from instance 9aca117f-581a-4625-abf1-c7faba669572 from the persistent domain config.
Dec 01 17:17:03 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMKyIbSf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:17:03 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 01 17:17:03 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e534d3d-02cf-4c15-9bac-a1e253b2e411]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe9d70f3-a979-49fd-931b-2e0773b59e6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:17:03 user nova-compute[75745]: No targets found.
Dec 01 17:17:03 user nova-compute[75745]: iSNS:
Dec 01 17:17:03 user nova-compute[75745]: No targets found.
Dec 01 17:17:03 user nova-compute[75745]: STATIC:
Dec 01 17:17:03 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:fe9d70f3-a979-49fd-931b-2e0773b59e6c
Dec 01 17:17:03 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:17:03 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:17:03 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0
Dec 01 17:17:03 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:17:03 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:17:03 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc
Dec 01 17:17:03 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:17:03 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:17:03 user nova-compute[75745]: FIRMWARE:
Dec 01 17:17:03 user nova-compute[75745]: No targets found.
Dec 01 17:17:03 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:17:03 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:17:03 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[941e0f0e-f694-497f-b815-d37137a696f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe9d70f3-a979-49fd-931b-2e0773b59e6c\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcc8560-279d-44ec-a85c-621030de9a8d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe9d70f3-a979-49fd-931b-2e0773b59e6c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:17:03 user nova-compute[75745]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe9d70f3-a979-49fd-931b-2e0773b59e6c (non-flash)
Dec 01 17:17:03 user nova-compute[75745]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc (non-flash)
Dec 01 17:17:03 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:17:03 user nova-compute[75745]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe9d70f3-a979-49fd-931b-2e0773b59e6c (non-flash)
Dec 01 17:17:03 user nova-compute[75745]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc (non-flash)
Dec 01 17:17:03 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24986a4670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc'): ({'sdd'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Removing single pathed devices sdd {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.053s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3958fc0f-e84d-416b-a716-459d6d188a47]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[992bcd5f-0c40-45b9-bf32-00739e9772f3]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Flushing IO for device /dev/sdd {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a844d45-6d56-407a-ae5f-3387ebf831da]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ca0c28-5a5c-4cab-8f82-4bc1bb4ff103]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] SCSI volumes sdd have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[98003494-ad13-48ec-bee6-24c7db05bcf4]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a713e985-0e86-4620-99c0-34371ebc98b6]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc, portal: 172.16.0.220,3260]
Dec 01 17:17:03 user nova-compute[75745]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc, portal: 172.16.0.220,3260] successful.
Dec 01 17:17:03 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[febb4a11-d859-4175-a34c-94caf27d659a]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] <== disconnect_volume: return (373ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:17:03 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG nova.compute.manager [req-7a4b1905-a709-4dfe-9dce-3c94f5cc73cc req-670126a7-748b-4b7e-b553-c9c7a4e44314 service nova] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Received event network-vif-plugged-30260fca-fac2-4377-b514-add8784429c4 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7a4b1905-a709-4dfe-9dce-3c94f5cc73cc req-670126a7-748b-4b7e-b553-c9c7a4e44314 service nova] Acquiring lock "9aca117f-581a-4625-abf1-c7faba669572-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7a4b1905-a709-4dfe-9dce-3c94f5cc73cc req-670126a7-748b-4b7e-b553-c9c7a4e44314 service nova] Lock "9aca117f-581a-4625-abf1-c7faba669572-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7a4b1905-a709-4dfe-9dce-3c94f5cc73cc req-670126a7-748b-4b7e-b553-c9c7a4e44314 service nova] Lock "9aca117f-581a-4625-abf1-c7faba669572-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG nova.compute.manager [req-7a4b1905-a709-4dfe-9dce-3c94f5cc73cc req-670126a7-748b-4b7e-b553-c9c7a4e44314 service nova] [instance: 9aca117f-581a-4625-abf1-c7faba669572] No waiting events found dispatching network-vif-plugged-30260fca-fac2-4377-b514-add8784429c4 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:17:04 user nova-compute[75745]: WARNING nova.compute.manager [req-7a4b1905-a709-4dfe-9dce-3c94f5cc73cc req-670126a7-748b-4b7e-b553-c9c7a4e44314 service nova] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Received unexpected event network-vif-plugged-30260fca-fac2-4377-b514-add8784429c4 for instance with vm_state active and task_state rebuilding.
Dec 01 17:17:04 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Instance destroyed successfully.
Dec 01 17:17:04 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-860674518',display_name='tempest-ServerActionsTestOtherA-server-1881038620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-860674518',id=26,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0VPvubRo9N9hDbGZ7rvBGfNIC49qGsVU6LVqmy/4M0zGXAuWOJcM6VFMASpfTpY2Uok0EIDnJL42vbGcwlx4yY9AlIDoh46ApbqcvwQjSds+Lyv6QMRAVGuNqnSLgdTA==',key_name='tempest-keypair-723015957',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:15:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='409356993ea442c5abdf4269aebe43ab',ramdisk_id='',reservation_id='r-9f0md9mc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1500186869',owner_user_name='tempest-ServerActionsTestOtherA-1500186869-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:17:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5204ecaa9b354d10bac514c27acbccc6',uuid=9aca117f-581a-4625-abf1-c7faba669572,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30260fca-fac2-4377-b514-add8784429c4", "address": "fa:16:3e:d6:94:e3", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30260fca-fa", "ovs_interfaceid": "30260fca-fac2-4377-b514-add8784429c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Converting VIF {"id": "30260fca-fac2-4377-b514-add8784429c4", "address": "fa:16:3e:d6:94:e3", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30260fca-fa", "ovs_interfaceid": "30260fca-fac2-4377-b514-add8784429c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:94:e3,bridge_name='br-int',has_traffic_filtering=True,id=30260fca-fac2-4377-b514-add8784429c4,network=Network(f7cefc9d-2279-4601-8a81-a640ad1aea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30260fca-fa') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG os_vif [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:94:e3,bridge_name='br-int',has_traffic_filtering=True,id=30260fca-fac2-4377-b514-add8784429c4,network=Network(f7cefc9d-2279-4601-8a81-a640ad1aea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30260fca-fa') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30260fca-fa, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8dd72a37-0188-40b8-910d-f53268f1f29e) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:04 user nova-compute[75745]: INFO os_vif [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:94:e3,bridge_name='br-int',has_traffic_filtering=True,id=30260fca-fac2-4377-b514-add8784429c4,network=Network(f7cefc9d-2279-4601-8a81-a640ad1aea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30260fca-fa')
Dec 01 17:17:04 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMKyIbSf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:17:04 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 01 17:17:04 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2026c8fc-ee50-4859-b57f-882e10d5008d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe9d70f3-a979-49fd-931b-2e0773b59e6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:17:04 user nova-compute[75745]: No targets found.
Dec 01 17:17:04 user nova-compute[75745]: iSNS:
Dec 01 17:17:04 user nova-compute[75745]: No targets found.
Dec 01 17:17:04 user nova-compute[75745]: STATIC:
Dec 01 17:17:04 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:fe9d70f3-a979-49fd-931b-2e0773b59e6c
Dec 01 17:17:04 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:17:04 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:17:04 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0
Dec 01 17:17:04 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:17:04 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:17:04 user nova-compute[75745]: FIRMWARE:
Dec 01 17:17:04 user nova-compute[75745]: No targets found.
Dec 01 17:17:04 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:17:04 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:17:04 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c21941-9dde-428a-b8c8-9a1a101567f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe9d70f3-a979-49fd-931b-2e0773b59e6c\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[80adc153-1f9c-4027-ae5b-8518347bf7e8]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe9d70f3-a979-49fd-931b-2e0773b59e6c (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:17:04 user nova-compute[75745]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe9d70f3-a979-49fd-931b-2e0773b59e6c (non-flash)
Dec 01 17:17:04 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:17:04 user nova-compute[75745]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe9d70f3-a979-49fd-931b-2e0773b59e6c (non-flash)
Dec 01 17:17:04 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24dbd693f0>, {}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Disconnecting from: [] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.086s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] <== disconnect_volume: return (87ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:17:04 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:17:04 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Deleting instance files /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572_del
Dec 01 17:17:04 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Deletion of /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572_del complete
Dec 01 17:17:05 user nova-compute[75745]: INFO nova.virt.block_device [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Booting with volume da9f9e8e-5434-4610-aab3-51748fb3b8fc at /dev/vdb
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.volume.cinder [None req-28cc8b0a-d90c-4932-a687-516bdf293bf8 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Update attachment failed for attachment fbbdf245-6f1e-4b65-a351-4a4dbcbafb9e. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-aeddcf56-528c-48cb-a6a6-efdc67d208bc) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-aeddcf56-528c-48cb-a6a6-efdc67d208bc)
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [None req-28cc8b0a-d90c-4932-a687-516bdf293bf8 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Failed to attach 41a00766-71f0-45af-9487-dcecd44349ab at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-aeddcf56-528c-48cb-a6a6-efdc67d208bc)
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Traceback (most recent call last):
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3]     bdm.attach(context, instance, self.volume_api, self.driver,
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3]     ret_val = method(obj, context, *args, **kwargs)
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3]     self._do_attach(context, instance, volume, volume_api,
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3]     self._volume_attach(context, volume, connector, instance,
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3]     connection_info = volume_api.attachment_update(
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3]     res = method(self, ctx, *args, **kwargs)
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3]     res = method(self, ctx, attachment_id, *args, **kwargs)
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3]     with excutils.save_and_reraise_exception():
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3]     self.force_reraise()
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3]     raise self.value
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3]     context, '3.44', skip_version_check=True).attachments.update(
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3]     return method.func(obj, *args, **kwargs)
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3]     resp = self._update('/attachments/%s' % id, body)
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3]     resp, body = self.api.client.put(url, body=body, **kwargs)
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3]     return self._cs_request(url, 'PUT', **kwargs)
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3]     return self.request(url, method, **kwargs)
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3]     raise exceptions.from_response(resp, body)
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-aeddcf56-528c-48cb-a6a6-efdc67d208bc)
Dec 01 17:17:05 user nova-compute[75745]: ERROR nova.compute.manager [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] 
Dec 01 17:17:05 user nova-compute[75745]: DEBUG os_brick.utils [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:17:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:05 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[46969638-5a1d-4424-8846-b6cad6d246c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:17:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:05 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64ccecc-78f2-4d18-bad8-45aa1af5de4d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:17:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.056s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:05 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17c8092-ef5e-45bd-ae62-619329a413d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:17:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-28cc8b0a-d90c-4932-a687-516bdf293bf8 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.261s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:17:05 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5bce7d-cb58-4830-85ea-c98f8ef46b83]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:17:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:17:05 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:17:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:17:05 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:17:05 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f44643-5577-4fdb-9663-101d02af6ef5]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:17:05 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:17:05 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:17:05 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:17:05 user nova-compute[75745]: DEBUG os_brick.utils [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:17:05 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Updating existing volume attachment record: 82afd64c-1e0c-4f08-9010-1ef846f76e7d {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server [None req-28cc8b0a-d90c-4932-a687-516bdf293bf8 tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-aeddcf56-528c-48cb-a6a6-efdc67d208bc)
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-aeddcf56-528c-48cb-a6a6-efdc67d208bc)
Dec 01 17:17:05 user nova-compute[75745]: ERROR oslo_messaging.rpc.server 
Dec 01 17:17:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-bc22afaa-70fb-4723-8887-2a99b5458ca2 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Acquiring lock "3a56aca8-ffbb-450b-a953-fc2071902486" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:17:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-bc22afaa-70fb-4723-8887-2a99b5458ca2 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "3a56aca8-ffbb-450b-a953-fc2071902486" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:17:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-bc22afaa-70fb-4723-8887-2a99b5458ca2 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Acquiring lock "3a56aca8-ffbb-450b-a953-fc2071902486-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:17:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-bc22afaa-70fb-4723-8887-2a99b5458ca2 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "3a56aca8-ffbb-450b-a953-fc2071902486-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:17:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-bc22afaa-70fb-4723-8887-2a99b5458ca2 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "3a56aca8-ffbb-450b-a953-fc2071902486-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:17:12 user nova-compute[75745]: INFO nova.compute.manager [None req-bc22afaa-70fb-4723-8887-2a99b5458ca2 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Terminating instance
Dec 01 17:17:12 user nova-compute[75745]: DEBUG nova.compute.manager [None req-bc22afaa-70fb-4723-8887-2a99b5458ca2 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:17:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:12 user nova-compute[75745]: DEBUG nova.compute.manager [req-8838793d-91e7-4f64-9b2b-6ee7b68ce7fa req-27fd1cd9-5881-481d-bf0f-ece5e87b1227 service nova] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Received event network-vif-unplugged-0bfa2344-df4f-4c3a-9b5d-97b85e4b2515 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:17:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8838793d-91e7-4f64-9b2b-6ee7b68ce7fa req-27fd1cd9-5881-481d-bf0f-ece5e87b1227 service nova] Acquiring lock "3a56aca8-ffbb-450b-a953-fc2071902486-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:17:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8838793d-91e7-4f64-9b2b-6ee7b68ce7fa req-27fd1cd9-5881-481d-bf0f-ece5e87b1227 service nova] Lock "3a56aca8-ffbb-450b-a953-fc2071902486-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:17:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8838793d-91e7-4f64-9b2b-6ee7b68ce7fa req-27fd1cd9-5881-481d-bf0f-ece5e87b1227 service nova] Lock "3a56aca8-ffbb-450b-a953-fc2071902486-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:17:12 user nova-compute[75745]: DEBUG nova.compute.manager [req-8838793d-91e7-4f64-9b2b-6ee7b68ce7fa req-27fd1cd9-5881-481d-bf0f-ece5e87b1227 service nova] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] No waiting events found dispatching network-vif-unplugged-0bfa2344-df4f-4c3a-9b5d-97b85e4b2515 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:17:12 user nova-compute[75745]: DEBUG nova.compute.manager [req-8838793d-91e7-4f64-9b2b-6ee7b68ce7fa req-27fd1cd9-5881-481d-bf0f-ece5e87b1227 service nova] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Received event network-vif-unplugged-0bfa2344-df4f-4c3a-9b5d-97b85e4b2515 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:17:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:12 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Instance destroyed successfully.
Dec 01 17:17:12 user nova-compute[75745]: DEBUG nova.objects.instance [None req-bc22afaa-70fb-4723-8887-2a99b5458ca2 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lazy-loading 'resources' on Instance uuid 3a56aca8-ffbb-450b-a953-fc2071902486 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:17:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-bc22afaa-70fb-4723-8887-2a99b5458ca2 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:11:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-487107947',display_name='tempest-VolumesAdminNegativeTest-server-487107947',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-487107947',id=18,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZLjze4FkGOylb0jFVFIB9tdNcTx7AFKqs6N3dDsif+JQE0moFczIgm27ATGKpT6/vcBlLfM13o4y2KyvscBeC1gX5gLUohJTPxtoo55ayB3yoSsiT7YdW7OuWhGOnjww==',key_name='tempest-keypair-1098877628',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:11:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0919015c0904a8481a5297b6aa9af40',ramdisk_id='',reservation_id='r-jkg27j2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-483419746',owner_user_name='tempest-VolumesAdminNegativeTest-483419746-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:11:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4522c1762bd4fea8ee7190642b63e06',uuid=3a56aca8-ffbb-450b-a953-fc2071902486,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0bfa2344-df4f-4c3a-9b5d-97b85e4b2515", "address": "fa:16:3e:3a:4a:12", "network": {"id": "b40e2616-f366-491f-a652-c99fc1c6b989", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-538343107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0919015c0904a8481a5297b6aa9af40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfa2344-df", "ovs_interfaceid": "0bfa2344-df4f-4c3a-9b5d-97b85e4b2515", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:17:12 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-bc22afaa-70fb-4723-8887-2a99b5458ca2 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Converting VIF {"id": "0bfa2344-df4f-4c3a-9b5d-97b85e4b2515", "address": "fa:16:3e:3a:4a:12", "network": {"id": "b40e2616-f366-491f-a652-c99fc1c6b989", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-538343107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0919015c0904a8481a5297b6aa9af40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfa2344-df", "ovs_interfaceid": "0bfa2344-df4f-4c3a-9b5d-97b85e4b2515", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:17:12 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-bc22afaa-70fb-4723-8887-2a99b5458ca2 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:4a:12,bridge_name='br-int',has_traffic_filtering=True,id=0bfa2344-df4f-4c3a-9b5d-97b85e4b2515,network=Network(b40e2616-f366-491f-a652-c99fc1c6b989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bfa2344-df') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:17:12 user nova-compute[75745]: DEBUG os_vif [None req-bc22afaa-70fb-4723-8887-2a99b5458ca2 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:4a:12,bridge_name='br-int',has_traffic_filtering=True,id=0bfa2344-df4f-4c3a-9b5d-97b85e4b2515,network=Network(b40e2616-f366-491f-a652-c99fc1c6b989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bfa2344-df') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:17:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0bfa2344-df, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:17:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=03673d24-6ae2-45a8-b430-ccfb392e0599) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:17:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:12 user nova-compute[75745]: INFO os_vif [None req-bc22afaa-70fb-4723-8887-2a99b5458ca2 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:4a:12,bridge_name='br-int',has_traffic_filtering=True,id=0bfa2344-df4f-4c3a-9b5d-97b85e4b2515,network=Network(b40e2616-f366-491f-a652-c99fc1c6b989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bfa2344-df')
Dec 01 17:17:12 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-bc22afaa-70fb-4723-8887-2a99b5458ca2 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Deleting instance files /opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486_del
Dec 01 17:17:12 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-bc22afaa-70fb-4723-8887-2a99b5458ca2 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Deletion of /opt/stack/data/nova/instances/3a56aca8-ffbb-450b-a953-fc2071902486_del complete
Dec 01 17:17:13 user nova-compute[75745]: INFO nova.compute.manager [None req-bc22afaa-70fb-4723-8887-2a99b5458ca2 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Took 0.97 seconds to destroy the instance on the hypervisor.
Dec 01 17:17:13 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-bc22afaa-70fb-4723-8887-2a99b5458ca2 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:17:13 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:17:13 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:17:13 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:17:13 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Took 0.80 seconds to deallocate network for instance.
Dec 01 17:17:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-bc22afaa-70fb-4723-8887-2a99b5458ca2 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:17:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-bc22afaa-70fb-4723-8887-2a99b5458ca2 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:17:14 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-bc22afaa-70fb-4723-8887-2a99b5458ca2 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:17:14 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-bc22afaa-70fb-4723-8887-2a99b5458ca2 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:17:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-bc22afaa-70fb-4723-8887-2a99b5458ca2 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:17:14 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-bc22afaa-70fb-4723-8887-2a99b5458ca2 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Deleted allocations for instance 3a56aca8-ffbb-450b-a953-fc2071902486
Dec 01 17:17:14 user nova-compute[75745]: DEBUG nova.compute.manager [req-bf3cbc71-cce0-406f-9fa6-17f892f89213 req-e4b811a5-9c6d-4d60-8663-cc780cb6dba0 service nova] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Received event network-vif-plugged-0bfa2344-df4f-4c3a-9b5d-97b85e4b2515 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:17:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-bf3cbc71-cce0-406f-9fa6-17f892f89213 req-e4b811a5-9c6d-4d60-8663-cc780cb6dba0 service nova] Acquiring lock "3a56aca8-ffbb-450b-a953-fc2071902486-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:17:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-bf3cbc71-cce0-406f-9fa6-17f892f89213 req-e4b811a5-9c6d-4d60-8663-cc780cb6dba0 service nova] Lock "3a56aca8-ffbb-450b-a953-fc2071902486-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:17:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-bf3cbc71-cce0-406f-9fa6-17f892f89213 req-e4b811a5-9c6d-4d60-8663-cc780cb6dba0 service nova] Lock "3a56aca8-ffbb-450b-a953-fc2071902486-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:17:14 user nova-compute[75745]: DEBUG nova.compute.manager [req-bf3cbc71-cce0-406f-9fa6-17f892f89213 req-e4b811a5-9c6d-4d60-8663-cc780cb6dba0 service nova] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] No waiting events found dispatching network-vif-plugged-0bfa2344-df4f-4c3a-9b5d-97b85e4b2515 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:17:14 user nova-compute[75745]: WARNING nova.compute.manager [req-bf3cbc71-cce0-406f-9fa6-17f892f89213 req-e4b811a5-9c6d-4d60-8663-cc780cb6dba0 service nova] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Received unexpected event network-vif-plugged-0bfa2344-df4f-4c3a-9b5d-97b85e4b2515 for instance with vm_state deleted and task_state None.
Dec 01 17:17:14 user nova-compute[75745]: DEBUG nova.compute.manager [req-bf3cbc71-cce0-406f-9fa6-17f892f89213 req-e4b811a5-9c6d-4d60-8663-cc780cb6dba0 service nova] [instance: 3a56aca8-ffbb-450b-a953-fc2071902486] Received event network-vif-deleted-0bfa2344-df4f-4c3a-9b5d-97b85e4b2515 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:17:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-bc22afaa-70fb-4723-8887-2a99b5458ca2 tempest-VolumesAdminNegativeTest-483419746 tempest-VolumesAdminNegativeTest-483419746-project-member] Lock "3a56aca8-ffbb-450b-a953-fc2071902486" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.384s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:17:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:17:14 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Creating image(s)
Dec 01 17:17:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "/opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:17:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "/opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:17:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "/opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:17:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.173s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:17:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:17:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.169s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk 1073741824" returned: 0 in 0.049s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:17:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.173s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Cannot resize image /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Ensure instance console log exists: /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Start _get_guest_xml network_info=[{"id": "30260fca-fac2-4377-b514-add8784429c4", "address": "fa:16:3e:d6:94:e3", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30260fca-fa", "ovs_interfaceid": "30260fca-fac2-4377-b514-add8784429c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': '82afd64c-1e0c-4f08-9010-1ef846f76e7d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMKyIbSf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9aca117f-581a-4625-abf1-c7faba669572', 'attached_at': '', 'detached_at': '', 'volume_id': 'da9f9e8e-5434-4610-aab3-51748fb3b8fc', 'serial': 'da9f9e8e-5434-4610-aab3-51748fb3b8fc'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:17:15 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Dec 01 17:17:15 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Dec 01 17:17:15 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG nova.objects.instance [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9aca117f-581a-4625-abf1-c7faba669572 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMKyIbSf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:17:15 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 01 17:17:15 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:17:15 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 01 17:17:15 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:17:15 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cfcd28-38db-4ba1-b07b-31029f8dd8a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:17:15 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d485d0-61d7-44fa-9bac-e3b6dbfe3d63]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc] added
Dec 01 17:17:15 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a6eb89-b66a-433d-a29f-12c3602d5330]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dde4b9f-558e-4cf5-8532-f5ef1dc7b2c6]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QMKyIbSf {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QMKyIbSf" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[073b42e3-c2d7-4d36-97fd-fa30f0ac1022]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QMKyIbSf'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab0d0f7-6d76-4171-b53b-0caaa92f5400]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3c9a68-4a3e-4f9c-bd03-2ba214d2f33e]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:17:15 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:17:15 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a37dc6-6878-4e66-9dab-fa0905ea8e98]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc, portal: 172.16.0.220,3260]
Dec 01 17:17:15 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc, portal: 172.16.0.220,3260] successful.
Dec 01 17:17:15 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29e7197-2dd5-4468-8a08-b64ef6785f48]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9768d630-a4ab-41ae-b7b3-b3bd60457de5]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:17:15 user nova-compute[75745]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc (non-flash)
Dec 01 17:17:15 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:17:15 user nova-compute[75745]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc (non-flash)
Dec 01 17:17:15 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35795b0-11ff-468f-856b-04d784bfab57]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:17:15 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: None {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:17:16 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:17:16 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMKyIbSf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:17:16 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:17:16 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23934393335343434', 'path': '/dev/sdc'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:17:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934393335343434', 'path': '/dev/sdc'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:17:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T17:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-860674518',display_name='tempest-ServerActionsTestOtherA-server-1881038620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-860674518',id=26,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0VPvubRo9N9hDbGZ7rvBGfNIC49qGsVU6LVqmy/4M0zGXAuWOJcM6VFMASpfTpY2Uok0EIDnJL42vbGcwlx4yY9AlIDoh46ApbqcvwQjSds+Lyv6QMRAVGuNqnSLgdTA==',key_name='tempest-keypair-723015957',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:15:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='409356993ea442c5abdf4269aebe43ab',ramdisk_id='',reservation_id='r-9f0md9mc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1500186869',owner_user_name='tempest-ServerActionsTestOtherA-1500186869-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:17:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5204ecaa9b354d10bac514c27acbccc6',uuid=9aca117f-581a-4625-abf1-c7faba669572,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30260fca-fac2-4377-b514-add8784429c4", "address": "fa:16:3e:d6:94:e3", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30260fca-fa", "ovs_interfaceid": "30260fca-fac2-4377-b514-add8784429c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:17:16 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Converting VIF {"id": "30260fca-fac2-4377-b514-add8784429c4", "address": "fa:16:3e:d6:94:e3", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30260fca-fa", "ovs_interfaceid": "30260fca-fac2-4377-b514-add8784429c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:17:16 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:94:e3,bridge_name='br-int',has_traffic_filtering=True,id=30260fca-fac2-4377-b514-add8784429c4,network=Network(f7cefc9d-2279-4601-8a81-a640ad1aea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30260fca-fa') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:17:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:17:16 user nova-compute[75745]:   <uuid>9aca117f-581a-4625-abf1-c7faba669572</uuid>
Dec 01 17:17:16 user nova-compute[75745]:   <name>instance-0000001a</name>
Dec 01 17:17:16 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:17:16 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:17:16 user nova-compute[75745]:   <metadata>
Dec 01 17:17:16 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:17:16 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:17:16 user nova-compute[75745]:       <nova:name>tempest-ServerActionsTestOtherA-server-1881038620</nova:name>
Dec 01 17:17:16 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:17:15</nova:creationTime>
Dec 01 17:17:16 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:17:16 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:17:16 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:17:16 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:17:16 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:17:16 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:17:16 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:17:16 user nova-compute[75745]:       <nova:owner>
Dec 01 17:17:16 user nova-compute[75745]:         <nova:user uuid="5204ecaa9b354d10bac514c27acbccc6">tempest-ServerActionsTestOtherA-1500186869-project-member</nova:user>
Dec 01 17:17:16 user nova-compute[75745]:         <nova:project uuid="409356993ea442c5abdf4269aebe43ab">tempest-ServerActionsTestOtherA-1500186869</nova:project>
Dec 01 17:17:16 user nova-compute[75745]:       </nova:owner>
Dec 01 17:17:16 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:17:16 user nova-compute[75745]:       <nova:ports>
Dec 01 17:17:16 user nova-compute[75745]:         <nova:port uuid="30260fca-fac2-4377-b514-add8784429c4">
Dec 01 17:17:16 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 01 17:17:16 user nova-compute[75745]:         </nova:port>
Dec 01 17:17:16 user nova-compute[75745]:       </nova:ports>
Dec 01 17:17:16 user nova-compute[75745]:     </nova:instance>
Dec 01 17:17:16 user nova-compute[75745]:   </metadata>
Dec 01 17:17:16 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:17:16 user nova-compute[75745]:     <system>
Dec 01 17:17:16 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:17:16 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:17:16 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:17:16 user nova-compute[75745]:       <entry name="serial">9aca117f-581a-4625-abf1-c7faba669572</entry>
Dec 01 17:17:16 user nova-compute[75745]:       <entry name="uuid">9aca117f-581a-4625-abf1-c7faba669572</entry>
Dec 01 17:17:16 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:17:16 user nova-compute[75745]:     </system>
Dec 01 17:17:16 user nova-compute[75745]:   </sysinfo>
Dec 01 17:17:16 user nova-compute[75745]:   <os>
Dec 01 17:17:16 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:17:16 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:17:16 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:17:16 user nova-compute[75745]:   </os>
Dec 01 17:17:16 user nova-compute[75745]:   <features>
Dec 01 17:17:16 user nova-compute[75745]:     <acpi/>
Dec 01 17:17:16 user nova-compute[75745]:     <apic/>
Dec 01 17:17:16 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:17:16 user nova-compute[75745]:   </features>
Dec 01 17:17:16 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:17:16 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:17:16 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:17:16 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:17:16 user nova-compute[75745]:   </clock>
Dec 01 17:17:16 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:17:16 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:17:16 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:17:16 user nova-compute[75745]:   </cpu>
Dec 01 17:17:16 user nova-compute[75745]:   <devices>
Dec 01 17:17:16 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:17:16 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:17:16 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk"/>
Dec 01 17:17:16 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:17:16 user nova-compute[75745]:     </disk>
Dec 01 17:17:16 user nova-compute[75745]:     <disk type="block" device="disk">
Dec 01 17:17:16 user nova-compute[75745]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:17:16 user nova-compute[75745]:       <source dev="/dev/sdc"/>
Dec 01 17:17:16 user nova-compute[75745]:       <target dev="vdb" bus="virtio"/>
Dec 01 17:17:16 user nova-compute[75745]:       <serial>da9f9e8e-5434-4610-aab3-51748fb3b8fc</serial>
Dec 01 17:17:16 user nova-compute[75745]:     </disk>
Dec 01 17:17:16 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:17:16 user nova-compute[75745]:       <mac address="fa:16:3e:d6:94:e3"/>
Dec 01 17:17:16 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:17:16 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:17:16 user nova-compute[75745]:       <target dev="tap30260fca-fa"/>
Dec 01 17:17:16 user nova-compute[75745]:     </interface>
Dec 01 17:17:16 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:17:16 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/console.log" append="off"/>
Dec 01 17:17:16 user nova-compute[75745]:     </serial>
Dec 01 17:17:16 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:17:16 user nova-compute[75745]:     <video>
Dec 01 17:17:16 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:17:16 user nova-compute[75745]:     </video>
Dec 01 17:17:16 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:17:16 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:17:16 user nova-compute[75745]:     </rng>
Dec 01 17:17:16 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:17:16 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:17:16 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:17:16 user nova-compute[75745]:     </memballoon>
Dec 01 17:17:16 user nova-compute[75745]:   </devices>
Dec 01 17:17:16 user nova-compute[75745]: </domain>
Dec 01 17:17:16 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:17:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T17:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-860674518',display_name='tempest-ServerActionsTestOtherA-server-1881038620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-860674518',id=26,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0VPvubRo9N9hDbGZ7rvBGfNIC49qGsVU6LVqmy/4M0zGXAuWOJcM6VFMASpfTpY2Uok0EIDnJL42vbGcwlx4yY9AlIDoh46ApbqcvwQjSds+Lyv6QMRAVGuNqnSLgdTA==',key_name='tempest-keypair-723015957',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:15:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='409356993ea442c5abdf4269aebe43ab',ramdisk_id='',reservation_id='r-9f0md9mc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1500186869',owner_user_name='tempest-ServerActionsTestOtherA-1500186869-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:17:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5204ecaa9b354d10bac514c27acbccc6',uuid=9aca117f-581a-4625-abf1-c7faba669572,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30260fca-fac2-4377-b514-add8784429c4", "address": "fa:16:3e:d6:94:e3", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30260fca-fa", "ovs_interfaceid": "30260fca-fac2-4377-b514-add8784429c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:17:16 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Converting VIF {"id": "30260fca-fac2-4377-b514-add8784429c4", "address": "fa:16:3e:d6:94:e3", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30260fca-fa", "ovs_interfaceid": "30260fca-fac2-4377-b514-add8784429c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:17:16 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:94:e3,bridge_name='br-int',has_traffic_filtering=True,id=30260fca-fac2-4377-b514-add8784429c4,network=Network(f7cefc9d-2279-4601-8a81-a640ad1aea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30260fca-fa') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:17:16 user nova-compute[75745]: DEBUG os_vif [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:94:e3,bridge_name='br-int',has_traffic_filtering=True,id=30260fca-fac2-4377-b514-add8784429c4,network=Network(f7cefc9d-2279-4601-8a81-a640ad1aea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30260fca-fa') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:17:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:17:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:17:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '219868d8-f848-5a8d-99dc-688ed426a4fd', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:17:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:17:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30260fca-fa, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:17:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap30260fca-fa, col_values=(('qos', UUID('aeadb41f-72dd-4434-83e1-314ed0f59a67')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:17:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap30260fca-fa, col_values=(('external_ids', {'iface-id': '30260fca-fac2-4377-b514-add8784429c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:94:e3', 'vm-uuid': '9aca117f-581a-4625-abf1-c7faba669572'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:17:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:17:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:16 user nova-compute[75745]: INFO os_vif [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:94:e3,bridge_name='br-int',has_traffic_filtering=True,id=30260fca-fac2-4377-b514-add8784429c4,network=Network(f7cefc9d-2279-4601-8a81-a640ad1aea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30260fca-fa')
Dec 01 17:17:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:17:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:17:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] No VIF found with MAC fa:16:3e:d6:94:e3, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:17:17 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:18 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:18 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:18 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:18 user nova-compute[75745]: DEBUG nova.compute.manager [req-d5068b6a-504a-44b3-ba7d-ca1a69a31296 req-8c9cb3bc-abc0-4734-831a-e659a6029cff service nova] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Received event network-vif-plugged-30260fca-fac2-4377-b514-add8784429c4 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:17:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d5068b6a-504a-44b3-ba7d-ca1a69a31296 req-8c9cb3bc-abc0-4734-831a-e659a6029cff service nova] Acquiring lock "9aca117f-581a-4625-abf1-c7faba669572-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:17:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d5068b6a-504a-44b3-ba7d-ca1a69a31296 req-8c9cb3bc-abc0-4734-831a-e659a6029cff service nova] Lock "9aca117f-581a-4625-abf1-c7faba669572-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:17:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d5068b6a-504a-44b3-ba7d-ca1a69a31296 req-8c9cb3bc-abc0-4734-831a-e659a6029cff service nova] Lock "9aca117f-581a-4625-abf1-c7faba669572-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:17:18 user nova-compute[75745]: DEBUG nova.compute.manager [req-d5068b6a-504a-44b3-ba7d-ca1a69a31296 req-8c9cb3bc-abc0-4734-831a-e659a6029cff service nova] [instance: 9aca117f-581a-4625-abf1-c7faba669572] No waiting events found dispatching network-vif-plugged-30260fca-fac2-4377-b514-add8784429c4 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:17:18 user nova-compute[75745]: WARNING nova.compute.manager [req-d5068b6a-504a-44b3-ba7d-ca1a69a31296 req-8c9cb3bc-abc0-4734-831a-e659a6029cff service nova] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Received unexpected event network-vif-plugged-30260fca-fac2-4377-b514-add8784429c4 for instance with vm_state active and task_state rebuild_spawning.
Dec 01 17:17:18 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:20 user nova-compute[75745]: DEBUG nova.compute.manager [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:17:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:17:20 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Instance spawned successfully.
Dec 01 17:17:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:17:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:17:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:17:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:17:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:17:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:17:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:17:20 user nova-compute[75745]: DEBUG nova.compute.manager [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:17:20 user nova-compute[75745]: DEBUG nova.compute.manager [req-6c1e68ed-692d-44c7-8cf0-ccc99cfb32b6 req-7b72e7bb-44b8-4c55-9279-5c81ba23846c service nova] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Received event network-vif-plugged-30260fca-fac2-4377-b514-add8784429c4 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:17:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6c1e68ed-692d-44c7-8cf0-ccc99cfb32b6 req-7b72e7bb-44b8-4c55-9279-5c81ba23846c service nova] Acquiring lock "9aca117f-581a-4625-abf1-c7faba669572-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:17:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6c1e68ed-692d-44c7-8cf0-ccc99cfb32b6 req-7b72e7bb-44b8-4c55-9279-5c81ba23846c service nova] Lock "9aca117f-581a-4625-abf1-c7faba669572-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:17:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6c1e68ed-692d-44c7-8cf0-ccc99cfb32b6 req-7b72e7bb-44b8-4c55-9279-5c81ba23846c service nova] Lock "9aca117f-581a-4625-abf1-c7faba669572-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:17:20 user nova-compute[75745]: DEBUG nova.compute.manager [req-6c1e68ed-692d-44c7-8cf0-ccc99cfb32b6 req-7b72e7bb-44b8-4c55-9279-5c81ba23846c service nova] [instance: 9aca117f-581a-4625-abf1-c7faba669572] No waiting events found dispatching network-vif-plugged-30260fca-fac2-4377-b514-add8784429c4 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:17:20 user nova-compute[75745]: WARNING nova.compute.manager [req-6c1e68ed-692d-44c7-8cf0-ccc99cfb32b6 req-7b72e7bb-44b8-4c55-9279-5c81ba23846c service nova] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Received unexpected event network-vif-plugged-30260fca-fac2-4377-b514-add8784429c4 for instance with vm_state active and task_state rebuild_spawning.
Dec 01 17:17:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:17:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:17:20 user nova-compute[75745]: DEBUG nova.objects.instance [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75745) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Dec 01 17:17:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-565818e6-7fe7-494e-b244-109baa955bbf tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.071s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:17:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:17:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:17:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:17:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:17:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:41 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:43 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:17:43 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:17:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:44 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:17:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:46 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:17:48 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:17:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:49 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:17:49 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:17:49 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:17:49 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:17:49 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:17:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:17:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:17:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:17:49 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:17:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0959ad6-3d88-47d7-bf74-58fcb727fb3e/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0959ad6-3d88-47d7-bf74-58fcb727fb3e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0959ad6-3d88-47d7-bf74-58fcb727fb3e/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0959ad6-3d88-47d7-bf74-58fcb727fb3e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce212884-ddef-4db5-8b22-9f2e1502fadd/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce212884-ddef-4db5-8b22-9f2e1502fadd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce212884-ddef-4db5-8b22-9f2e1502fadd/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce212884-ddef-4db5-8b22-9f2e1502fadd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:17:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63cffe58-0056-4b06-86d9-bee746c2f832/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63cffe58-0056-4b06-86d9-bee746c2f832/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63cffe58-0056-4b06-86d9-bee746c2f832/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63cffe58-0056-4b06-86d9-bee746c2f832/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:17:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:17:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:17:54 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:17:54 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:17:54 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=7426MB free_disk=25.321109771728516GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:17:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:17:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:17:54 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance d997cdd6-67c6-4263-814a-17cf9e27bbeb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:17:54 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 0ab0c115-74aa-4e55-92a3-6fa91ba753e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:17:54 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 98b29ba5-9993-4494-b196-f7eea077df7a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:17:54 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance e4ffb96e-456c-4fb9-9850-9e98310d63e5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:17:54 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 80962f79-dbb2-4380-b2c8-791642cfa86b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:17:54 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance a690fa65-078d-4ffd-bc62-3366aaa3d681 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:17:54 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 9aca117f-581a-4625-abf1-c7faba669572 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:17:54 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance ce212884-ddef-4db5-8b22-9f2e1502fadd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:17:54 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance e0959ad6-3d88-47d7-bf74-58fcb727fb3e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:17:54 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 63cffe58-0056-4b06-86d9-bee746c2f832 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:17:54 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:17:54 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:17:54 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Refreshing inventories for resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 01 17:17:54 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Updating ProviderTree inventory for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 01 17:17:54 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Updating inventory in ProviderTree for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 01 17:17:54 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Refreshing aggregate associations for resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9, aggregates: None {{(pid=75745) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 01 17:17:55 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Refreshing trait associations for resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9, traits: COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=75745) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 01 17:17:55 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:17:55 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:17:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:17:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.725s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:17:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:17:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:17:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:17:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:17:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6a7bc54f-091d-49aa-a5c7-bed2dda84e96 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Acquiring lock "ce212884-ddef-4db5-8b22-9f2e1502fadd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:17:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6a7bc54f-091d-49aa-a5c7-bed2dda84e96 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Lock "ce212884-ddef-4db5-8b22-9f2e1502fadd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:17:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6a7bc54f-091d-49aa-a5c7-bed2dda84e96 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Acquiring lock "ce212884-ddef-4db5-8b22-9f2e1502fadd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:17:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6a7bc54f-091d-49aa-a5c7-bed2dda84e96 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Lock "ce212884-ddef-4db5-8b22-9f2e1502fadd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:17:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6a7bc54f-091d-49aa-a5c7-bed2dda84e96 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Lock "ce212884-ddef-4db5-8b22-9f2e1502fadd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:17:58 user nova-compute[75745]: INFO nova.compute.manager [None req-6a7bc54f-091d-49aa-a5c7-bed2dda84e96 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Terminating instance
Dec 01 17:17:58 user nova-compute[75745]: DEBUG nova.compute.manager [None req-6a7bc54f-091d-49aa-a5c7-bed2dda84e96 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:17:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-bb93feb3-7635-40c5-bd1b-07765898b748 req-d3a33e5c-2bd1-4e38-9e37-f4f7a2fccacb service nova] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Received event network-vif-unplugged-d242e0a1-01b7-44b9-8c6a-446c1c6e8876 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:17:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-bb93feb3-7635-40c5-bd1b-07765898b748 req-d3a33e5c-2bd1-4e38-9e37-f4f7a2fccacb service nova] Acquiring lock "ce212884-ddef-4db5-8b22-9f2e1502fadd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:17:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-bb93feb3-7635-40c5-bd1b-07765898b748 req-d3a33e5c-2bd1-4e38-9e37-f4f7a2fccacb service nova] Lock "ce212884-ddef-4db5-8b22-9f2e1502fadd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:17:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-bb93feb3-7635-40c5-bd1b-07765898b748 req-d3a33e5c-2bd1-4e38-9e37-f4f7a2fccacb service nova] Lock "ce212884-ddef-4db5-8b22-9f2e1502fadd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:17:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-bb93feb3-7635-40c5-bd1b-07765898b748 req-d3a33e5c-2bd1-4e38-9e37-f4f7a2fccacb service nova] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] No waiting events found dispatching network-vif-unplugged-d242e0a1-01b7-44b9-8c6a-446c1c6e8876 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:17:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-bb93feb3-7635-40c5-bd1b-07765898b748 req-d3a33e5c-2bd1-4e38-9e37-f4f7a2fccacb service nova] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Received event network-vif-unplugged-d242e0a1-01b7-44b9-8c6a-446c1c6e8876 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:17:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:59 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Instance destroyed successfully.
Dec 01 17:17:59 user nova-compute[75745]: DEBUG nova.objects.instance [None req-6a7bc54f-091d-49aa-a5c7-bed2dda84e96 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Lazy-loading 'resources' on Instance uuid ce212884-ddef-4db5-8b22-9f2e1502fadd {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:17:59 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:17:59 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:17:59 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Rebuilding the list of instances to heal {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 17:17:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-6a7bc54f-091d-49aa-a5c7-bed2dda84e96 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-466238503',display_name='tempest-ServersNegativeTestJSON-server-466238503',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-466238503',id=27,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:16:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d0d8924495d400d978d7107a78b3167',ramdisk_id='',reservation_id='r-u7mqmks8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-67621407',owner_user_name='tempest-ServersNegativeTestJSON-67621407-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:16:15Z,user_data=None,user_id='8b524e70f3794e81a2111cd12cab9abc',uuid=ce212884-ddef-4db5-8b22-9f2e1502fadd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d242e0a1-01b7-44b9-8c6a-446c1c6e8876", "address": "fa:16:3e:d0:7e:f8", "network": {"id": "3b2feb84-7495-4ea1-8eb4-6fcb4763a75a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1599091175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0d8924495d400d978d7107a78b3167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd242e0a1-01", "ovs_interfaceid": "d242e0a1-01b7-44b9-8c6a-446c1c6e8876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:17:59 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-6a7bc54f-091d-49aa-a5c7-bed2dda84e96 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Converting VIF {"id": "d242e0a1-01b7-44b9-8c6a-446c1c6e8876", "address": "fa:16:3e:d0:7e:f8", "network": {"id": "3b2feb84-7495-4ea1-8eb4-6fcb4763a75a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1599091175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0d8924495d400d978d7107a78b3167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd242e0a1-01", "ovs_interfaceid": "d242e0a1-01b7-44b9-8c6a-446c1c6e8876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:17:59 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-6a7bc54f-091d-49aa-a5c7-bed2dda84e96 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:7e:f8,bridge_name='br-int',has_traffic_filtering=True,id=d242e0a1-01b7-44b9-8c6a-446c1c6e8876,network=Network(3b2feb84-7495-4ea1-8eb4-6fcb4763a75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd242e0a1-01') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:17:59 user nova-compute[75745]: DEBUG os_vif [None req-6a7bc54f-091d-49aa-a5c7-bed2dda84e96 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:7e:f8,bridge_name='br-int',has_traffic_filtering=True,id=d242e0a1-01b7-44b9-8c6a-446c1c6e8876,network=Network(3b2feb84-7495-4ea1-8eb4-6fcb4763a75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd242e0a1-01') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:17:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd242e0a1-01, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:17:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:17:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0f39bdcb-1a91-4f6d-af8d-ea39908eac0d) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:17:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:17:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:17:59 user nova-compute[75745]: INFO os_vif [None req-6a7bc54f-091d-49aa-a5c7-bed2dda84e96 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:7e:f8,bridge_name='br-int',has_traffic_filtering=True,id=d242e0a1-01b7-44b9-8c6a-446c1c6e8876,network=Network(3b2feb84-7495-4ea1-8eb4-6fcb4763a75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd242e0a1-01')
Dec 01 17:17:59 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-6a7bc54f-091d-49aa-a5c7-bed2dda84e96 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Deleting instance files /opt/stack/data/nova/instances/ce212884-ddef-4db5-8b22-9f2e1502fadd_del
Dec 01 17:17:59 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-6a7bc54f-091d-49aa-a5c7-bed2dda84e96 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Deletion of /opt/stack/data/nova/instances/ce212884-ddef-4db5-8b22-9f2e1502fadd_del complete
Dec 01 17:17:59 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Skipping network cache update for instance because it is being deleted. {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Dec 01 17:17:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-98b29ba5-9993-4494-b196-f7eea077df7a" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:17:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-98b29ba5-9993-4494-b196-f7eea077df7a" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:17:59 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:17:59 user nova-compute[75745]: DEBUG nova.objects.instance [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lazy-loading 'info_cache' on Instance uuid 98b29ba5-9993-4494-b196-f7eea077df7a {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:17:59 user nova-compute[75745]: INFO nova.compute.manager [None req-6a7bc54f-091d-49aa-a5c7-bed2dda84e96 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Took 0.89 seconds to destroy the instance on the hypervisor.
Dec 01 17:17:59 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-6a7bc54f-091d-49aa-a5c7-bed2dda84e96 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:17:59 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:17:59 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:17:59 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Updating instance_info_cache with network_info: [{"id": "9c3aade6-4181-435d-aabd-07988112a373", "address": "fa:16:3e:60:67:90", "network": {"id": "9083e0bd-c071-4794-bf87-74bc7ba3898b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-947489426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4f3ec75737429e8834e7d3576ffa69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3aade6-41", "ovs_interfaceid": "9c3aade6-4181-435d-aabd-07988112a373", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:17:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-98b29ba5-9993-4494-b196-f7eea077df7a" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:17:59 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:18:00 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:18:00 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Took 0.68 seconds to deallocate network for instance.
Dec 01 17:18:00 user nova-compute[75745]: DEBUG nova.compute.manager [req-7e06b0af-7bf6-4473-b254-b13b1814ddab req-180ad6dc-75bb-472a-8a27-60a709a17fa2 service nova] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Received event network-vif-deleted-d242e0a1-01b7-44b9-8c6a-446c1c6e8876 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:18:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6a7bc54f-091d-49aa-a5c7-bed2dda84e96 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:18:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6a7bc54f-091d-49aa-a5c7-bed2dda84e96 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:18:00 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-6a7bc54f-091d-49aa-a5c7-bed2dda84e96 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:18:00 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-6a7bc54f-091d-49aa-a5c7-bed2dda84e96 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:18:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6a7bc54f-091d-49aa-a5c7-bed2dda84e96 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:18:00 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-6a7bc54f-091d-49aa-a5c7-bed2dda84e96 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Deleted allocations for instance ce212884-ddef-4db5-8b22-9f2e1502fadd
Dec 01 17:18:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6a7bc54f-091d-49aa-a5c7-bed2dda84e96 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Lock "ce212884-ddef-4db5-8b22-9f2e1502fadd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.207s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:18:00 user nova-compute[75745]: DEBUG nova.compute.manager [req-8e3dab84-b016-43e5-9a2f-b21b0c38a952 req-3cfceef5-09f4-44f5-8cfd-53264c757780 service nova] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Received event network-vif-plugged-d242e0a1-01b7-44b9-8c6a-446c1c6e8876 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:18:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8e3dab84-b016-43e5-9a2f-b21b0c38a952 req-3cfceef5-09f4-44f5-8cfd-53264c757780 service nova] Acquiring lock "ce212884-ddef-4db5-8b22-9f2e1502fadd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:18:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8e3dab84-b016-43e5-9a2f-b21b0c38a952 req-3cfceef5-09f4-44f5-8cfd-53264c757780 service nova] Lock "ce212884-ddef-4db5-8b22-9f2e1502fadd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:18:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8e3dab84-b016-43e5-9a2f-b21b0c38a952 req-3cfceef5-09f4-44f5-8cfd-53264c757780 service nova] Lock "ce212884-ddef-4db5-8b22-9f2e1502fadd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:18:00 user nova-compute[75745]: DEBUG nova.compute.manager [req-8e3dab84-b016-43e5-9a2f-b21b0c38a952 req-3cfceef5-09f4-44f5-8cfd-53264c757780 service nova] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] No waiting events found dispatching network-vif-plugged-d242e0a1-01b7-44b9-8c6a-446c1c6e8876 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:18:00 user nova-compute[75745]: WARNING nova.compute.manager [req-8e3dab84-b016-43e5-9a2f-b21b0c38a952 req-3cfceef5-09f4-44f5-8cfd-53264c757780 service nova] [instance: ce212884-ddef-4db5-8b22-9f2e1502fadd] Received unexpected event network-vif-plugged-d242e0a1-01b7-44b9-8c6a-446c1c6e8876 for instance with vm_state deleted and task_state None.
Dec 01 17:18:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:10 user nova-compute[75745]: DEBUG nova.compute.manager [req-5f02f6fe-f828-4d84-8425-3cf03daba847 req-c2e8a2b7-69c5-428b-9c3a-4c83047e7293 service nova] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Received event network-changed-1af2d3d8-d2bb-4203-a6e2-f179af1228be {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:18:10 user nova-compute[75745]: DEBUG nova.compute.manager [req-5f02f6fe-f828-4d84-8425-3cf03daba847 req-c2e8a2b7-69c5-428b-9c3a-4c83047e7293 service nova] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Refreshing instance network info cache due to event network-changed-1af2d3d8-d2bb-4203-a6e2-f179af1228be. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:18:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5f02f6fe-f828-4d84-8425-3cf03daba847 req-c2e8a2b7-69c5-428b-9c3a-4c83047e7293 service nova] Acquiring lock "refresh_cache-e0959ad6-3d88-47d7-bf74-58fcb727fb3e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:18:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5f02f6fe-f828-4d84-8425-3cf03daba847 req-c2e8a2b7-69c5-428b-9c3a-4c83047e7293 service nova] Acquired lock "refresh_cache-e0959ad6-3d88-47d7-bf74-58fcb727fb3e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:18:10 user nova-compute[75745]: DEBUG nova.network.neutron [req-5f02f6fe-f828-4d84-8425-3cf03daba847 req-c2e8a2b7-69c5-428b-9c3a-4c83047e7293 service nova] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Refreshing network info cache for port 1af2d3d8-d2bb-4203-a6e2-f179af1228be {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:18:10 user nova-compute[75745]: DEBUG nova.network.neutron [req-5f02f6fe-f828-4d84-8425-3cf03daba847 req-c2e8a2b7-69c5-428b-9c3a-4c83047e7293 service nova] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Updated VIF entry in instance network info cache for port 1af2d3d8-d2bb-4203-a6e2-f179af1228be. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:18:10 user nova-compute[75745]: DEBUG nova.network.neutron [req-5f02f6fe-f828-4d84-8425-3cf03daba847 req-c2e8a2b7-69c5-428b-9c3a-4c83047e7293 service nova] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Updating instance_info_cache with network_info: [{"id": "1af2d3d8-d2bb-4203-a6e2-f179af1228be", "address": "fa:16:3e:26:bd:7c", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1af2d3d8-d2", "ovs_interfaceid": "1af2d3d8-d2bb-4203-a6e2-f179af1228be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:18:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5f02f6fe-f828-4d84-8425-3cf03daba847 req-c2e8a2b7-69c5-428b-9c3a-4c83047e7293 service nova] Releasing lock "refresh_cache-e0959ad6-3d88-47d7-bf74-58fcb727fb3e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-353fdc04-4ade-495d-9919-b332450dbb63 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "e0959ad6-3d88-47d7-bf74-58fcb727fb3e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-353fdc04-4ade-495d-9919-b332450dbb63 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "e0959ad6-3d88-47d7-bf74-58fcb727fb3e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG nova.objects.instance [None req-353fdc04-4ade-495d-9919-b332450dbb63 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lazy-loading 'flavor' on Instance uuid e0959ad6-3d88-47d7-bf74-58fcb727fb3e {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-353fdc04-4ade-495d-9919-b332450dbb63 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "e0959ad6-3d88-47d7-bf74-58fcb727fb3e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Acquiring lock "98b29ba5-9993-4494-b196-f7eea077df7a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "98b29ba5-9993-4494-b196-f7eea077df7a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Acquiring lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:18:13 user nova-compute[75745]: INFO nova.compute.manager [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Terminating instance
Dec 01 17:18:13 user nova-compute[75745]: DEBUG nova.compute.manager [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-353fdc04-4ade-495d-9919-b332450dbb63 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "e0959ad6-3d88-47d7-bf74-58fcb727fb3e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-353fdc04-4ade-495d-9919-b332450dbb63 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "e0959ad6-3d88-47d7-bf74-58fcb727fb3e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:18:13 user nova-compute[75745]: INFO nova.compute.manager [None req-353fdc04-4ade-495d-9919-b332450dbb63 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Attaching volume 99d4b5e4-8502-46cc-93e0-fc6a211eb023 to /dev/vdb
Dec 01 17:18:13 user nova-compute[75745]: DEBUG os_brick.utils [None req-353fdc04-4ade-495d-9919-b332450dbb63 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86edd7c-c55a-4488-8477-b8cd31c3d109]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a6bc28-eec3-4a6b-bace-10c98380c8a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d158cd-fea2-4e13-9326-85526d818193]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[778da12b-fb51-4748-b191-96091690865b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-353fdc04-4ade-495d-9919-b332450dbb63 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-353fdc04-4ade-495d-9919-b332450dbb63 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-353fdc04-4ade-495d-9919-b332450dbb63 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:18:13 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:18:13 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aef1bbe-8a2d-4f59-bfef-760fcc363b14]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-353fdc04-4ade-495d-9919-b332450dbb63 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-353fdc04-4ade-495d-9919-b332450dbb63 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-353fdc04-4ade-495d-9919-b332450dbb63 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG os_brick.utils [None req-353fdc04-4ade-495d-9919-b332450dbb63 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-353fdc04-4ade-495d-9919-b332450dbb63 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Updating existing volume attachment record: e8918f34-c749-447a-8259-508b9f7daf21 {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG nova.compute.manager [req-e39c6b83-ca4e-4422-a3cd-6d3322829f24 req-a5048f30-6b01-4e33-8cb5-77fec0705a4a service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Received event network-vif-unplugged-9c3aade6-4181-435d-aabd-07988112a373 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e39c6b83-ca4e-4422-a3cd-6d3322829f24 req-a5048f30-6b01-4e33-8cb5-77fec0705a4a service nova] Acquiring lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e39c6b83-ca4e-4422-a3cd-6d3322829f24 req-a5048f30-6b01-4e33-8cb5-77fec0705a4a service nova] Lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e39c6b83-ca4e-4422-a3cd-6d3322829f24 req-a5048f30-6b01-4e33-8cb5-77fec0705a4a service nova] Lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG nova.compute.manager [req-e39c6b83-ca4e-4422-a3cd-6d3322829f24 req-a5048f30-6b01-4e33-8cb5-77fec0705a4a service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] No waiting events found dispatching network-vif-unplugged-9c3aade6-4181-435d-aabd-07988112a373 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:18:13 user nova-compute[75745]: DEBUG nova.compute.manager [req-e39c6b83-ca4e-4422-a3cd-6d3322829f24 req-a5048f30-6b01-4e33-8cb5-77fec0705a4a service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Received event network-vif-unplugged-9c3aade6-4181-435d-aabd-07988112a373 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:18:14 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Instance destroyed successfully.
Dec 01 17:18:14 user nova-compute[75745]: DEBUG nova.objects.instance [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lazy-loading 'resources' on Instance uuid 98b29ba5-9993-4494-b196-f7eea077df7a {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-321906429',display_name='tempest-ServerActionsTestOtherB-server-321906429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-321906429',id=14,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6Xv1Rwscmn/urtTSZP43LfdG03kX+bxRxOhmhIXfcYy1rBNpzO0Q01awhPBxn/6X5VK/oxuGhv1u1yXJ9Fp7a3tqYVzRZF/9QTyYTjIDpNO30GMbJX0Ytk2j/sLZKHuw==',key_name='tempest-keypair-56607333',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:15:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e4f3ec75737429e8834e7d3576ffa69',ramdisk_id='',reservation_id='r-64j6n0b5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-978518734',owner_user_name='tempest-ServerActionsTestOtherB-978518734-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:15:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad1d09d017314c67b4616642f1108f21',uuid=98b29ba5-9993-4494-b196-f7eea077df7a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c3aade6-4181-435d-aabd-07988112a373", "address": "fa:16:3e:60:67:90", "network": {"id": "9083e0bd-c071-4794-bf87-74bc7ba3898b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-947489426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4f3ec75737429e8834e7d3576ffa69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3aade6-41", "ovs_interfaceid": "9c3aade6-4181-435d-aabd-07988112a373", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Converting VIF {"id": "9c3aade6-4181-435d-aabd-07988112a373", "address": "fa:16:3e:60:67:90", "network": {"id": "9083e0bd-c071-4794-bf87-74bc7ba3898b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-947489426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e4f3ec75737429e8834e7d3576ffa69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3aade6-41", "ovs_interfaceid": "9c3aade6-4181-435d-aabd-07988112a373", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:67:90,bridge_name='br-int',has_traffic_filtering=True,id=9c3aade6-4181-435d-aabd-07988112a373,network=Network(9083e0bd-c071-4794-bf87-74bc7ba3898b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c3aade6-41') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG os_vif [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:67:90,bridge_name='br-int',has_traffic_filtering=True,id=9c3aade6-4181-435d-aabd-07988112a373,network=Network(9083e0bd-c071-4794-bf87-74bc7ba3898b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c3aade6-41') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c3aade6-41, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6b6f15aa-a379-4435-a5d0-a67bf9518a04) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:18:14 user nova-compute[75745]: INFO os_vif [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:67:90,bridge_name='br-int',has_traffic_filtering=True,id=9c3aade6-4181-435d-aabd-07988112a373,network=Network(9083e0bd-c071-4794-bf87-74bc7ba3898b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c3aade6-41')
Dec 01 17:18:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxLBeEqG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:18:14 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:18:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a1e863-5635-460e-a251-3dcadb512446]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:18:14 user nova-compute[75745]: No targets found.
Dec 01 17:18:14 user nova-compute[75745]: iSNS:
Dec 01 17:18:14 user nova-compute[75745]: No targets found.
Dec 01 17:18:14 user nova-compute[75745]: STATIC:
Dec 01 17:18:14 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0
Dec 01 17:18:14 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:18:14 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:18:14 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc
Dec 01 17:18:14 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:18:14 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:18:14 user nova-compute[75745]: FIRMWARE:
Dec 01 17:18:14 user nova-compute[75745]: No targets found.
Dec 01 17:18:14 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:18:14 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:18:14 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f9dc93-32f5-46bf-bb96-27693806cdce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ed2bb8-242c-4bbd-b19e-f4414209e75e]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:18:14 user nova-compute[75745]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc (non-flash)
Dec 01 17:18:14 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 (non-flash)
Dec 01 17:18:14 user nova-compute[75745]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc (non-flash)
Dec 01 17:18:14 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f249850c4c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0'): ({'sdb'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Removing single pathed devices sdb {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[854b185f-e0a7-4c62-8768-59f280ebe5d2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87e049c-d740-4346-a0b9-e223b3e936b1]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Flushing IO for device /dev/sdb {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7ebf8a-5520-4284-90f3-f96951f21108]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.063s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21148a3-fb50-46d8-8a8c-a3027ddae217]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] SCSI volumes sdb have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d549f43-29e3-4943-8c96-e8e87c229e7b]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbdffc2-c289-4fce-96ef-6c180f5989d1]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0, portal: 172.16.0.220,3260]
Dec 01 17:18:14 user nova-compute[75745]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0, portal: 172.16.0.220,3260] successful.
Dec 01 17:18:14 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e941299-9596-4969-a82d-e543f40668c0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e39c3e-6413-4fb5-9f0e-79bd0fa6b4d1]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] <== disconnect_volume: return (334ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:18:14 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Deleting instance files /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a_del
Dec 01 17:18:14 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Deletion of /opt/stack/data/nova/instances/98b29ba5-9993-4494-b196-f7eea077df7a_del complete
Dec 01 17:18:14 user nova-compute[75745]: INFO nova.compute.manager [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Took 1.26 seconds to destroy the instance on the hypervisor.
Dec 01 17:18:14 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:18:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:15 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:18:15 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Took 1.00 seconds to deallocate network for instance.
Dec 01 17:18:15 user nova-compute[75745]: DEBUG nova.compute.manager [req-15fdc4c2-33a0-4403-8b7e-e12ea3d9a36f req-928152a5-25e5-4acd-ba64-ebd7953c3aca service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Received event network-vif-deleted-9c3aade6-4181-435d-aabd-07988112a373 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:18:15 user nova-compute[75745]: DEBUG nova.compute.manager [req-403492fe-0c99-4034-911b-a59efa1cf1ff req-9ff69bc6-2812-48db-a3b9-46118fdd7c03 service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Received event network-vif-plugged-9c3aade6-4181-435d-aabd-07988112a373 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:18:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-403492fe-0c99-4034-911b-a59efa1cf1ff req-9ff69bc6-2812-48db-a3b9-46118fdd7c03 service nova] Acquiring lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:18:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-403492fe-0c99-4034-911b-a59efa1cf1ff req-9ff69bc6-2812-48db-a3b9-46118fdd7c03 service nova] Lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:18:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-403492fe-0c99-4034-911b-a59efa1cf1ff req-9ff69bc6-2812-48db-a3b9-46118fdd7c03 service nova] Lock "98b29ba5-9993-4494-b196-f7eea077df7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:18:15 user nova-compute[75745]: DEBUG nova.compute.manager [req-403492fe-0c99-4034-911b-a59efa1cf1ff req-9ff69bc6-2812-48db-a3b9-46118fdd7c03 service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] No waiting events found dispatching network-vif-plugged-9c3aade6-4181-435d-aabd-07988112a373 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:18:15 user nova-compute[75745]: WARNING nova.compute.manager [req-403492fe-0c99-4034-911b-a59efa1cf1ff req-9ff69bc6-2812-48db-a3b9-46118fdd7c03 service nova] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Received unexpected event network-vif-plugged-9c3aade6-4181-435d-aabd-07988112a373 for instance with vm_state active and task_state deleting.
Dec 01 17:18:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.volume.cinder [None req-353fdc04-4ade-495d-9919-b332450dbb63 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Update attachment failed for attachment e8918f34-c749-447a-8259-508b9f7daf21. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-22a5f1c4-1afb-410c-83d0-c87dab49db12) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-22a5f1c4-1afb-410c-83d0-c87dab49db12)
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [None req-353fdc04-4ade-495d-9919-b332450dbb63 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Failed to attach 99d4b5e4-8502-46cc-93e0-fc6a211eb023 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-22a5f1c4-1afb-410c-83d0-c87dab49db12)
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Traceback (most recent call last):
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e]     bdm.attach(context, instance, self.volume_api, self.driver,
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e]     ret_val = method(obj, context, *args, **kwargs)
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e]     self._do_attach(context, instance, volume, volume_api,
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e]     self._volume_attach(context, volume, connector, instance,
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e]     connection_info = volume_api.attachment_update(
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e]     res = method(self, ctx, *args, **kwargs)
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e]     res = method(self, ctx, attachment_id, *args, **kwargs)
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e]     with excutils.save_and_reraise_exception():
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e]     self.force_reraise()
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e]     raise self.value
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e]     context, '3.44', skip_version_check=True).attachments.update(
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e]     return method.func(obj, *args, **kwargs)
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e]     resp = self._update('/attachments/%s' % id, body)
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e]     resp, body = self.api.client.put(url, body=body, **kwargs)
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e]     return self._cs_request(url, 'PUT', **kwargs)
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e]     return self.request(url, method, **kwargs)
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e]     raise exceptions.from_response(resp, body)
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-22a5f1c4-1afb-410c-83d0-c87dab49db12)
Dec 01 17:18:16 user nova-compute[75745]: ERROR nova.compute.manager [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] 
Dec 01 17:18:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-353fdc04-4ade-495d-9919-b332450dbb63 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "e0959ad6-3d88-47d7-bf74-58fcb727fb3e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 2.844s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server [None req-353fdc04-4ade-495d-9919-b332450dbb63 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-22a5f1c4-1afb-410c-83d0-c87dab49db12)
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-22a5f1c4-1afb-410c-83d0-c87dab49db12)
Dec 01 17:18:16 user nova-compute[75745]: ERROR oslo_messaging.rpc.server 
Dec 01 17:18:16 user nova-compute[75745]: INFO nova.compute.manager [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] [instance: 98b29ba5-9993-4494-b196-f7eea077df7a] Took 0.86 seconds to detach 1 volumes for instance.
Dec 01 17:18:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:18:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:18:16 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:18:16 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:18:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:18:17 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Deleted allocations for instance 98b29ba5-9993-4494-b196-f7eea077df7a
Dec 01 17:18:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-97e2321f-6e10-452c-927f-637f02a88120 tempest-ServerActionsTestOtherB-978518734 tempest-ServerActionsTestOtherB-978518734-project-member] Lock "98b29ba5-9993-4494-b196-f7eea077df7a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.693s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:18:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "5e631ac3-8122-46a3-a54f-2395c0f7cf7c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:18:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "5e631ac3-8122-46a3-a54f-2395c0f7cf7c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:18:17 user nova-compute[75745]: DEBUG nova.compute.manager [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:18:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:18:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:18:17 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:18:17 user nova-compute[75745]: INFO nova.compute.claims [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Claim successful on node user
Dec 01 17:18:17 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:18:17 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:18:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.410s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:18:18 user nova-compute[75745]: DEBUG nova.compute.manager [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:18:18 user nova-compute[75745]: DEBUG nova.compute.manager [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:18:18 user nova-compute[75745]: DEBUG nova.network.neutron [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:18:18 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:18:18 user nova-compute[75745]: DEBUG nova.compute.manager [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:18:18 user nova-compute[75745]: DEBUG nova.policy [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b319a47b86c04affa1858e1c2359876b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb3ba16695543cab6f10932fd6b2d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:18:18 user nova-compute[75745]: DEBUG nova.compute.manager [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:18:18 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:18:18 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Creating image(s)
Dec 01 17:18:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:18:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "/opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:18:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "/opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:18:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.176s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:18:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:18:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.181s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk 1073741824" returned: 0 in 0.061s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:18:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:18 user nova-compute[75745]: DEBUG nova.network.neutron [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Successfully created port: 7239781d-a3ed-42f7-a30b-d8e5410bc622 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:18:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.188s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:18 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:18:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Cannot resize image /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Ensure instance console log exists: /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.network.neutron [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Successfully updated port: 7239781d-a3ed-42f7-a30b-d8e5410bc622 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "refresh_cache-5e631ac3-8122-46a3-a54f-2395c0f7cf7c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquired lock "refresh_cache-5e631ac3-8122-46a3-a54f-2395c0f7cf7c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.network.neutron [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.compute.manager [req-832a6403-da5c-4713-a8a2-ec89b4015d14 req-fd600a86-eb82-40bc-adf0-2958916d77cd service nova] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Received event network-changed-7239781d-a3ed-42f7-a30b-d8e5410bc622 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.compute.manager [req-832a6403-da5c-4713-a8a2-ec89b4015d14 req-fd600a86-eb82-40bc-adf0-2958916d77cd service nova] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Refreshing instance network info cache due to event network-changed-7239781d-a3ed-42f7-a30b-d8e5410bc622. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-832a6403-da5c-4713-a8a2-ec89b4015d14 req-fd600a86-eb82-40bc-adf0-2958916d77cd service nova] Acquiring lock "refresh_cache-5e631ac3-8122-46a3-a54f-2395c0f7cf7c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.network.neutron [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.network.neutron [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Updating instance_info_cache with network_info: [{"id": "7239781d-a3ed-42f7-a30b-d8e5410bc622", "address": "fa:16:3e:0a:8d:a9", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7239781d-a3", "ovs_interfaceid": "7239781d-a3ed-42f7-a30b-d8e5410bc622", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Releasing lock "refresh_cache-5e631ac3-8122-46a3-a54f-2395c0f7cf7c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.compute.manager [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Instance network_info: |[{"id": "7239781d-a3ed-42f7-a30b-d8e5410bc622", "address": "fa:16:3e:0a:8d:a9", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7239781d-a3", "ovs_interfaceid": "7239781d-a3ed-42f7-a30b-d8e5410bc622", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-832a6403-da5c-4713-a8a2-ec89b4015d14 req-fd600a86-eb82-40bc-adf0-2958916d77cd service nova] Acquired lock "refresh_cache-5e631ac3-8122-46a3-a54f-2395c0f7cf7c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.network.neutron [req-832a6403-da5c-4713-a8a2-ec89b4015d14 req-fd600a86-eb82-40bc-adf0-2958916d77cd service nova] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Refreshing network info cache for port 7239781d-a3ed-42f7-a30b-d8e5410bc622 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Start _get_guest_xml network_info=[{"id": "7239781d-a3ed-42f7-a30b-d8e5410bc622", "address": "fa:16:3e:0a:8d:a9", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7239781d-a3", "ovs_interfaceid": "7239781d-a3ed-42f7-a30b-d8e5410bc622", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:18:19 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:18:19 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1743880248',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1743880248',id=30,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='adb3ba16695543cab6f10932fd6b2d2d',ramdisk_id='',reservation_id='r-709b8qsw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-90723689',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:18:18Z,user_data=None,user_id='b319a47b86c04affa1858e1c2359876b',uuid=5e631ac3-8122-46a3-a54f-2395c0f7cf7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7239781d-a3ed-42f7-a30b-d8e5410bc622", "address": "fa:16:3e:0a:8d:a9", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7239781d-a3", "ovs_interfaceid": "7239781d-a3ed-42f7-a30b-d8e5410bc622", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Converting VIF {"id": "7239781d-a3ed-42f7-a30b-d8e5410bc622", "address": "fa:16:3e:0a:8d:a9", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7239781d-a3", "ovs_interfaceid": "7239781d-a3ed-42f7-a30b-d8e5410bc622", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:8d:a9,bridge_name='br-int',has_traffic_filtering=True,id=7239781d-a3ed-42f7-a30b-d8e5410bc622,network=Network(bf1db63d-d427-41c2-ac82-6fab9483a423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7239781d-a3') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.objects.instance [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e631ac3-8122-46a3-a54f-2395c0f7cf7c {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:18:19 user nova-compute[75745]:   <uuid>5e631ac3-8122-46a3-a54f-2395c0f7cf7c</uuid>
Dec 01 17:18:19 user nova-compute[75745]:   <name>instance-0000001e</name>
Dec 01 17:18:19 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:18:19 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:18:19 user nova-compute[75745]:   <metadata>
Dec 01 17:18:19 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:18:19 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:18:19 user nova-compute[75745]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1743880248</nova:name>
Dec 01 17:18:19 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:18:19</nova:creationTime>
Dec 01 17:18:19 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:18:19 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:18:19 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:18:19 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:18:19 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:18:19 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:18:19 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:18:19 user nova-compute[75745]:       <nova:owner>
Dec 01 17:18:19 user nova-compute[75745]:         <nova:user uuid="b319a47b86c04affa1858e1c2359876b">tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member</nova:user>
Dec 01 17:18:19 user nova-compute[75745]:         <nova:project uuid="adb3ba16695543cab6f10932fd6b2d2d">tempest-ServerBootFromVolumeStableRescueTest-90723689</nova:project>
Dec 01 17:18:19 user nova-compute[75745]:       </nova:owner>
Dec 01 17:18:19 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:18:19 user nova-compute[75745]:       <nova:ports>
Dec 01 17:18:19 user nova-compute[75745]:         <nova:port uuid="7239781d-a3ed-42f7-a30b-d8e5410bc622">
Dec 01 17:18:19 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 01 17:18:19 user nova-compute[75745]:         </nova:port>
Dec 01 17:18:19 user nova-compute[75745]:       </nova:ports>
Dec 01 17:18:19 user nova-compute[75745]:     </nova:instance>
Dec 01 17:18:19 user nova-compute[75745]:   </metadata>
Dec 01 17:18:19 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:18:19 user nova-compute[75745]:     <system>
Dec 01 17:18:19 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:18:19 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:18:19 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:18:19 user nova-compute[75745]:       <entry name="serial">5e631ac3-8122-46a3-a54f-2395c0f7cf7c</entry>
Dec 01 17:18:19 user nova-compute[75745]:       <entry name="uuid">5e631ac3-8122-46a3-a54f-2395c0f7cf7c</entry>
Dec 01 17:18:19 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:18:19 user nova-compute[75745]:     </system>
Dec 01 17:18:19 user nova-compute[75745]:   </sysinfo>
Dec 01 17:18:19 user nova-compute[75745]:   <os>
Dec 01 17:18:19 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:18:19 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:18:19 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:18:19 user nova-compute[75745]:   </os>
Dec 01 17:18:19 user nova-compute[75745]:   <features>
Dec 01 17:18:19 user nova-compute[75745]:     <acpi/>
Dec 01 17:18:19 user nova-compute[75745]:     <apic/>
Dec 01 17:18:19 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:18:19 user nova-compute[75745]:   </features>
Dec 01 17:18:19 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:18:19 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:18:19 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:18:19 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:18:19 user nova-compute[75745]:   </clock>
Dec 01 17:18:19 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:18:19 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:18:19 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:18:19 user nova-compute[75745]:   </cpu>
Dec 01 17:18:19 user nova-compute[75745]:   <devices>
Dec 01 17:18:19 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:18:19 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:18:19 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk"/>
Dec 01 17:18:19 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:18:19 user nova-compute[75745]:     </disk>
Dec 01 17:18:19 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:18:19 user nova-compute[75745]:       <mac address="fa:16:3e:0a:8d:a9"/>
Dec 01 17:18:19 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:18:19 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:18:19 user nova-compute[75745]:       <target dev="tap7239781d-a3"/>
Dec 01 17:18:19 user nova-compute[75745]:     </interface>
Dec 01 17:18:19 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:18:19 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/console.log" append="off"/>
Dec 01 17:18:19 user nova-compute[75745]:     </serial>
Dec 01 17:18:19 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:18:19 user nova-compute[75745]:     <video>
Dec 01 17:18:19 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:18:19 user nova-compute[75745]:     </video>
Dec 01 17:18:19 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:18:19 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:18:19 user nova-compute[75745]:     </rng>
Dec 01 17:18:19 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:18:19 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:18:19 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:18:19 user nova-compute[75745]:     </memballoon>
Dec 01 17:18:19 user nova-compute[75745]:   </devices>
Dec 01 17:18:19 user nova-compute[75745]: </domain>
Dec 01 17:18:19 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1743880248',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1743880248',id=30,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='adb3ba16695543cab6f10932fd6b2d2d',ramdisk_id='',reservation_id='r-709b8qsw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-90723689',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:18:18Z,user_data=None,user_id='b319a47b86c04affa1858e1c2359876b',uuid=5e631ac3-8122-46a3-a54f-2395c0f7cf7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7239781d-a3ed-42f7-a30b-d8e5410bc622", "address": "fa:16:3e:0a:8d:a9", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7239781d-a3", "ovs_interfaceid": "7239781d-a3ed-42f7-a30b-d8e5410bc622", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Converting VIF {"id": "7239781d-a3ed-42f7-a30b-d8e5410bc622", "address": "fa:16:3e:0a:8d:a9", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7239781d-a3", "ovs_interfaceid": "7239781d-a3ed-42f7-a30b-d8e5410bc622", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:8d:a9,bridge_name='br-int',has_traffic_filtering=True,id=7239781d-a3ed-42f7-a30b-d8e5410bc622,network=Network(bf1db63d-d427-41c2-ac82-6fab9483a423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7239781d-a3') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG os_vif [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:8d:a9,bridge_name='br-int',has_traffic_filtering=True,id=7239781d-a3ed-42f7-a30b-d8e5410bc622,network=Network(bf1db63d-d427-41c2-ac82-6fab9483a423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7239781d-a3') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5b8e37ca-c18f-5def-9285-19403a9edc7d', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7239781d-a3, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7239781d-a3, col_values=(('qos', UUID('710e210f-f769-4750-b816-cc27499f4210')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7239781d-a3, col_values=(('external_ids', {'iface-id': '7239781d-a3ed-42f7-a30b-d8e5410bc622', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:8d:a9', 'vm-uuid': '5e631ac3-8122-46a3-a54f-2395c0f7cf7c'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:19 user nova-compute[75745]: INFO os_vif [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:8d:a9,bridge_name='br-int',has_traffic_filtering=True,id=7239781d-a3ed-42f7-a30b-d8e5410bc622,network=Network(bf1db63d-d427-41c2-ac82-6fab9483a423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7239781d-a3')
Dec 01 17:18:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:18:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] No VIF found with MAC fa:16:3e:0a:8d:a9, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:18:20 user nova-compute[75745]: DEBUG nova.network.neutron [req-832a6403-da5c-4713-a8a2-ec89b4015d14 req-fd600a86-eb82-40bc-adf0-2958916d77cd service nova] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Updated VIF entry in instance network info cache for port 7239781d-a3ed-42f7-a30b-d8e5410bc622. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:18:20 user nova-compute[75745]: DEBUG nova.network.neutron [req-832a6403-da5c-4713-a8a2-ec89b4015d14 req-fd600a86-eb82-40bc-adf0-2958916d77cd service nova] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Updating instance_info_cache with network_info: [{"id": "7239781d-a3ed-42f7-a30b-d8e5410bc622", "address": "fa:16:3e:0a:8d:a9", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7239781d-a3", "ovs_interfaceid": "7239781d-a3ed-42f7-a30b-d8e5410bc622", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:18:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-832a6403-da5c-4713-a8a2-ec89b4015d14 req-fd600a86-eb82-40bc-adf0-2958916d77cd service nova] Releasing lock "refresh_cache-5e631ac3-8122-46a3-a54f-2395c0f7cf7c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:18:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:21 user nova-compute[75745]: DEBUG nova.compute.manager [req-a0325630-cfb5-4bc8-822f-719d1851f5f5 req-ac63e890-5cbd-4a64-ab71-f55020aaac70 service nova] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Received event network-vif-plugged-7239781d-a3ed-42f7-a30b-d8e5410bc622 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:18:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a0325630-cfb5-4bc8-822f-719d1851f5f5 req-ac63e890-5cbd-4a64-ab71-f55020aaac70 service nova] Acquiring lock "5e631ac3-8122-46a3-a54f-2395c0f7cf7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:18:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a0325630-cfb5-4bc8-822f-719d1851f5f5 req-ac63e890-5cbd-4a64-ab71-f55020aaac70 service nova] Lock "5e631ac3-8122-46a3-a54f-2395c0f7cf7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:18:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a0325630-cfb5-4bc8-822f-719d1851f5f5 req-ac63e890-5cbd-4a64-ab71-f55020aaac70 service nova] Lock "5e631ac3-8122-46a3-a54f-2395c0f7cf7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:18:21 user nova-compute[75745]: DEBUG nova.compute.manager [req-a0325630-cfb5-4bc8-822f-719d1851f5f5 req-ac63e890-5cbd-4a64-ab71-f55020aaac70 service nova] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] No waiting events found dispatching network-vif-plugged-7239781d-a3ed-42f7-a30b-d8e5410bc622 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:18:21 user nova-compute[75745]: WARNING nova.compute.manager [req-a0325630-cfb5-4bc8-822f-719d1851f5f5 req-ac63e890-5cbd-4a64-ab71-f55020aaac70 service nova] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Received unexpected event network-vif-plugged-7239781d-a3ed-42f7-a30b-d8e5410bc622 for instance with vm_state building and task_state spawning.
Dec 01 17:18:23 user nova-compute[75745]: DEBUG nova.compute.manager [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:18:23 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:18:23 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Instance spawned successfully.
Dec 01 17:18:23 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:18:23 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:18:23 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:18:23 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:18:23 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:18:23 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:18:23 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:18:23 user nova-compute[75745]: INFO nova.compute.manager [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Took 5.19 seconds to spawn the instance on the hypervisor.
Dec 01 17:18:23 user nova-compute[75745]: DEBUG nova.compute.manager [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:18:23 user nova-compute[75745]: INFO nova.compute.manager [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Took 5.95 seconds to build instance.
Dec 01 17:18:23 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b48c6be9-2cbc-4eec-9bee-832d0071481a tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "5e631ac3-8122-46a3-a54f-2395c0f7cf7c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.055s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:18:24 user nova-compute[75745]: DEBUG nova.compute.manager [req-dd248cc7-f73e-41c2-bccb-af1c85254c21 req-2e9dfc54-7ff0-433b-bff7-e4a70a863369 service nova] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Received event network-vif-plugged-7239781d-a3ed-42f7-a30b-d8e5410bc622 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:18:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-dd248cc7-f73e-41c2-bccb-af1c85254c21 req-2e9dfc54-7ff0-433b-bff7-e4a70a863369 service nova] Acquiring lock "5e631ac3-8122-46a3-a54f-2395c0f7cf7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:18:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-dd248cc7-f73e-41c2-bccb-af1c85254c21 req-2e9dfc54-7ff0-433b-bff7-e4a70a863369 service nova] Lock "5e631ac3-8122-46a3-a54f-2395c0f7cf7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:18:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-dd248cc7-f73e-41c2-bccb-af1c85254c21 req-2e9dfc54-7ff0-433b-bff7-e4a70a863369 service nova] Lock "5e631ac3-8122-46a3-a54f-2395c0f7cf7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:18:24 user nova-compute[75745]: DEBUG nova.compute.manager [req-dd248cc7-f73e-41c2-bccb-af1c85254c21 req-2e9dfc54-7ff0-433b-bff7-e4a70a863369 service nova] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] No waiting events found dispatching network-vif-plugged-7239781d-a3ed-42f7-a30b-d8e5410bc622 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:18:24 user nova-compute[75745]: WARNING nova.compute.manager [req-dd248cc7-f73e-41c2-bccb-af1c85254c21 req-2e9dfc54-7ff0-433b-bff7-e4a70a863369 service nova] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Received unexpected event network-vif-plugged-7239781d-a3ed-42f7-a30b-d8e5410bc622 for instance with vm_state active and task_state None.
Dec 01 17:18:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:29 user nova-compute[75745]: DEBUG nova.compute.manager [req-e7217f71-d0a6-4eb7-8c4d-cc8fc5ee56e6 req-e642260d-34cb-4ac6-a1c2-62775d33aac0 service nova] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Received event network-changed-643d0b0f-f36b-4107-8f2a-4efd9db2973a {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:18:29 user nova-compute[75745]: DEBUG nova.compute.manager [req-e7217f71-d0a6-4eb7-8c4d-cc8fc5ee56e6 req-e642260d-34cb-4ac6-a1c2-62775d33aac0 service nova] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Refreshing instance network info cache due to event network-changed-643d0b0f-f36b-4107-8f2a-4efd9db2973a. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:18:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e7217f71-d0a6-4eb7-8c4d-cc8fc5ee56e6 req-e642260d-34cb-4ac6-a1c2-62775d33aac0 service nova] Acquiring lock "refresh_cache-63cffe58-0056-4b06-86d9-bee746c2f832" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:18:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e7217f71-d0a6-4eb7-8c4d-cc8fc5ee56e6 req-e642260d-34cb-4ac6-a1c2-62775d33aac0 service nova] Acquired lock "refresh_cache-63cffe58-0056-4b06-86d9-bee746c2f832" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:18:29 user nova-compute[75745]: DEBUG nova.network.neutron [req-e7217f71-d0a6-4eb7-8c4d-cc8fc5ee56e6 req-e642260d-34cb-4ac6-a1c2-62775d33aac0 service nova] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Refreshing network info cache for port 643d0b0f-f36b-4107-8f2a-4efd9db2973a {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:18:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:29 user nova-compute[75745]: DEBUG nova.network.neutron [req-e7217f71-d0a6-4eb7-8c4d-cc8fc5ee56e6 req-e642260d-34cb-4ac6-a1c2-62775d33aac0 service nova] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Updated VIF entry in instance network info cache for port 643d0b0f-f36b-4107-8f2a-4efd9db2973a. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:18:29 user nova-compute[75745]: DEBUG nova.network.neutron [req-e7217f71-d0a6-4eb7-8c4d-cc8fc5ee56e6 req-e642260d-34cb-4ac6-a1c2-62775d33aac0 service nova] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Updating instance_info_cache with network_info: [{"id": "643d0b0f-f36b-4107-8f2a-4efd9db2973a", "address": "fa:16:3e:e3:a6:76", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643d0b0f-f3", "ovs_interfaceid": "643d0b0f-f36b-4107-8f2a-4efd9db2973a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:18:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e7217f71-d0a6-4eb7-8c4d-cc8fc5ee56e6 req-e642260d-34cb-4ac6-a1c2-62775d33aac0 service nova] Releasing lock "refresh_cache-63cffe58-0056-4b06-86d9-bee746c2f832" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:18:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "63cffe58-0056-4b06-86d9-bee746c2f832" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:18:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "63cffe58-0056-4b06-86d9-bee746c2f832" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:18:32 user nova-compute[75745]: DEBUG nova.objects.instance [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lazy-loading 'flavor' on Instance uuid 63cffe58-0056-4b06-86d9-bee746c2f832 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:18:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "63cffe58-0056-4b06-86d9-bee746c2f832" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:18:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "63cffe58-0056-4b06-86d9-bee746c2f832" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:18:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "63cffe58-0056-4b06-86d9-bee746c2f832" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:18:32 user nova-compute[75745]: INFO nova.compute.manager [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Attaching volume 9c8da1c1-2f30-4738-9ba7-f144c91f35b3 to /dev/vdb
Dec 01 17:18:32 user nova-compute[75745]: DEBUG os_brick.utils [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:18:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:32 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[12912e68-cfc5-41de-aab2-731620be6a78]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:32 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a861d64-734b-40a9-9bf4-a6608b03b3a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:32 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3125c42f-3b66-4073-9586-f8395cffe32c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:32 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[06499482-aa17-4a1d-ac2d-a96e36e50d6f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:18:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:18:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:18:32 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:18:32 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe482e2-f307-492c-81cd-f34461c0e650]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:18:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:18:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:18:32 user nova-compute[75745]: DEBUG os_brick.utils [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:18:32 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Updating existing volume attachment record: 0bf99e51-6ea7-4afb-a020-22cb25783664 {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:18:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KipWPdoC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:18:41 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:18:41 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:18:41 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:18:41 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:18:41 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:18:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdc476d-910d-4117-8c42-18a40ef6c066]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:18:41 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff0979f-5e55-4c0f-b3bb-2719ed57851c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3] added
Dec 01 17:18:41 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c58b933-b352-44cb-86ca-dd04c842cf22]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf0341c-dbda-4638-85d7-13f5fcd72f45]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KipWPdoC {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KipWPdoC" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df1122c-fe30-4ae9-b89b-c34589eb69fd]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KipWPdoC'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[003cff12-bb0d-4b74-8379-200c69a12147]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed6358b-dc52-4b78-8054-e64ac0abeb7d]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc (non-flash)
Dec 01 17:18:41 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc (non-flash)
Dec 01 17:18:41 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84de618-03da-4fe1-bce4-8137c91763cc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3, portal: 172.16.0.220,3260]
Dec 01 17:18:41 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3, portal: 172.16.0.220,3260] successful.
Dec 01 17:18:41 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c83b0cd-576d-4df2-a474-5bba24b90fba]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[22448957-2a11-4253-9d22-d6ec4086fe12]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc (non-flash)
Dec 01 17:18:41 user nova-compute[75745]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3 (non-flash)
Dec 01 17:18:41 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc (non-flash)
Dec 01 17:18:41 user nova-compute[75745]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3 (non-flash)
Dec 01 17:18:41 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[59df0b4e-6017-4c98-903c-26d2bd29a1e8]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:18:41 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KipWPdoC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:18:42 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:18:42 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23064643539613662', 'path': '/dev/sdb'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:18:42 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064643539613662', 'path': '/dev/sdb'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:18:42 user nova-compute[75745]: DEBUG nova.objects.instance [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lazy-loading 'flavor' on Instance uuid 63cffe58-0056-4b06-86d9-bee746c2f832 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:18:42 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 17:18:42 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:18:42 user nova-compute[75745]:   <source dev="/dev/sdb"/>
Dec 01 17:18:42 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:18:42 user nova-compute[75745]:   <serial>9c8da1c1-2f30-4738-9ba7-f144c91f35b3</serial>
Dec 01 17:18:42 user nova-compute[75745]: </disk>
Dec 01 17:18:42 user nova-compute[75745]:  {{(pid=75745) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 17:18:43 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:18:43 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:18:43 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] No VIF found with MAC fa:16:3e:e3:a6:76, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:18:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-42f84558-4770-48ba-8be3-55796e3c18b6 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "63cffe58-0056-4b06-86d9-bee746c2f832" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.005s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:18:43 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:18:43 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:18:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "63cffe58-0056-4b06-86d9-bee746c2f832" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:18:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "63cffe58-0056-4b06-86d9-bee746c2f832" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:18:46 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:18:46 user nova-compute[75745]: DEBUG nova.objects.instance [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lazy-loading 'flavor' on Instance uuid 63cffe58-0056-4b06-86d9-bee746c2f832 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:18:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "63cffe58-0056-4b06-86d9-bee746c2f832" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:18:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "63cffe58-0056-4b06-86d9-bee746c2f832" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:18:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "63cffe58-0056-4b06-86d9-bee746c2f832" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:18:47 user nova-compute[75745]: INFO nova.compute.manager [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Attaching volume d64ffe6f-0963-4748-b9a9-e79c6856b6d6 to /dev/vdc
Dec 01 17:18:47 user nova-compute[75745]: DEBUG os_brick.utils [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:18:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c52eac4-4faf-47da-a5e2-cb647882a9c1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[239aef7d-b62c-4f9e-a943-200e08d4d324]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd3a6ab-c6f6-4cc4-ac90-983b27196cc7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c6336b-3d01-4c52-a68b-e634f2426fdd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:18:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:18:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:18:47 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:18:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec99f250-937d-4980-a91a-cc92df2ce43a]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:18:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:18:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:18:47 user nova-compute[75745]: DEBUG os_brick.utils [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:18:47 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Updating existing volume attachment record: 3d0e813a-3cdc-4012-a5e9-97693c5c461e {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:18:47 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:18:48 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:18:49 user nova-compute[75745]: INFO nova.compute.manager [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Rescuing
Dec 01 17:18:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "refresh_cache-e4ffb96e-456c-4fb9-9850-9e98310d63e5" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:18:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquired lock "refresh_cache-e4ffb96e-456c-4fb9-9850-9e98310d63e5" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:18:49 user nova-compute[75745]: DEBUG nova.network.neutron [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:18:49 user nova-compute[75745]: DEBUG nova.network.neutron [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Updating instance_info_cache with network_info: [{"id": "ebf45b7a-1ee5-43d6-9940-0ca049c95d71", "address": "fa:16:3e:39:c0:e3", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf45b7a-1e", "ovs_interfaceid": "ebf45b7a-1ee5-43d6-9940-0ca049c95d71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:18:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Releasing lock "refresh_cache-e4ffb96e-456c-4fb9-9850-9e98310d63e5" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:18:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:49 user nova-compute[75745]: DEBUG nova.compute.manager [req-2bc5b66d-eaf5-40e4-bd46-dc529264109e req-195e1189-66d0-498b-b17c-a5a1dc9ba0b9 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Received event network-vif-unplugged-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:18:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2bc5b66d-eaf5-40e4-bd46-dc529264109e req-195e1189-66d0-498b-b17c-a5a1dc9ba0b9 service nova] Acquiring lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:18:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2bc5b66d-eaf5-40e4-bd46-dc529264109e req-195e1189-66d0-498b-b17c-a5a1dc9ba0b9 service nova] Lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:18:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2bc5b66d-eaf5-40e4-bd46-dc529264109e req-195e1189-66d0-498b-b17c-a5a1dc9ba0b9 service nova] Lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:18:49 user nova-compute[75745]: DEBUG nova.compute.manager [req-2bc5b66d-eaf5-40e4-bd46-dc529264109e req-195e1189-66d0-498b-b17c-a5a1dc9ba0b9 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] No waiting events found dispatching network-vif-unplugged-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:18:49 user nova-compute[75745]: WARNING nova.compute.manager [req-2bc5b66d-eaf5-40e4-bd46-dc529264109e req-195e1189-66d0-498b-b17c-a5a1dc9ba0b9 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Received unexpected event network-vif-unplugged-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 for instance with vm_state active and task_state rescuing.
Dec 01 17:18:49 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:18:49 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:18:49 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:18:49 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:18:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:18:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:18:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:18:49 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:18:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:50 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Instance destroyed successfully.
Dec 01 17:18:50 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Attempting rescue
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75745) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Instance directory exists: not creating {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Dec 01 17:18:50 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Creating image(s)
Dec 01 17:18:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "/opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "/opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.objects.instance [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lazy-loading 'trusted_certs' on Instance uuid e4ffb96e-456c-4fb9-9850-9e98310d63e5 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.200s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk.rescue {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk.rescue" returned: 0 in 0.053s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.objects.instance [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lazy-loading 'migration_context' on Instance uuid e4ffb96e-456c-4fb9-9850-9e98310d63e5 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.objects.base [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Object Instance<e4ffb96e-456c-4fb9-9850-9e98310d63e5> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Start _get_guest_xml network_info=[{"id": "ebf45b7a-1ee5-43d6-9940-0ca049c95d71", "address": "fa:16:3e:39:c0:e3", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "vif_mac": "fa:16:3e:39:c0:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf45b7a-1e", "ovs_interfaceid": "ebf45b7a-1ee5-43d6-9940-0ca049c95d71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.objects.instance [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lazy-loading 'resources' on Instance uuid e4ffb96e-456c-4fb9-9850-9e98310d63e5 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.objects.base [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Object Instance<e4ffb96e-456c-4fb9-9850-9e98310d63e5> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.objects.instance [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lazy-loading 'numa_topology' on Instance uuid e4ffb96e-456c-4fb9-9850-9e98310d63e5 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.objects.base [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Object Instance<e4ffb96e-456c-4fb9-9850-9e98310d63e5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:18:50 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:18:50 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.objects.instance [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lazy-loading 'vcpu_model' on Instance uuid e4ffb96e-456c-4fb9-9850-9e98310d63e5 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.objects.base [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Object Instance<e4ffb96e-456c-4fb9-9850-9e98310d63e5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:14:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-910276691',display_name='tempest-ServerRescueNegativeTestJSON-server-910276691',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-910276691',id=22,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:14:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4542114c14774241bb138dfafe3441ad',ramdisk_id='',reservation_id='r-px22dfxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1719994145',owner_user_name='tempest-ServerRescueNegativeTestJSON-1719994145-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:14:13Z,user_data=None,user_id='7bd90117cc3c433d953b7e0de3718f0d',uuid=e4ffb96e-456c-4fb9-9850-9e98310d63e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebf45b7a-1ee5-43d6-9940-0ca049c95d71", "address": "fa:16:3e:39:c0:e3", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "vif_mac": "fa:16:3e:39:c0:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf45b7a-1e", "ovs_interfaceid": "ebf45b7a-1ee5-43d6-9940-0ca049c95d71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Converting VIF {"id": "ebf45b7a-1ee5-43d6-9940-0ca049c95d71", "address": "fa:16:3e:39:c0:e3", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "vif_mac": "fa:16:3e:39:c0:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf45b7a-1e", "ovs_interfaceid": "ebf45b7a-1ee5-43d6-9940-0ca049c95d71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:c0:e3,bridge_name='br-int',has_traffic_filtering=True,id=ebf45b7a-1ee5-43d6-9940-0ca049c95d71,network=Network(fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf45b7a-1e') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.objects.instance [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lazy-loading 'pci_devices' on Instance uuid e4ffb96e-456c-4fb9-9850-9e98310d63e5 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.objects.base [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Object Instance<e4ffb96e-456c-4fb9-9850-9e98310d63e5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:18:50 user nova-compute[75745]:   <uuid>e4ffb96e-456c-4fb9-9850-9e98310d63e5</uuid>
Dec 01 17:18:50 user nova-compute[75745]:   <name>instance-00000016</name>
Dec 01 17:18:50 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:18:50 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:18:50 user nova-compute[75745]:   <metadata>
Dec 01 17:18:50 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:18:50 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:18:50 user nova-compute[75745]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-910276691</nova:name>
Dec 01 17:18:50 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:18:50</nova:creationTime>
Dec 01 17:18:50 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:18:50 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:18:50 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:18:50 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:18:50 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:18:50 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:18:50 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:18:50 user nova-compute[75745]:       <nova:owner>
Dec 01 17:18:50 user nova-compute[75745]:         <nova:user uuid="7bd90117cc3c433d953b7e0de3718f0d">tempest-ServerRescueNegativeTestJSON-1719994145-project-member</nova:user>
Dec 01 17:18:50 user nova-compute[75745]:         <nova:project uuid="4542114c14774241bb138dfafe3441ad">tempest-ServerRescueNegativeTestJSON-1719994145</nova:project>
Dec 01 17:18:50 user nova-compute[75745]:       </nova:owner>
Dec 01 17:18:50 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:18:50 user nova-compute[75745]:       <nova:ports>
Dec 01 17:18:50 user nova-compute[75745]:         <nova:port uuid="ebf45b7a-1ee5-43d6-9940-0ca049c95d71">
Dec 01 17:18:50 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 01 17:18:50 user nova-compute[75745]:         </nova:port>
Dec 01 17:18:50 user nova-compute[75745]:       </nova:ports>
Dec 01 17:18:50 user nova-compute[75745]:     </nova:instance>
Dec 01 17:18:50 user nova-compute[75745]:   </metadata>
Dec 01 17:18:50 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:18:50 user nova-compute[75745]:     <system>
Dec 01 17:18:50 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:18:50 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:18:50 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:18:50 user nova-compute[75745]:       <entry name="serial">e4ffb96e-456c-4fb9-9850-9e98310d63e5</entry>
Dec 01 17:18:50 user nova-compute[75745]:       <entry name="uuid">e4ffb96e-456c-4fb9-9850-9e98310d63e5</entry>
Dec 01 17:18:50 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:18:50 user nova-compute[75745]:     </system>
Dec 01 17:18:50 user nova-compute[75745]:   </sysinfo>
Dec 01 17:18:50 user nova-compute[75745]:   <os>
Dec 01 17:18:50 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:18:50 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:18:50 user nova-compute[75745]:   </os>
Dec 01 17:18:50 user nova-compute[75745]:   <features>
Dec 01 17:18:50 user nova-compute[75745]:     <acpi/>
Dec 01 17:18:50 user nova-compute[75745]:     <apic/>
Dec 01 17:18:50 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:18:50 user nova-compute[75745]:   </features>
Dec 01 17:18:50 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:18:50 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:18:50 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:18:50 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:18:50 user nova-compute[75745]:   </clock>
Dec 01 17:18:50 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:18:50 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:18:50 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:18:50 user nova-compute[75745]:   </cpu>
Dec 01 17:18:50 user nova-compute[75745]:   <devices>
Dec 01 17:18:50 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:18:50 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:18:50 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk.rescue"/>
Dec 01 17:18:50 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:18:50 user nova-compute[75745]:     </disk>
Dec 01 17:18:50 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:18:50 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:18:50 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk"/>
Dec 01 17:18:50 user nova-compute[75745]:       <target dev="vdb" bus="virtio"/>
Dec 01 17:18:50 user nova-compute[75745]:     </disk>
Dec 01 17:18:50 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:18:50 user nova-compute[75745]:       <mac address="fa:16:3e:39:c0:e3"/>
Dec 01 17:18:50 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:18:50 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:18:50 user nova-compute[75745]:       <target dev="tapebf45b7a-1e"/>
Dec 01 17:18:50 user nova-compute[75745]:     </interface>
Dec 01 17:18:50 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:18:50 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/console.log" append="off"/>
Dec 01 17:18:50 user nova-compute[75745]:     </serial>
Dec 01 17:18:50 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:18:50 user nova-compute[75745]:     <video>
Dec 01 17:18:50 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:18:50 user nova-compute[75745]:     </video>
Dec 01 17:18:50 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:18:50 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:18:50 user nova-compute[75745]:     </rng>
Dec 01 17:18:50 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:18:50 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:18:50 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:18:50 user nova-compute[75745]:     </memballoon>
Dec 01 17:18:50 user nova-compute[75745]:   </devices>
Dec 01 17:18:50 user nova-compute[75745]: </domain>
Dec 01 17:18:50 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:18:50 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Instance destroyed successfully.
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] No VIF found with MAC fa:16:3e:39:c0:e3, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:50 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0959ad6-3d88-47d7-bf74-58fcb727fb3e/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0959ad6-3d88-47d7-bf74-58fcb727fb3e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0959ad6-3d88-47d7-bf74-58fcb727fb3e/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-038235d4-4d0f-4236-b04d-267ae148cbdc req-5829d502-dd68-474f-b236-212ab207d665 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Received event network-vif-plugged-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:18:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-038235d4-4d0f-4236-b04d-267ae148cbdc req-5829d502-dd68-474f-b236-212ab207d665 service nova] Acquiring lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:18:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-038235d4-4d0f-4236-b04d-267ae148cbdc req-5829d502-dd68-474f-b236-212ab207d665 service nova] Lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:18:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-038235d4-4d0f-4236-b04d-267ae148cbdc req-5829d502-dd68-474f-b236-212ab207d665 service nova] Lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:18:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-038235d4-4d0f-4236-b04d-267ae148cbdc req-5829d502-dd68-474f-b236-212ab207d665 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] No waiting events found dispatching network-vif-plugged-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:18:51 user nova-compute[75745]: WARNING nova.compute.manager [req-038235d4-4d0f-4236-b04d-267ae148cbdc req-5829d502-dd68-474f-b236-212ab207d665 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Received unexpected event network-vif-plugged-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 for instance with vm_state active and task_state rescuing.
Dec 01 17:18:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0959ad6-3d88-47d7-bf74-58fcb727fb3e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:18:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63cffe58-0056-4b06-86d9-bee746c2f832/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63cffe58-0056-4b06-86d9-bee746c2f832/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63cffe58-0056-4b06-86d9-bee746c2f832/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63cffe58-0056-4b06-86d9-bee746c2f832/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:18:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:53 user nova-compute[75745]: DEBUG nova.compute.manager [req-305ec806-ab9e-4ff0-bcd5-926fb689a08e req-531bcf22-db56-498b-90e3-80934feecfc3 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Received event network-vif-plugged-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:18:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-305ec806-ab9e-4ff0-bcd5-926fb689a08e req-531bcf22-db56-498b-90e3-80934feecfc3 service nova] Acquiring lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:18:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-305ec806-ab9e-4ff0-bcd5-926fb689a08e req-531bcf22-db56-498b-90e3-80934feecfc3 service nova] Lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:18:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-305ec806-ab9e-4ff0-bcd5-926fb689a08e req-531bcf22-db56-498b-90e3-80934feecfc3 service nova] Lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:18:53 user nova-compute[75745]: DEBUG nova.compute.manager [req-305ec806-ab9e-4ff0-bcd5-926fb689a08e req-531bcf22-db56-498b-90e3-80934feecfc3 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] No waiting events found dispatching network-vif-plugged-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:18:53 user nova-compute[75745]: WARNING nova.compute.manager [req-305ec806-ab9e-4ff0-bcd5-926fb689a08e req-531bcf22-db56-498b-90e3-80934feecfc3 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Received unexpected event network-vif-plugged-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 for instance with vm_state active and task_state rescuing.
Dec 01 17:18:53 user nova-compute[75745]: DEBUG nova.compute.manager [req-305ec806-ab9e-4ff0-bcd5-926fb689a08e req-531bcf22-db56-498b-90e3-80934feecfc3 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Received event network-vif-plugged-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:18:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-305ec806-ab9e-4ff0-bcd5-926fb689a08e req-531bcf22-db56-498b-90e3-80934feecfc3 service nova] Acquiring lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:18:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-305ec806-ab9e-4ff0-bcd5-926fb689a08e req-531bcf22-db56-498b-90e3-80934feecfc3 service nova] Lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:18:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-305ec806-ab9e-4ff0-bcd5-926fb689a08e req-531bcf22-db56-498b-90e3-80934feecfc3 service nova] Lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:18:53 user nova-compute[75745]: DEBUG nova.compute.manager [req-305ec806-ab9e-4ff0-bcd5-926fb689a08e req-531bcf22-db56-498b-90e3-80934feecfc3 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] No waiting events found dispatching network-vif-plugged-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:18:53 user nova-compute[75745]: WARNING nova.compute.manager [req-305ec806-ab9e-4ff0-bcd5-926fb689a08e req-531bcf22-db56-498b-90e3-80934feecfc3 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Received unexpected event network-vif-plugged-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 for instance with vm_state active and task_state rescuing.
Dec 01 17:18:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:54 user nova-compute[75745]: DEBUG nova.compute.manager [None req-cf7789cb-801d-4512-9c67-f1bef1f14de1 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:18:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:55 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:18:55 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:18:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=7806MB free_disk=25.336910247802734GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:18:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:18:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:18:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance d997cdd6-67c6-4263-814a-17cf9e27bbeb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:18:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 0ab0c115-74aa-4e55-92a3-6fa91ba753e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:18:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance e4ffb96e-456c-4fb9-9850-9e98310d63e5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:18:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 80962f79-dbb2-4380-b2c8-791642cfa86b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:18:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance a690fa65-078d-4ffd-bc62-3366aaa3d681 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:18:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 9aca117f-581a-4625-abf1-c7faba669572 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:18:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance e0959ad6-3d88-47d7-bf74-58fcb727fb3e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:18:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 63cffe58-0056-4b06-86d9-bee746c2f832 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:18:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 5e631ac3-8122-46a3-a54f-2395c0f7cf7c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:18:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:18:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:18:55 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:18:55 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:18:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:18:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.495s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:18:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:18:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fAyejYpz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:18:56 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:18:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:18:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:18:56 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:18:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:18:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:18:56 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:18:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:56 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46d00d6-5d13-4b20-9801-a26ac1f52576]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:18:56 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:18:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:56 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ed40e8-78bb-462b-b7cc-52519c532b07]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6] added
Dec 01 17:18:56 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:18:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:56 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[13984a39-d7b8-48e9-b076-76ae3f91e27f]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:18:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:56 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f606d053-8155-4790-85af-774896747f95]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:18:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fAyejYpz {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fAyejYpz" returned: 0 in 0.027s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:56 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edef58f-e1c8-40d4-a153-5d7662a33c7c]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fAyejYpz'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:18:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:56 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76cbad9-d2cf-482d-a478-41707b4665a8]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:18:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:56 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[19124cbf-0ab5-49dd-92d2-37462790cc22]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc (non-flash)
Dec 01 17:18:56 user nova-compute[75745]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3 (non-flash)
Dec 01 17:18:56 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:18:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc (non-flash)
Dec 01 17:18:56 user nova-compute[75745]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3 (non-flash)
Dec 01 17:18:56 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:18:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:57 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d063b17-b4dc-4bfa-adb9-88f99749fe79]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6, portal: 172.16.0.220,3260]
Dec 01 17:18:57 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6, portal: 172.16.0.220,3260] successful.
Dec 01 17:18:57 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:18:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:57 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ab0507-0c5f-46ba-b641-ec6189b11ebe]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:18:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:57 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[23089907-295e-464b-898b-5835a1048ca6]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc (non-flash)
Dec 01 17:18:57 user nova-compute[75745]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3 (non-flash)
Dec 01 17:18:57 user nova-compute[75745]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6 (non-flash)
Dec 01 17:18:57 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:18:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc (non-flash)
Dec 01 17:18:57 user nova-compute[75745]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3 (non-flash)
Dec 01 17:18:57 user nova-compute[75745]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6 (non-flash)
Dec 01 17:18:57 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:18:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:18:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:18:57 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:18:57 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:18:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:18:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:18:57 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9dfa99-8d9f-45ff-8663-8fb84439b0d0]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:18:57 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:18:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fAyejYpz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:18:58 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:18:58 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '26563643265656132', 'path': '/dev/sdd'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:18:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563643265656132', 'path': '/dev/sdd'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:18:58 user nova-compute[75745]: DEBUG nova.objects.instance [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lazy-loading 'flavor' on Instance uuid 63cffe58-0056-4b06-86d9-bee746c2f832 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:18:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 17:18:58 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:18:58 user nova-compute[75745]:   <source dev="/dev/sdd"/>
Dec 01 17:18:58 user nova-compute[75745]:   <target dev="vdc" bus="virtio"/>
Dec 01 17:18:58 user nova-compute[75745]:   <serial>d64ffe6f-0963-4748-b9a9-e79c6856b6d6</serial>
Dec 01 17:18:58 user nova-compute[75745]: </disk>
Dec 01 17:18:58 user nova-compute[75745]:  {{(pid=75745) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 17:18:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:18:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:18:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:18:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] No VIF found with MAC fa:16:3e:e3:a6:76, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:18:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1b7dbf79-3e5a-4bb6-b993-98dfecd8bd54 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "63cffe58-0056-4b06-86d9-bee746c2f832" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.615s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:18:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "63cffe58-0056-4b06-86d9-bee746c2f832" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:18:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "63cffe58-0056-4b06-86d9-bee746c2f832" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:18:59 user nova-compute[75745]: INFO nova.compute.manager [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Detaching volume 9c8da1c1-2f30-4738-9ba7-f144c91f35b3
Dec 01 17:18:59 user nova-compute[75745]: INFO nova.virt.block_device [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Attempting to driver detach volume 9c8da1c1-2f30-4738-9ba7-f144c91f35b3 from mountpoint /dev/vdb
Dec 01 17:18:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Attempting to detach device vdb from instance 63cffe58-0056-4b06-86d9-bee746c2f832 from the persistent domain config. {{(pid=75745) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 17:18:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:18:59 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:18:59 user nova-compute[75745]:   <source dev="/dev/sdb"/>
Dec 01 17:18:59 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:18:59 user nova-compute[75745]:   <serial>9c8da1c1-2f30-4738-9ba7-f144c91f35b3</serial>
Dec 01 17:18:59 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 17:18:59 user nova-compute[75745]: </disk>
Dec 01 17:18:59 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:18:59 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Successfully detached device vdb from instance 63cffe58-0056-4b06-86d9-bee746c2f832 from the persistent domain config.
Dec 01 17:18:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 63cffe58-0056-4b06-86d9-bee746c2f832 from the live domain config. {{(pid=75745) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 17:18:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:18:59 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:18:59 user nova-compute[75745]:   <source dev="/dev/sdb"/>
Dec 01 17:18:59 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:18:59 user nova-compute[75745]:   <serial>9c8da1c1-2f30-4738-9ba7-f144c91f35b3</serial>
Dec 01 17:18:59 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 17:18:59 user nova-compute[75745]: </disk>
Dec 01 17:18:59 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:18:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:18:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 63cffe58-0056-4b06-86d9-bee746c2f832 {{(pid=75745) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 17:19:01 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:19:01 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:19:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-d997cdd6-67c6-4263-814a-17cf9e27bbeb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:19:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-d997cdd6-67c6-4263-814a-17cf9e27bbeb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:19:01 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:19:02 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Updating instance_info_cache with network_info: [{"id": "9d64a643-0dca-4fe1-8734-9778689292bc", "address": "fa:16:3e:e2:0c:90", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d64a643-0d", "ovs_interfaceid": "9d64a643-0dca-4fe1-8734-9778689292bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:19:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-d997cdd6-67c6-4263-814a-17cf9e27bbeb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:19:02 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:19:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:19:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:19:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:19:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:19:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:19:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:19:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:19:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:19:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:19:19 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 63cffe58-0056-4b06-86d9-bee746c2f832 is timed out.
Dec 01 17:19:19 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Successfully detached device vdb from instance 63cffe58-0056-4b06-86d9-bee746c2f832 from the live domain config.
Dec 01 17:19:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:19:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KipWPdoC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:19:19 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:19:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:19:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:19:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6017aca1-3460-4632-8fe1-21038de699c6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:19:20 user nova-compute[75745]: No targets found.
Dec 01 17:19:20 user nova-compute[75745]: iSNS:
Dec 01 17:19:20 user nova-compute[75745]: No targets found.
Dec 01 17:19:20 user nova-compute[75745]: STATIC:
Dec 01 17:19:20 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3
Dec 01 17:19:20 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:19:20 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:19:20 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6
Dec 01 17:19:20 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:19:20 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:19:20 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc
Dec 01 17:19:20 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:19:20 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:19:20 user nova-compute[75745]: FIRMWARE:
Dec 01 17:19:20 user nova-compute[75745]: No targets found.
Dec 01 17:19:20 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:19:20 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:19:20 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37d23cb-1c53-4577-a7a0-80eddce27ac8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e9d47a-e518-4b7c-a4c4-ed022499989f]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc (non-flash)
Dec 01 17:19:20 user nova-compute[75745]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3 (non-flash)
Dec 01 17:19:20 user nova-compute[75745]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6 (non-flash)
Dec 01 17:19:20 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc (non-flash)
Dec 01 17:19:20 user nova-compute[75745]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3 (non-flash)
Dec 01 17:19:20 user nova-compute[75745]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6 (non-flash)
Dec 01 17:19:20 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24e4988160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3'): ({'sdb'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Removing single pathed devices sdb {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6c4211-d5b2-4749-ad21-2996d662999b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7434ebd-fd33-45ad-b07d-a6c23de07830]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Flushing IO for device /dev/sdb {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5278f1b-811a-4415-a60b-13831e926ed4]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67e144d-26a4-43ef-b2db-7e2699c91f12]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] SCSI volumes sdb have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfc74b3-62b1-435f-a5de-85362f609c84]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4521f003-ccfc-4420-830b-a3f8d37b1021]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3, portal: 172.16.0.220,3260]
Dec 01 17:19:20 user nova-compute[75745]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3, portal: 172.16.0.220,3260] successful.
Dec 01 17:19:20 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c8da1c1-2f30-4738-9ba7-f144c91f35b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81231d4-18e1-4b09-b7ad-6ab0557f0c9c]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] <== disconnect_volume: return (314ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:19:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:19:21 user nova-compute[75745]: DEBUG nova.objects.instance [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lazy-loading 'flavor' on Instance uuid 63cffe58-0056-4b06-86d9-bee746c2f832 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:19:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5fefaea2-e845-4e7d-b82a-255ddfafea7d tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "63cffe58-0056-4b06-86d9-bee746c2f832" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.713s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:19:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "63cffe58-0056-4b06-86d9-bee746c2f832" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:19:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "63cffe58-0056-4b06-86d9-bee746c2f832" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:19:22 user nova-compute[75745]: INFO nova.compute.manager [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Detaching volume d64ffe6f-0963-4748-b9a9-e79c6856b6d6
Dec 01 17:19:22 user nova-compute[75745]: INFO nova.virt.block_device [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Attempting to driver detach volume d64ffe6f-0963-4748-b9a9-e79c6856b6d6 from mountpoint /dev/vdc
Dec 01 17:19:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Attempting to detach device vdc from instance 63cffe58-0056-4b06-86d9-bee746c2f832 from the persistent domain config. {{(pid=75745) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 17:19:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:19:22 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:19:22 user nova-compute[75745]:   <source dev="/dev/sdd"/>
Dec 01 17:19:22 user nova-compute[75745]:   <target dev="vdc" bus="virtio"/>
Dec 01 17:19:22 user nova-compute[75745]:   <serial>d64ffe6f-0963-4748-b9a9-e79c6856b6d6</serial>
Dec 01 17:19:22 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 01 17:19:22 user nova-compute[75745]: </disk>
Dec 01 17:19:22 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:19:22 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Successfully detached device vdc from instance 63cffe58-0056-4b06-86d9-bee746c2f832 from the persistent domain config.
Dec 01 17:19:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 63cffe58-0056-4b06-86d9-bee746c2f832 from the live domain config. {{(pid=75745) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 17:19:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:19:22 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:19:22 user nova-compute[75745]:   <source dev="/dev/sdd"/>
Dec 01 17:19:22 user nova-compute[75745]:   <target dev="vdc" bus="virtio"/>
Dec 01 17:19:22 user nova-compute[75745]:   <serial>d64ffe6f-0963-4748-b9a9-e79c6856b6d6</serial>
Dec 01 17:19:22 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 01 17:19:22 user nova-compute[75745]: </disk>
Dec 01 17:19:22 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:19:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 63cffe58-0056-4b06-86d9-bee746c2f832 {{(pid=75745) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 17:19:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:19:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:19:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:19:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:19:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:19:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:19:42 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 63cffe58-0056-4b06-86d9-bee746c2f832 is timed out.
Dec 01 17:19:42 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Successfully detached device vdc from instance 63cffe58-0056-4b06-86d9-bee746c2f832 from the live domain config.
Dec 01 17:19:42 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fAyejYpz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:19:42 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:19:42 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d94ed7-c673-4a66-aa05-0a841f3d3822]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:19:42 user nova-compute[75745]: No targets found.
Dec 01 17:19:42 user nova-compute[75745]: iSNS:
Dec 01 17:19:42 user nova-compute[75745]: No targets found.
Dec 01 17:19:42 user nova-compute[75745]: STATIC:
Dec 01 17:19:42 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6
Dec 01 17:19:42 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:19:42 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:19:42 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc
Dec 01 17:19:42 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:19:42 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:19:42 user nova-compute[75745]: FIRMWARE:
Dec 01 17:19:42 user nova-compute[75745]: No targets found.
Dec 01 17:19:42 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:19:42 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:19:42 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[76065234-9d15-4483-9c69-1ba6d2dae72a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b998dcf-bb9f-4d33-9fe8-74bd842b194f]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc (non-flash)
Dec 01 17:19:42 user nova-compute[75745]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6 (non-flash)
Dec 01 17:19:42 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc (non-flash)
Dec 01 17:19:42 user nova-compute[75745]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6 (non-flash)
Dec 01 17:19:42 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2498688550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6'): ({'sdd'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Removing single pathed devices sdd {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e03a45-be40-4406-9d92-adb22a608d78]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[255f9298-a744-4944-8312-34203e0eae48]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Flushing IO for device /dev/sdd {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f39b2c6-7310-49db-8bf4-465a1190c510]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.032s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c861ff6-7cb9-4edb-a272-f0a40c429829]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] SCSI volumes sdd have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad818fdc-8fb5-4a21-bfab-847b3b36c5a5]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:19:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:43 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfd2f02-3f00-4071-b651-334648f76daf]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:19:43 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6, portal: 172.16.0.220,3260]
Dec 01 17:19:43 user nova-compute[75745]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6, portal: 172.16.0.220,3260] successful.
Dec 01 17:19:43 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:19:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64ffe6f-0963-4748-b9a9-e79c6856b6d6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:43 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f67498-5abd-4079-b80e-0c7938811d39]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:19:43 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:19:43 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:19:43 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] <== disconnect_volume: return (272ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:19:43 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:19:43 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:19:43 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:19:43 user nova-compute[75745]: DEBUG nova.objects.instance [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lazy-loading 'flavor' on Instance uuid 63cffe58-0056-4b06-86d9-bee746c2f832 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:19:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d3fce7e2-afef-4368-aa75-dd9adc7b9870 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "63cffe58-0056-4b06-86d9-bee746c2f832" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.782s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:19:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:19:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:19:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:19:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:19:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:19:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:19:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8c7756d9-e913-4459-b714-2394d562d5d7 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "63cffe58-0056-4b06-86d9-bee746c2f832" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:19:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8c7756d9-e913-4459-b714-2394d562d5d7 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "63cffe58-0056-4b06-86d9-bee746c2f832" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:19:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8c7756d9-e913-4459-b714-2394d562d5d7 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "63cffe58-0056-4b06-86d9-bee746c2f832-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:19:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8c7756d9-e913-4459-b714-2394d562d5d7 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "63cffe58-0056-4b06-86d9-bee746c2f832-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:19:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8c7756d9-e913-4459-b714-2394d562d5d7 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "63cffe58-0056-4b06-86d9-bee746c2f832-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:19:45 user nova-compute[75745]: INFO nova.compute.manager [None req-8c7756d9-e913-4459-b714-2394d562d5d7 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Terminating instance
Dec 01 17:19:45 user nova-compute[75745]: DEBUG nova.compute.manager [None req-8c7756d9-e913-4459-b714-2394d562d5d7 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:19:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:19:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:19:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:19:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:19:45 user nova-compute[75745]: DEBUG nova.compute.manager [req-bb61d296-b78f-4f13-8683-50df6d5fe4f1 req-55b26b7e-db2f-4410-8f33-c1d60de3d185 service nova] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Received event network-vif-unplugged-643d0b0f-f36b-4107-8f2a-4efd9db2973a {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:19:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-bb61d296-b78f-4f13-8683-50df6d5fe4f1 req-55b26b7e-db2f-4410-8f33-c1d60de3d185 service nova] Acquiring lock "63cffe58-0056-4b06-86d9-bee746c2f832-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:19:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-bb61d296-b78f-4f13-8683-50df6d5fe4f1 req-55b26b7e-db2f-4410-8f33-c1d60de3d185 service nova] Lock "63cffe58-0056-4b06-86d9-bee746c2f832-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:19:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-bb61d296-b78f-4f13-8683-50df6d5fe4f1 req-55b26b7e-db2f-4410-8f33-c1d60de3d185 service nova] Lock "63cffe58-0056-4b06-86d9-bee746c2f832-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:19:45 user nova-compute[75745]: DEBUG nova.compute.manager [req-bb61d296-b78f-4f13-8683-50df6d5fe4f1 req-55b26b7e-db2f-4410-8f33-c1d60de3d185 service nova] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] No waiting events found dispatching network-vif-unplugged-643d0b0f-f36b-4107-8f2a-4efd9db2973a {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:19:45 user nova-compute[75745]: DEBUG nova.compute.manager [req-bb61d296-b78f-4f13-8683-50df6d5fe4f1 req-55b26b7e-db2f-4410-8f33-c1d60de3d185 service nova] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Received event network-vif-unplugged-643d0b0f-f36b-4107-8f2a-4efd9db2973a for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:19:45 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Instance destroyed successfully.
Dec 01 17:19:45 user nova-compute[75745]: DEBUG nova.objects.instance [None req-8c7756d9-e913-4459-b714-2394d562d5d7 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lazy-loading 'resources' on Instance uuid 63cffe58-0056-4b06-86d9-bee746c2f832 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:19:45 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-8c7756d9-e913-4459-b714-2394d562d5d7 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:16:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-662811475',display_name='tempest-AttachVolumeTestJSON-server-662811475',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-662811475',id=29,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcaJ8xRX+d/Sg0b7vw2KL4t+17as5hlZUvo/uJwu0cc017UFPCChc+lXLkQwr97GvTWm6mMuXXOWRHejNFICInkRHWP2GW8pGzDIvbWuIr81+KgTpsQ72ReG3zW1z7SZA==',key_name='tempest-keypair-871035478',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:16:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c4e507763844b67b588fa2509ec3aff',ramdisk_id='',reservation_id='r-u0d12hnd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-712829532',owner_user_name='tempest-AttachVolumeTestJSON-712829532-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:16:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e92e1fa18cc4bdaa17afd2b2db97259',uuid=63cffe58-0056-4b06-86d9-bee746c2f832,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "643d0b0f-f36b-4107-8f2a-4efd9db2973a", "address": "fa:16:3e:e3:a6:76", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643d0b0f-f3", "ovs_interfaceid": "643d0b0f-f36b-4107-8f2a-4efd9db2973a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:19:45 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-8c7756d9-e913-4459-b714-2394d562d5d7 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Converting VIF {"id": "643d0b0f-f36b-4107-8f2a-4efd9db2973a", "address": "fa:16:3e:e3:a6:76", "network": {"id": "b2b1c054-5370-4c64-9fb7-b98791c8f5ec", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1192205962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e507763844b67b588fa2509ec3aff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap643d0b0f-f3", "ovs_interfaceid": "643d0b0f-f36b-4107-8f2a-4efd9db2973a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:19:45 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-8c7756d9-e913-4459-b714-2394d562d5d7 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:a6:76,bridge_name='br-int',has_traffic_filtering=True,id=643d0b0f-f36b-4107-8f2a-4efd9db2973a,network=Network(b2b1c054-5370-4c64-9fb7-b98791c8f5ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap643d0b0f-f3') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:19:45 user nova-compute[75745]: DEBUG os_vif [None req-8c7756d9-e913-4459-b714-2394d562d5d7 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:a6:76,bridge_name='br-int',has_traffic_filtering=True,id=643d0b0f-f36b-4107-8f2a-4efd9db2973a,network=Network(b2b1c054-5370-4c64-9fb7-b98791c8f5ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap643d0b0f-f3') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:19:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:19:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap643d0b0f-f3, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:19:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:19:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:19:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:19:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dda851e6-42d4-4014-a86a-a1ee994495c7) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:19:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:19:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:19:46 user nova-compute[75745]: INFO os_vif [None req-8c7756d9-e913-4459-b714-2394d562d5d7 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:a6:76,bridge_name='br-int',has_traffic_filtering=True,id=643d0b0f-f36b-4107-8f2a-4efd9db2973a,network=Network(b2b1c054-5370-4c64-9fb7-b98791c8f5ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap643d0b0f-f3')
Dec 01 17:19:46 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-8c7756d9-e913-4459-b714-2394d562d5d7 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Deleting instance files /opt/stack/data/nova/instances/63cffe58-0056-4b06-86d9-bee746c2f832_del
Dec 01 17:19:46 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-8c7756d9-e913-4459-b714-2394d562d5d7 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Deletion of /opt/stack/data/nova/instances/63cffe58-0056-4b06-86d9-bee746c2f832_del complete
Dec 01 17:19:46 user nova-compute[75745]: INFO nova.compute.manager [None req-8c7756d9-e913-4459-b714-2394d562d5d7 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Took 0.98 seconds to destroy the instance on the hypervisor.
Dec 01 17:19:46 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-8c7756d9-e913-4459-b714-2394d562d5d7 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:19:46 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:19:46 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:19:46 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:19:46 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Took 0.90 seconds to deallocate network for instance.
Dec 01 17:19:47 user nova-compute[75745]: DEBUG nova.compute.manager [req-1054256d-36d1-4c0b-acc5-26791f754697 req-f426568f-e9e6-4f49-94dc-cc5b58dd326c service nova] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Received event network-vif-deleted-643d0b0f-f36b-4107-8f2a-4efd9db2973a {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:19:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8c7756d9-e913-4459-b714-2394d562d5d7 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:19:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8c7756d9-e913-4459-b714-2394d562d5d7 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:19:47 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-8c7756d9-e913-4459-b714-2394d562d5d7 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:19:47 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-8c7756d9-e913-4459-b714-2394d562d5d7 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:19:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8c7756d9-e913-4459-b714-2394d562d5d7 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:19:47 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-8c7756d9-e913-4459-b714-2394d562d5d7 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Deleted allocations for instance 63cffe58-0056-4b06-86d9-bee746c2f832
Dec 01 17:19:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8c7756d9-e913-4459-b714-2394d562d5d7 tempest-AttachVolumeTestJSON-712829532 tempest-AttachVolumeTestJSON-712829532-project-member] Lock "63cffe58-0056-4b06-86d9-bee746c2f832" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.404s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:19:47 user nova-compute[75745]: DEBUG nova.compute.manager [req-60de0b51-6370-4192-84b3-ae028f45b61e req-84e63050-1cd4-4eb6-a068-39789f2bfc98 service nova] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Received event network-vif-plugged-643d0b0f-f36b-4107-8f2a-4efd9db2973a {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:19:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-60de0b51-6370-4192-84b3-ae028f45b61e req-84e63050-1cd4-4eb6-a068-39789f2bfc98 service nova] Acquiring lock "63cffe58-0056-4b06-86d9-bee746c2f832-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:19:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-60de0b51-6370-4192-84b3-ae028f45b61e req-84e63050-1cd4-4eb6-a068-39789f2bfc98 service nova] Lock "63cffe58-0056-4b06-86d9-bee746c2f832-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:19:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-60de0b51-6370-4192-84b3-ae028f45b61e req-84e63050-1cd4-4eb6-a068-39789f2bfc98 service nova] Lock "63cffe58-0056-4b06-86d9-bee746c2f832-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:19:47 user nova-compute[75745]: DEBUG nova.compute.manager [req-60de0b51-6370-4192-84b3-ae028f45b61e req-84e63050-1cd4-4eb6-a068-39789f2bfc98 service nova] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] No waiting events found dispatching network-vif-plugged-643d0b0f-f36b-4107-8f2a-4efd9db2973a {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:19:47 user nova-compute[75745]: WARNING nova.compute.manager [req-60de0b51-6370-4192-84b3-ae028f45b61e req-84e63050-1cd4-4eb6-a068-39789f2bfc98 service nova] [instance: 63cffe58-0056-4b06-86d9-bee746c2f832] Received unexpected event network-vif-plugged-643d0b0f-f36b-4107-8f2a-4efd9db2973a for instance with vm_state deleted and task_state None.
Dec 01 17:19:48 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:19:49 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:19:49 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:19:49 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:19:49 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:19:49 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:19:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:19:51 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:19:51 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:19:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:19:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:19:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:19:51 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:19:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0959ad6-3d88-47d7-bf74-58fcb727fb3e/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0959ad6-3d88-47d7-bf74-58fcb727fb3e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0959ad6-3d88-47d7-bf74-58fcb727fb3e/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "9aca117f-581a-4625-abf1-c7faba669572" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:19:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "9aca117f-581a-4625-abf1-c7faba669572" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:19:53 user nova-compute[75745]: INFO nova.compute.manager [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Detaching volume da9f9e8e-5434-4610-aab3-51748fb3b8fc
Dec 01 17:19:53 user nova-compute[75745]: INFO nova.virt.block_device [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Attempting to driver detach volume da9f9e8e-5434-4610-aab3-51748fb3b8fc from mountpoint /dev/vdb
Dec 01 17:19:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Attempting to detach device vdb from instance 9aca117f-581a-4625-abf1-c7faba669572 from the persistent domain config. {{(pid=75745) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 17:19:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:19:53 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:19:53 user nova-compute[75745]:   <source dev="/dev/sdc"/>
Dec 01 17:19:53 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:19:53 user nova-compute[75745]:   <serial>da9f9e8e-5434-4610-aab3-51748fb3b8fc</serial>
Dec 01 17:19:53 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 01 17:19:53 user nova-compute[75745]: </disk>
Dec 01 17:19:53 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:19:53 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Successfully detached device vdb from instance 9aca117f-581a-4625-abf1-c7faba669572 from the persistent domain config.
Dec 01 17:19:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9aca117f-581a-4625-abf1-c7faba669572 from the live domain config. {{(pid=75745) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 17:19:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:19:53 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:19:53 user nova-compute[75745]:   <source dev="/dev/sdc"/>
Dec 01 17:19:53 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:19:53 user nova-compute[75745]:   <serial>da9f9e8e-5434-4610-aab3-51748fb3b8fc</serial>
Dec 01 17:19:53 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 01 17:19:53 user nova-compute[75745]: </disk>
Dec 01 17:19:53 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:19:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0959ad6-3d88-47d7-bf74-58fcb727fb3e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:19:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9aca117f-581a-4625-abf1-c7faba669572 {{(pid=75745) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 17:19:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:19:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:19:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:19:56 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:19:56 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:19:56 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=7905MB free_disk=25.360015869140625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:19:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:19:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:19:56 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance d997cdd6-67c6-4263-814a-17cf9e27bbeb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:19:56 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 0ab0c115-74aa-4e55-92a3-6fa91ba753e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:19:56 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance e4ffb96e-456c-4fb9-9850-9e98310d63e5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:19:56 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 80962f79-dbb2-4380-b2c8-791642cfa86b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:19:56 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance a690fa65-078d-4ffd-bc62-3366aaa3d681 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:19:56 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 9aca117f-581a-4625-abf1-c7faba669572 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:19:56 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance e0959ad6-3d88-47d7-bf74-58fcb727fb3e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:19:56 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 5e631ac3-8122-46a3-a54f-2395c0f7cf7c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:19:56 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:19:56 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:19:56 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:19:56 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:19:56 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:19:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.399s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:20:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:20:02 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:20:02 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:20:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-0ab0c115-74aa-4e55-92a3-6fa91ba753e3" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:20:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-0ab0c115-74aa-4e55-92a3-6fa91ba753e3" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:20:02 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:20:03 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Updating instance_info_cache with network_info: [{"id": "030e12c5-9662-4774-a9fc-5073144043f0", "address": "fa:16:3e:f5:29:5f", "network": {"id": "636c0eca-05bf-45a8-a587-9f9a43f430e8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-52821118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f601b29e4ec41cba8048a7c999ccdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030e12c5-96", "ovs_interfaceid": "030e12c5-9662-4774-a9fc-5073144043f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:20:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-0ab0c115-74aa-4e55-92a3-6fa91ba753e3" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:20:03 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:20:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:20:08 user nova-compute[75745]: DEBUG nova.compute.manager [None req-2d81aba2-1f3e-409c-98ec-a6ecd5990508 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:20:08 user nova-compute[75745]: INFO nova.compute.manager [None req-2d81aba2-1f3e-409c-98ec-a6ecd5990508 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] instance snapshotting
Dec 01 17:20:08 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-2d81aba2-1f3e-409c-98ec-a6ecd5990508 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Beginning live snapshot process
Dec 01 17:20:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2d81aba2-1f3e-409c-98ec-a6ecd5990508 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json -f qcow2 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:20:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2d81aba2-1f3e-409c-98ec-a6ecd5990508 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json -f qcow2" returned: 0 in 0.188s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:20:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2d81aba2-1f3e-409c-98ec-a6ecd5990508 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json -f qcow2 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:20:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2d81aba2-1f3e-409c-98ec-a6ecd5990508 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json -f qcow2" returned: 0 in 0.218s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:20:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2d81aba2-1f3e-409c-98ec-a6ecd5990508 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:20:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2d81aba2-1f3e-409c-98ec-a6ecd5990508 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.181s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:20:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2d81aba2-1f3e-409c-98ec-a6ecd5990508 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpw0tr8qbz/11923ddebe754a74b1bd2a73c8ed02dd.delta 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:20:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2d81aba2-1f3e-409c-98ec-a6ecd5990508 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpw0tr8qbz/11923ddebe754a74b1bd2a73c8ed02dd.delta 1073741824" returned: 0 in 0.050s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:20:09 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-2d81aba2-1f3e-409c-98ec-a6ecd5990508 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Quiescing instance not available: QEMU guest agent is not enabled.
Dec 01 17:20:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-2d81aba2-1f3e-409c-98ec-a6ecd5990508 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75745) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 17:20:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-2d81aba2-1f3e-409c-98ec-a6ecd5990508 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75745) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 17:20:10 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-2d81aba2-1f3e-409c-98ec-a6ecd5990508 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 01 17:20:10 user nova-compute[75745]: DEBUG nova.privsep.utils [None req-2d81aba2-1f3e-409c-98ec-a6ecd5990508 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75745) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 17:20:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2d81aba2-1f3e-409c-98ec-a6ecd5990508 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpw0tr8qbz/11923ddebe754a74b1bd2a73c8ed02dd.delta /opt/stack/data/nova/instances/snapshots/tmpw0tr8qbz/11923ddebe754a74b1bd2a73c8ed02dd {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:20:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2d81aba2-1f3e-409c-98ec-a6ecd5990508 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpw0tr8qbz/11923ddebe754a74b1bd2a73c8ed02dd.delta /opt/stack/data/nova/instances/snapshots/tmpw0tr8qbz/11923ddebe754a74b1bd2a73c8ed02dd" returned: 0 in 0.598s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:20:11 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-2d81aba2-1f3e-409c-98ec-a6ecd5990508 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Snapshot extracted, beginning image upload
Dec 01 17:20:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:14 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-2d81aba2-1f3e-409c-98ec-a6ecd5990508 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Snapshot image upload complete
Dec 01 17:20:14 user nova-compute[75745]: INFO nova.compute.manager [None req-2d81aba2-1f3e-409c-98ec-a6ecd5990508 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Took 5.45 seconds to snapshot the instance on the hypervisor.
Dec 01 17:20:14 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9aca117f-581a-4625-abf1-c7faba669572 is timed out.
Dec 01 17:20:14 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Successfully detached device vdb from instance 9aca117f-581a-4625-abf1-c7faba669572 from the live domain config.
Dec 01 17:20:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMKyIbSf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:20:14 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:20:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[586b4840-3634-4518-91d3-51813d169842]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:20:14 user nova-compute[75745]: No targets found.
Dec 01 17:20:14 user nova-compute[75745]: iSNS:
Dec 01 17:20:14 user nova-compute[75745]: No targets found.
Dec 01 17:20:14 user nova-compute[75745]: STATIC:
Dec 01 17:20:14 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc
Dec 01 17:20:14 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:20:14 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:20:14 user nova-compute[75745]: FIRMWARE:
Dec 01 17:20:14 user nova-compute[75745]: No targets found.
Dec 01 17:20:14 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:20:14 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:20:14 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b523431-d746-49a2-b725-2430699238d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca7c6c2-82fc-4aa6-bb01-953b309843bc]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc (non-flash)
Dec 01 17:20:14 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc (non-flash)
Dec 01 17:20:14 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f249870e4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc'): ({'sdc'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Removing single pathed devices sdc {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf033e22-a3fa-421f-b2a0-d8b7fa461c71]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b77c13-6956-413f-a9cf-cd58731b977b]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Flushing IO for device /dev/sdc {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c762f1-2a82-4e7d-81d0-d75787878337]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c4f6a3-001b-4466-9cd7-1bdccdf733fe]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] SCSI volumes sdc have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e9a492-da08-4791-b99a-e34e552960f3]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b909b2e-8cf1-4737-b1f8-d74d7331cb44]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc, portal: 172.16.0.220,3260]
Dec 01 17:20:14 user nova-compute[75745]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc, portal: 172.16.0.220,3260] successful.
Dec 01 17:20:14 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9f9e8e-5434-4610-aab3-51748fb3b8fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[15424815-a168-435b-a2c1-aec2f959b0c8]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] <== disconnect_volume: return (311ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:20:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:15 user nova-compute[75745]: DEBUG nova.objects.instance [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lazy-loading 'flavor' on Instance uuid 9aca117f-581a-4625-abf1-c7faba669572 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:20:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c060e85e-b25b-46aa-8110-4fbdc8ba03c7 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "9aca117f-581a-4625-abf1-c7faba669572" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.881s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:20:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:20:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:20:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:20:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:20:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:20:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Acquiring lock "b41b0b06-5f6d-4985-9f11-842f678ad1e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:20:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "b41b0b06-5f6d-4985-9f11-842f678ad1e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:20:26 user nova-compute[75745]: DEBUG nova.compute.manager [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:20:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:20:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:20:26 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:20:26 user nova-compute[75745]: INFO nova.compute.claims [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Claim successful on node user
Dec 01 17:20:26 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:20:27 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:20:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.446s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:20:27 user nova-compute[75745]: DEBUG nova.compute.manager [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:20:27 user nova-compute[75745]: DEBUG nova.compute.manager [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:20:27 user nova-compute[75745]: DEBUG nova.network.neutron [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:20:27 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:20:27 user nova-compute[75745]: DEBUG nova.compute.manager [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:20:27 user nova-compute[75745]: DEBUG nova.policy [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dc207653aa7c407f92a01ba7cfe89572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5ee303033640e7adebbc0c949be9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:20:27 user nova-compute[75745]: DEBUG nova.compute.manager [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:20:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:20:27 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Creating image(s)
Dec 01 17:20:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Acquiring lock "/opt/stack/data/nova/instances/b41b0b06-5f6d-4985-9f11-842f678ad1e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:20:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "/opt/stack/data/nova/instances/b41b0b06-5f6d-4985-9f11-842f678ad1e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:20:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "/opt/stack/data/nova/instances/b41b0b06-5f6d-4985-9f11-842f678ad1e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:20:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:20:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.172s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:20:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:20:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:20:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:20:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.169s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:20:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/b41b0b06-5f6d-4985-9f11-842f678ad1e6/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:20:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/b41b0b06-5f6d-4985-9f11-842f678ad1e6/disk 1073741824" returned: 0 in 0.072s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:20:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:20:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:20:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.175s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:20:27 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b41b0b06-5f6d-4985-9f11-842f678ad1e6/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:20:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41b0b06-5f6d-4985-9f11-842f678ad1e6/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:20:28 user nova-compute[75745]: DEBUG nova.network.neutron [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Successfully created port: 05ab914d-2ae5-44a9-9d2c-41d968056d8f {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:20:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41b0b06-5f6d-4985-9f11-842f678ad1e6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:20:28 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Cannot resize image /opt/stack/data/nova/instances/b41b0b06-5f6d-4985-9f11-842f678ad1e6/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:20:28 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:20:28 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Ensure instance console log exists: /opt/stack/data/nova/instances/b41b0b06-5f6d-4985-9f11-842f678ad1e6/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:20:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:20:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:20:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:20:28 user nova-compute[75745]: DEBUG nova.network.neutron [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Successfully updated port: 05ab914d-2ae5-44a9-9d2c-41d968056d8f {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:20:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Acquiring lock "refresh_cache-b41b0b06-5f6d-4985-9f11-842f678ad1e6" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:20:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Acquired lock "refresh_cache-b41b0b06-5f6d-4985-9f11-842f678ad1e6" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:20:28 user nova-compute[75745]: DEBUG nova.network.neutron [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:20:28 user nova-compute[75745]: DEBUG nova.compute.manager [req-e8051cb3-68d3-4420-90ab-dfed04198a45 req-0642eaab-d2eb-4cf0-bfb4-dc11a88ee5e3 service nova] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Received event network-changed-05ab914d-2ae5-44a9-9d2c-41d968056d8f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:20:28 user nova-compute[75745]: DEBUG nova.compute.manager [req-e8051cb3-68d3-4420-90ab-dfed04198a45 req-0642eaab-d2eb-4cf0-bfb4-dc11a88ee5e3 service nova] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Refreshing instance network info cache due to event network-changed-05ab914d-2ae5-44a9-9d2c-41d968056d8f. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:20:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e8051cb3-68d3-4420-90ab-dfed04198a45 req-0642eaab-d2eb-4cf0-bfb4-dc11a88ee5e3 service nova] Acquiring lock "refresh_cache-b41b0b06-5f6d-4985-9f11-842f678ad1e6" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:20:28 user nova-compute[75745]: DEBUG nova.network.neutron [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG nova.network.neutron [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Updating instance_info_cache with network_info: [{"id": "05ab914d-2ae5-44a9-9d2c-41d968056d8f", "address": "fa:16:3e:1a:39:b9", "network": {"id": "ccf83dac-fecd-4f65-baf8-740ff63f51a0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-804694060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5ee303033640e7adebbc0c949be9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ab914d-2a", "ovs_interfaceid": "05ab914d-2ae5-44a9-9d2c-41d968056d8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Releasing lock "refresh_cache-b41b0b06-5f6d-4985-9f11-842f678ad1e6" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG nova.compute.manager [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Instance network_info: |[{"id": "05ab914d-2ae5-44a9-9d2c-41d968056d8f", "address": "fa:16:3e:1a:39:b9", "network": {"id": "ccf83dac-fecd-4f65-baf8-740ff63f51a0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-804694060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5ee303033640e7adebbc0c949be9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ab914d-2a", "ovs_interfaceid": "05ab914d-2ae5-44a9-9d2c-41d968056d8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e8051cb3-68d3-4420-90ab-dfed04198a45 req-0642eaab-d2eb-4cf0-bfb4-dc11a88ee5e3 service nova] Acquired lock "refresh_cache-b41b0b06-5f6d-4985-9f11-842f678ad1e6" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG nova.network.neutron [req-e8051cb3-68d3-4420-90ab-dfed04198a45 req-0642eaab-d2eb-4cf0-bfb4-dc11a88ee5e3 service nova] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Refreshing network info cache for port 05ab914d-2ae5-44a9-9d2c-41d968056d8f {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Start _get_guest_xml network_info=[{"id": "05ab914d-2ae5-44a9-9d2c-41d968056d8f", "address": "fa:16:3e:1a:39:b9", "network": {"id": "ccf83dac-fecd-4f65-baf8-740ff63f51a0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-804694060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5ee303033640e7adebbc0c949be9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ab914d-2a", "ovs_interfaceid": "05ab914d-2ae5-44a9-9d2c-41d968056d8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:20:29 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:20:29 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:20:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:20:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1273692104',display_name='tempest-VolumesSnapshotTestJSON-instance-1273692104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1273692104',id=31,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLU9spMA9DkIPuYlz6a8/cmHYfhZPwjDtvajCOW1rTWWN6ssszNfcR+1l21qY0kJE5gm2muPcvwIVXqVmGLUMoXRvcR2+hZi+jgG+PNMzC8x3bHP7tUcDNcW9wxGeqYJzA==',key_name='tempest-keypair-394183901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c5ee303033640e7adebbc0c949be9cc',ramdisk_id='',reservation_id='r-ikir68jd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1764036907',owner_user_name='tempest-VolumesSnapshotTestJSON-1764036907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:20:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc207653aa7c407f92a01ba7cfe89572',uuid=b41b0b06-5f6d-4985-9f11-842f678ad1e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05ab914d-2ae5-44a9-9d2c-41d968056d8f", "address": "fa:16:3e:1a:39:b9", "network": {"id": "ccf83dac-fecd-4f65-baf8-740ff63f51a0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-804694060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5ee303033640e7adebbc0c949be9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ab914d-2a", "ovs_interfaceid": "05ab914d-2ae5-44a9-9d2c-41d968056d8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Converting VIF {"id": "05ab914d-2ae5-44a9-9d2c-41d968056d8f", "address": "fa:16:3e:1a:39:b9", "network": {"id": "ccf83dac-fecd-4f65-baf8-740ff63f51a0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-804694060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5ee303033640e7adebbc0c949be9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ab914d-2a", "ovs_interfaceid": "05ab914d-2ae5-44a9-9d2c-41d968056d8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:39:b9,bridge_name='br-int',has_traffic_filtering=True,id=05ab914d-2ae5-44a9-9d2c-41d968056d8f,network=Network(ccf83dac-fecd-4f65-baf8-740ff63f51a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05ab914d-2a') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG nova.objects.instance [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lazy-loading 'pci_devices' on Instance uuid b41b0b06-5f6d-4985-9f11-842f678ad1e6 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:20:29 user nova-compute[75745]:   <uuid>b41b0b06-5f6d-4985-9f11-842f678ad1e6</uuid>
Dec 01 17:20:29 user nova-compute[75745]:   <name>instance-0000001f</name>
Dec 01 17:20:29 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:20:29 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:20:29 user nova-compute[75745]:   <metadata>
Dec 01 17:20:29 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:20:29 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:20:29 user nova-compute[75745]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1273692104</nova:name>
Dec 01 17:20:29 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:20:29</nova:creationTime>
Dec 01 17:20:29 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:20:29 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:20:29 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:20:29 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:20:29 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:20:29 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:20:29 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:20:29 user nova-compute[75745]:       <nova:owner>
Dec 01 17:20:29 user nova-compute[75745]:         <nova:user uuid="dc207653aa7c407f92a01ba7cfe89572">tempest-VolumesSnapshotTestJSON-1764036907-project-member</nova:user>
Dec 01 17:20:29 user nova-compute[75745]:         <nova:project uuid="2c5ee303033640e7adebbc0c949be9cc">tempest-VolumesSnapshotTestJSON-1764036907</nova:project>
Dec 01 17:20:29 user nova-compute[75745]:       </nova:owner>
Dec 01 17:20:29 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:20:29 user nova-compute[75745]:       <nova:ports>
Dec 01 17:20:29 user nova-compute[75745]:         <nova:port uuid="05ab914d-2ae5-44a9-9d2c-41d968056d8f">
Dec 01 17:20:29 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 01 17:20:29 user nova-compute[75745]:         </nova:port>
Dec 01 17:20:29 user nova-compute[75745]:       </nova:ports>
Dec 01 17:20:29 user nova-compute[75745]:     </nova:instance>
Dec 01 17:20:29 user nova-compute[75745]:   </metadata>
Dec 01 17:20:29 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:20:29 user nova-compute[75745]:     <system>
Dec 01 17:20:29 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:20:29 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:20:29 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:20:29 user nova-compute[75745]:       <entry name="serial">b41b0b06-5f6d-4985-9f11-842f678ad1e6</entry>
Dec 01 17:20:29 user nova-compute[75745]:       <entry name="uuid">b41b0b06-5f6d-4985-9f11-842f678ad1e6</entry>
Dec 01 17:20:29 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:20:29 user nova-compute[75745]:     </system>
Dec 01 17:20:29 user nova-compute[75745]:   </sysinfo>
Dec 01 17:20:29 user nova-compute[75745]:   <os>
Dec 01 17:20:29 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:20:29 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:20:29 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:20:29 user nova-compute[75745]:   </os>
Dec 01 17:20:29 user nova-compute[75745]:   <features>
Dec 01 17:20:29 user nova-compute[75745]:     <acpi/>
Dec 01 17:20:29 user nova-compute[75745]:     <apic/>
Dec 01 17:20:29 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:20:29 user nova-compute[75745]:   </features>
Dec 01 17:20:29 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:20:29 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:20:29 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:20:29 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:20:29 user nova-compute[75745]:   </clock>
Dec 01 17:20:29 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:20:29 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:20:29 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:20:29 user nova-compute[75745]:   </cpu>
Dec 01 17:20:29 user nova-compute[75745]:   <devices>
Dec 01 17:20:29 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:20:29 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:20:29 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/b41b0b06-5f6d-4985-9f11-842f678ad1e6/disk"/>
Dec 01 17:20:29 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:20:29 user nova-compute[75745]:     </disk>
Dec 01 17:20:29 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:20:29 user nova-compute[75745]:       <mac address="fa:16:3e:1a:39:b9"/>
Dec 01 17:20:29 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:20:29 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:20:29 user nova-compute[75745]:       <target dev="tap05ab914d-2a"/>
Dec 01 17:20:29 user nova-compute[75745]:     </interface>
Dec 01 17:20:29 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:20:29 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/b41b0b06-5f6d-4985-9f11-842f678ad1e6/console.log" append="off"/>
Dec 01 17:20:29 user nova-compute[75745]:     </serial>
Dec 01 17:20:29 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:20:29 user nova-compute[75745]:     <video>
Dec 01 17:20:29 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:20:29 user nova-compute[75745]:     </video>
Dec 01 17:20:29 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:20:29 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:20:29 user nova-compute[75745]:     </rng>
Dec 01 17:20:29 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:20:29 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:20:29 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:20:29 user nova-compute[75745]:     </memballoon>
Dec 01 17:20:29 user nova-compute[75745]:   </devices>
Dec 01 17:20:29 user nova-compute[75745]: </domain>
Dec 01 17:20:29 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:20:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1273692104',display_name='tempest-VolumesSnapshotTestJSON-instance-1273692104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1273692104',id=31,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLU9spMA9DkIPuYlz6a8/cmHYfhZPwjDtvajCOW1rTWWN6ssszNfcR+1l21qY0kJE5gm2muPcvwIVXqVmGLUMoXRvcR2+hZi+jgG+PNMzC8x3bHP7tUcDNcW9wxGeqYJzA==',key_name='tempest-keypair-394183901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c5ee303033640e7adebbc0c949be9cc',ramdisk_id='',reservation_id='r-ikir68jd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1764036907',owner_user_name='tempest-VolumesSnapshotTestJSON-1764036907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:20:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc207653aa7c407f92a01ba7cfe89572',uuid=b41b0b06-5f6d-4985-9f11-842f678ad1e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05ab914d-2ae5-44a9-9d2c-41d968056d8f", "address": "fa:16:3e:1a:39:b9", "network": {"id": "ccf83dac-fecd-4f65-baf8-740ff63f51a0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-804694060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5ee303033640e7adebbc0c949be9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ab914d-2a", "ovs_interfaceid": "05ab914d-2ae5-44a9-9d2c-41d968056d8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Converting VIF {"id": "05ab914d-2ae5-44a9-9d2c-41d968056d8f", "address": "fa:16:3e:1a:39:b9", "network": {"id": "ccf83dac-fecd-4f65-baf8-740ff63f51a0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-804694060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5ee303033640e7adebbc0c949be9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ab914d-2a", "ovs_interfaceid": "05ab914d-2ae5-44a9-9d2c-41d968056d8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:39:b9,bridge_name='br-int',has_traffic_filtering=True,id=05ab914d-2ae5-44a9-9d2c-41d968056d8f,network=Network(ccf83dac-fecd-4f65-baf8-740ff63f51a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05ab914d-2a') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG os_vif [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:39:b9,bridge_name='br-int',has_traffic_filtering=True,id=05ab914d-2ae5-44a9-9d2c-41d968056d8f,network=Network(ccf83dac-fecd-4f65-baf8-740ff63f51a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05ab914d-2a') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a75a26b8-f4b1-5c3a-9557-0ce28db20840', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05ab914d-2a, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap05ab914d-2a, col_values=(('qos', UUID('a3c76660-57dc-4431-a523-fe9dad77e0f6')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap05ab914d-2a, col_values=(('external_ids', {'iface-id': '05ab914d-2ae5-44a9-9d2c-41d968056d8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:39:b9', 'vm-uuid': 'b41b0b06-5f6d-4985-9f11-842f678ad1e6'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:29 user nova-compute[75745]: INFO os_vif [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:39:b9,bridge_name='br-int',has_traffic_filtering=True,id=05ab914d-2ae5-44a9-9d2c-41d968056d8f,network=Network(ccf83dac-fecd-4f65-baf8-740ff63f51a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05ab914d-2a')
Dec 01 17:20:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] No VIF found with MAC fa:16:3e:1a:39:b9, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG nova.network.neutron [req-e8051cb3-68d3-4420-90ab-dfed04198a45 req-0642eaab-d2eb-4cf0-bfb4-dc11a88ee5e3 service nova] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Updated VIF entry in instance network info cache for port 05ab914d-2ae5-44a9-9d2c-41d968056d8f. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG nova.network.neutron [req-e8051cb3-68d3-4420-90ab-dfed04198a45 req-0642eaab-d2eb-4cf0-bfb4-dc11a88ee5e3 service nova] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Updating instance_info_cache with network_info: [{"id": "05ab914d-2ae5-44a9-9d2c-41d968056d8f", "address": "fa:16:3e:1a:39:b9", "network": {"id": "ccf83dac-fecd-4f65-baf8-740ff63f51a0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-804694060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5ee303033640e7adebbc0c949be9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ab914d-2a", "ovs_interfaceid": "05ab914d-2ae5-44a9-9d2c-41d968056d8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e8051cb3-68d3-4420-90ab-dfed04198a45 req-0642eaab-d2eb-4cf0-bfb4-dc11a88ee5e3 service nova] Releasing lock "refresh_cache-b41b0b06-5f6d-4985-9f11-842f678ad1e6" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:20:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:30 user nova-compute[75745]: DEBUG nova.compute.manager [req-e2c669ba-d88e-44f7-b4aa-8990744e2c9b req-c8763833-d7f5-464e-a3a5-fc1819ce333a service nova] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Received event network-vif-plugged-05ab914d-2ae5-44a9-9d2c-41d968056d8f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:20:30 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e2c669ba-d88e-44f7-b4aa-8990744e2c9b req-c8763833-d7f5-464e-a3a5-fc1819ce333a service nova] Acquiring lock "b41b0b06-5f6d-4985-9f11-842f678ad1e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:20:30 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e2c669ba-d88e-44f7-b4aa-8990744e2c9b req-c8763833-d7f5-464e-a3a5-fc1819ce333a service nova] Lock "b41b0b06-5f6d-4985-9f11-842f678ad1e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:20:30 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e2c669ba-d88e-44f7-b4aa-8990744e2c9b req-c8763833-d7f5-464e-a3a5-fc1819ce333a service nova] Lock "b41b0b06-5f6d-4985-9f11-842f678ad1e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:20:30 user nova-compute[75745]: DEBUG nova.compute.manager [req-e2c669ba-d88e-44f7-b4aa-8990744e2c9b req-c8763833-d7f5-464e-a3a5-fc1819ce333a service nova] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] No waiting events found dispatching network-vif-plugged-05ab914d-2ae5-44a9-9d2c-41d968056d8f {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:20:30 user nova-compute[75745]: WARNING nova.compute.manager [req-e2c669ba-d88e-44f7-b4aa-8990744e2c9b req-c8763833-d7f5-464e-a3a5-fc1819ce333a service nova] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Received unexpected event network-vif-plugged-05ab914d-2ae5-44a9-9d2c-41d968056d8f for instance with vm_state building and task_state spawning.
Dec 01 17:20:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:32 user nova-compute[75745]: DEBUG nova.compute.manager [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:20:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:20:32 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Instance spawned successfully.
Dec 01 17:20:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:20:32 user nova-compute[75745]: DEBUG nova.compute.manager [req-ab3f36b7-fbd6-40c3-9bd8-b4cd6d2e04d3 req-a6131510-7ef9-4f5d-93d1-38256af04786 service nova] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Received event network-vif-plugged-05ab914d-2ae5-44a9-9d2c-41d968056d8f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:20:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ab3f36b7-fbd6-40c3-9bd8-b4cd6d2e04d3 req-a6131510-7ef9-4f5d-93d1-38256af04786 service nova] Acquiring lock "b41b0b06-5f6d-4985-9f11-842f678ad1e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:20:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ab3f36b7-fbd6-40c3-9bd8-b4cd6d2e04d3 req-a6131510-7ef9-4f5d-93d1-38256af04786 service nova] Lock "b41b0b06-5f6d-4985-9f11-842f678ad1e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:20:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ab3f36b7-fbd6-40c3-9bd8-b4cd6d2e04d3 req-a6131510-7ef9-4f5d-93d1-38256af04786 service nova] Lock "b41b0b06-5f6d-4985-9f11-842f678ad1e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:20:32 user nova-compute[75745]: DEBUG nova.compute.manager [req-ab3f36b7-fbd6-40c3-9bd8-b4cd6d2e04d3 req-a6131510-7ef9-4f5d-93d1-38256af04786 service nova] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] No waiting events found dispatching network-vif-plugged-05ab914d-2ae5-44a9-9d2c-41d968056d8f {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:20:32 user nova-compute[75745]: WARNING nova.compute.manager [req-ab3f36b7-fbd6-40c3-9bd8-b4cd6d2e04d3 req-a6131510-7ef9-4f5d-93d1-38256af04786 service nova] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Received unexpected event network-vif-plugged-05ab914d-2ae5-44a9-9d2c-41d968056d8f for instance with vm_state building and task_state spawning.
Dec 01 17:20:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:20:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:20:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:20:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:20:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:20:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:20:32 user nova-compute[75745]: INFO nova.compute.manager [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Took 5.67 seconds to spawn the instance on the hypervisor.
Dec 01 17:20:32 user nova-compute[75745]: DEBUG nova.compute.manager [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:20:33 user nova-compute[75745]: INFO nova.compute.manager [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Took 6.45 seconds to build instance.
Dec 01 17:20:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-79307f37-e90a-4259-bb8d-60d9c6c806ce tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "b41b0b06-5f6d-4985-9f11-842f678ad1e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.564s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:20:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:40 user nova-compute[75745]: INFO nova.compute.manager [None req-5839a59a-c00c-43a0-991b-3a6d5697d971 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Unrescuing
Dec 01 17:20:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5839a59a-c00c-43a0-991b-3a6d5697d971 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "refresh_cache-e4ffb96e-456c-4fb9-9850-9e98310d63e5" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:20:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5839a59a-c00c-43a0-991b-3a6d5697d971 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquired lock "refresh_cache-e4ffb96e-456c-4fb9-9850-9e98310d63e5" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:20:40 user nova-compute[75745]: DEBUG nova.network.neutron [None req-5839a59a-c00c-43a0-991b-3a6d5697d971 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:20:40 user nova-compute[75745]: DEBUG nova.network.neutron [None req-5839a59a-c00c-43a0-991b-3a6d5697d971 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Updating instance_info_cache with network_info: [{"id": "ebf45b7a-1ee5-43d6-9940-0ca049c95d71", "address": "fa:16:3e:39:c0:e3", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf45b7a-1e", "ovs_interfaceid": "ebf45b7a-1ee5-43d6-9940-0ca049c95d71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:20:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5839a59a-c00c-43a0-991b-3a6d5697d971 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Releasing lock "refresh_cache-e4ffb96e-456c-4fb9-9850-9e98310d63e5" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:20:40 user nova-compute[75745]: DEBUG nova.objects.instance [None req-5839a59a-c00c-43a0-991b-3a6d5697d971 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lazy-loading 'flavor' on Instance uuid e4ffb96e-456c-4fb9-9850-9e98310d63e5 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:20:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:40 user nova-compute[75745]: DEBUG nova.compute.manager [req-a9d52ad4-6692-4c80-894d-ce6eb2bc3464 req-662d64fb-8617-4d43-817d-8ac95fc8fde9 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Received event network-vif-unplugged-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:20:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a9d52ad4-6692-4c80-894d-ce6eb2bc3464 req-662d64fb-8617-4d43-817d-8ac95fc8fde9 service nova] Acquiring lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:20:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a9d52ad4-6692-4c80-894d-ce6eb2bc3464 req-662d64fb-8617-4d43-817d-8ac95fc8fde9 service nova] Lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:20:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a9d52ad4-6692-4c80-894d-ce6eb2bc3464 req-662d64fb-8617-4d43-817d-8ac95fc8fde9 service nova] Lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:20:40 user nova-compute[75745]: DEBUG nova.compute.manager [req-a9d52ad4-6692-4c80-894d-ce6eb2bc3464 req-662d64fb-8617-4d43-817d-8ac95fc8fde9 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] No waiting events found dispatching network-vif-unplugged-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:20:40 user nova-compute[75745]: WARNING nova.compute.manager [req-a9d52ad4-6692-4c80-894d-ce6eb2bc3464 req-662d64fb-8617-4d43-817d-8ac95fc8fde9 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Received unexpected event network-vif-unplugged-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 for instance with vm_state rescued and task_state unrescuing.
Dec 01 17:20:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:41 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Instance destroyed successfully.
Dec 01 17:20:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:42 user nova-compute[75745]: DEBUG nova.compute.manager [req-e71cefd0-4cbc-4b55-8a42-71f8d761025e req-a7aab3f9-ec6d-4ad5-b531-da49ce2aa090 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Received event network-vif-plugged-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:20:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e71cefd0-4cbc-4b55-8a42-71f8d761025e req-a7aab3f9-ec6d-4ad5-b531-da49ce2aa090 service nova] Acquiring lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:20:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e71cefd0-4cbc-4b55-8a42-71f8d761025e req-a7aab3f9-ec6d-4ad5-b531-da49ce2aa090 service nova] Lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:20:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e71cefd0-4cbc-4b55-8a42-71f8d761025e req-a7aab3f9-ec6d-4ad5-b531-da49ce2aa090 service nova] Lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:20:42 user nova-compute[75745]: DEBUG nova.compute.manager [req-e71cefd0-4cbc-4b55-8a42-71f8d761025e req-a7aab3f9-ec6d-4ad5-b531-da49ce2aa090 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] No waiting events found dispatching network-vif-plugged-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:20:42 user nova-compute[75745]: WARNING nova.compute.manager [req-e71cefd0-4cbc-4b55-8a42-71f8d761025e req-a7aab3f9-ec6d-4ad5-b531-da49ce2aa090 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Received unexpected event network-vif-plugged-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 for instance with vm_state rescued and task_state unrescuing.
Dec 01 17:20:42 user nova-compute[75745]: DEBUG nova.compute.manager [req-e71cefd0-4cbc-4b55-8a42-71f8d761025e req-a7aab3f9-ec6d-4ad5-b531-da49ce2aa090 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Received event network-vif-plugged-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:20:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e71cefd0-4cbc-4b55-8a42-71f8d761025e req-a7aab3f9-ec6d-4ad5-b531-da49ce2aa090 service nova] Acquiring lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:20:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e71cefd0-4cbc-4b55-8a42-71f8d761025e req-a7aab3f9-ec6d-4ad5-b531-da49ce2aa090 service nova] Lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:20:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e71cefd0-4cbc-4b55-8a42-71f8d761025e req-a7aab3f9-ec6d-4ad5-b531-da49ce2aa090 service nova] Lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:20:42 user nova-compute[75745]: DEBUG nova.compute.manager [req-e71cefd0-4cbc-4b55-8a42-71f8d761025e req-a7aab3f9-ec6d-4ad5-b531-da49ce2aa090 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] No waiting events found dispatching network-vif-plugged-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:20:42 user nova-compute[75745]: WARNING nova.compute.manager [req-e71cefd0-4cbc-4b55-8a42-71f8d761025e req-a7aab3f9-ec6d-4ad5-b531-da49ce2aa090 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Received unexpected event network-vif-plugged-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 for instance with vm_state rescued and task_state unrescuing.
Dec 01 17:20:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6c24f0c7-7a00-4d1b-93d4-21d779edb285 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "9aca117f-581a-4625-abf1-c7faba669572" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:20:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6c24f0c7-7a00-4d1b-93d4-21d779edb285 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "9aca117f-581a-4625-abf1-c7faba669572" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:20:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6c24f0c7-7a00-4d1b-93d4-21d779edb285 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "9aca117f-581a-4625-abf1-c7faba669572-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:20:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6c24f0c7-7a00-4d1b-93d4-21d779edb285 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "9aca117f-581a-4625-abf1-c7faba669572-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:20:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6c24f0c7-7a00-4d1b-93d4-21d779edb285 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "9aca117f-581a-4625-abf1-c7faba669572-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:20:43 user nova-compute[75745]: INFO nova.compute.manager [None req-6c24f0c7-7a00-4d1b-93d4-21d779edb285 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Terminating instance
Dec 01 17:20:43 user nova-compute[75745]: DEBUG nova.compute.manager [None req-6c24f0c7-7a00-4d1b-93d4-21d779edb285 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:20:43 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:43 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:44 user nova-compute[75745]: DEBUG nova.compute.manager [req-0f544bcd-9d4b-4641-9f41-acce05d38ccc req-e426d40a-8ccc-4c48-b1cd-a8a4e2b1f09f service nova] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Received event network-vif-unplugged-30260fca-fac2-4377-b514-add8784429c4 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:20:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0f544bcd-9d4b-4641-9f41-acce05d38ccc req-e426d40a-8ccc-4c48-b1cd-a8a4e2b1f09f service nova] Acquiring lock "9aca117f-581a-4625-abf1-c7faba669572-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:20:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0f544bcd-9d4b-4641-9f41-acce05d38ccc req-e426d40a-8ccc-4c48-b1cd-a8a4e2b1f09f service nova] Lock "9aca117f-581a-4625-abf1-c7faba669572-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:20:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0f544bcd-9d4b-4641-9f41-acce05d38ccc req-e426d40a-8ccc-4c48-b1cd-a8a4e2b1f09f service nova] Lock "9aca117f-581a-4625-abf1-c7faba669572-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:20:44 user nova-compute[75745]: DEBUG nova.compute.manager [req-0f544bcd-9d4b-4641-9f41-acce05d38ccc req-e426d40a-8ccc-4c48-b1cd-a8a4e2b1f09f service nova] [instance: 9aca117f-581a-4625-abf1-c7faba669572] No waiting events found dispatching network-vif-unplugged-30260fca-fac2-4377-b514-add8784429c4 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:20:44 user nova-compute[75745]: DEBUG nova.compute.manager [req-0f544bcd-9d4b-4641-9f41-acce05d38ccc req-e426d40a-8ccc-4c48-b1cd-a8a4e2b1f09f service nova] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Received event network-vif-unplugged-30260fca-fac2-4377-b514-add8784429c4 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:20:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:44 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Instance destroyed successfully.
Dec 01 17:20:44 user nova-compute[75745]: DEBUG nova.objects.instance [None req-6c24f0c7-7a00-4d1b-93d4-21d779edb285 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lazy-loading 'resources' on Instance uuid 9aca117f-581a-4625-abf1-c7faba669572 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:20:44 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-6c24f0c7-7a00-4d1b-93d4-21d779edb285 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T17:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-860674518',display_name='tempest-ServerActionsTestOtherA-server-1881038620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-860674518',id=26,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0VPvubRo9N9hDbGZ7rvBGfNIC49qGsVU6LVqmy/4M0zGXAuWOJcM6VFMASpfTpY2Uok0EIDnJL42vbGcwlx4yY9AlIDoh46ApbqcvwQjSds+Lyv6QMRAVGuNqnSLgdTA==',key_name='tempest-keypair-723015957',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:17:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='409356993ea442c5abdf4269aebe43ab',ramdisk_id='',reservation_id='r-9f0md9mc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1500186869',owner_user_name='tempest-ServerActionsTestOtherA-1500186869-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:17:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5204ecaa9b354d10bac514c27acbccc6',uuid=9aca117f-581a-4625-abf1-c7faba669572,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30260fca-fac2-4377-b514-add8784429c4", "address": "fa:16:3e:d6:94:e3", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30260fca-fa", "ovs_interfaceid": "30260fca-fac2-4377-b514-add8784429c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:20:44 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-6c24f0c7-7a00-4d1b-93d4-21d779edb285 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Converting VIF {"id": "30260fca-fac2-4377-b514-add8784429c4", "address": "fa:16:3e:d6:94:e3", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30260fca-fa", "ovs_interfaceid": "30260fca-fac2-4377-b514-add8784429c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:20:44 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-6c24f0c7-7a00-4d1b-93d4-21d779edb285 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:94:e3,bridge_name='br-int',has_traffic_filtering=True,id=30260fca-fac2-4377-b514-add8784429c4,network=Network(f7cefc9d-2279-4601-8a81-a640ad1aea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30260fca-fa') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:20:44 user nova-compute[75745]: DEBUG os_vif [None req-6c24f0c7-7a00-4d1b-93d4-21d779edb285 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:94:e3,bridge_name='br-int',has_traffic_filtering=True,id=30260fca-fac2-4377-b514-add8784429c4,network=Network(f7cefc9d-2279-4601-8a81-a640ad1aea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30260fca-fa') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:20:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30260fca-fa, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:20:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:20:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aeadb41f-72dd-4434-83e1-314ed0f59a67) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:20:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:20:44 user nova-compute[75745]: INFO os_vif [None req-6c24f0c7-7a00-4d1b-93d4-21d779edb285 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:94:e3,bridge_name='br-int',has_traffic_filtering=True,id=30260fca-fac2-4377-b514-add8784429c4,network=Network(f7cefc9d-2279-4601-8a81-a640ad1aea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30260fca-fa')
Dec 01 17:20:44 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-6c24f0c7-7a00-4d1b-93d4-21d779edb285 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Deleting instance files /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572_del
Dec 01 17:20:44 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-6c24f0c7-7a00-4d1b-93d4-21d779edb285 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Deletion of /opt/stack/data/nova/instances/9aca117f-581a-4625-abf1-c7faba669572_del complete
Dec 01 17:20:44 user nova-compute[75745]: INFO nova.compute.manager [None req-6c24f0c7-7a00-4d1b-93d4-21d779edb285 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Took 0.88 seconds to destroy the instance on the hypervisor.
Dec 01 17:20:44 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-6c24f0c7-7a00-4d1b-93d4-21d779edb285 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:20:44 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:20:44 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 9aca117f-581a-4625-abf1-c7faba669572] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:20:44 user nova-compute[75745]: DEBUG nova.compute.manager [None req-5839a59a-c00c-43a0-991b-3a6d5697d971 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:20:44 user nova-compute[75745]: DEBUG nova.compute.manager [req-8c4361ed-c444-4e59-8ee6-9b2ee05b6427 req-e89fbd12-9e19-4bc9-8504-6594821bd169 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Received event network-vif-plugged-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:20:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8c4361ed-c444-4e59-8ee6-9b2ee05b6427 req-e89fbd12-9e19-4bc9-8504-6594821bd169 service nova] Acquiring lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:20:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8c4361ed-c444-4e59-8ee6-9b2ee05b6427 req-e89fbd12-9e19-4bc9-8504-6594821bd169 service nova] Lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:20:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8c4361ed-c444-4e59-8ee6-9b2ee05b6427 req-e89fbd12-9e19-4bc9-8504-6594821bd169 service nova] Lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:20:44 user nova-compute[75745]: DEBUG nova.compute.manager [req-8c4361ed-c444-4e59-8ee6-9b2ee05b6427 req-e89fbd12-9e19-4bc9-8504-6594821bd169 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] No waiting events found dispatching network-vif-plugged-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:20:44 user nova-compute[75745]: WARNING nova.compute.manager [req-8c4361ed-c444-4e59-8ee6-9b2ee05b6427 req-e89fbd12-9e19-4bc9-8504-6594821bd169 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Received unexpected event network-vif-plugged-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 for instance with vm_state active and task_state None.
Dec 01 17:20:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a0209850-ea2a-4dc0-924c-2b9a24bd08cc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Acquiring lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:20:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a0209850-ea2a-4dc0-924c-2b9a24bd08cc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:20:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a0209850-ea2a-4dc0-924c-2b9a24bd08cc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Acquiring lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:20:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a0209850-ea2a-4dc0-924c-2b9a24bd08cc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:20:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a0209850-ea2a-4dc0-924c-2b9a24bd08cc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:20:45 user nova-compute[75745]: INFO nova.compute.manager [None req-a0209850-ea2a-4dc0-924c-2b9a24bd08cc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Terminating instance
Dec 01 17:20:45 user nova-compute[75745]: DEBUG nova.compute.manager [None req-a0209850-ea2a-4dc0-924c-2b9a24bd08cc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:20:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:45 user nova-compute[75745]: DEBUG nova.compute.manager [req-d83597ed-69d4-44db-ae08-5fee072884bf req-30804706-2138-45b2-86a9-dc2eef666c36 service nova] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Received event network-vif-unplugged-030e12c5-9662-4774-a9fc-5073144043f0 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:20:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d83597ed-69d4-44db-ae08-5fee072884bf req-30804706-2138-45b2-86a9-dc2eef666c36 service nova] Acquiring lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:20:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d83597ed-69d4-44db-ae08-5fee072884bf req-30804706-2138-45b2-86a9-dc2eef666c36 service nova] Lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:20:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d83597ed-69d4-44db-ae08-5fee072884bf req-30804706-2138-45b2-86a9-dc2eef666c36 service nova] Lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:20:45 user nova-compute[75745]: DEBUG nova.compute.manager [req-d83597ed-69d4-44db-ae08-5fee072884bf req-30804706-2138-45b2-86a9-dc2eef666c36 service nova] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] No waiting events found dispatching network-vif-unplugged-030e12c5-9662-4774-a9fc-5073144043f0 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:20:45 user nova-compute[75745]: DEBUG nova.compute.manager [req-d83597ed-69d4-44db-ae08-5fee072884bf req-30804706-2138-45b2-86a9-dc2eef666c36 service nova] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Received event network-vif-unplugged-030e12c5-9662-4774-a9fc-5073144043f0 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:20:45 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:20:45 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Took 0.95 seconds to deallocate network for instance.
Dec 01 17:20:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6c24f0c7-7a00-4d1b-93d4-21d779edb285 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:20:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6c24f0c7-7a00-4d1b-93d4-21d779edb285 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:20:45 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:20:45 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:20:45 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Instance destroyed successfully.
Dec 01 17:20:45 user nova-compute[75745]: DEBUG nova.objects.instance [None req-a0209850-ea2a-4dc0-924c-2b9a24bd08cc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lazy-loading 'resources' on Instance uuid 0ab0c115-74aa-4e55-92a3-6fa91ba753e3 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:20:45 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-a0209850-ea2a-4dc0-924c-2b9a24bd08cc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:12:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1559268353',display_name='tempest-SnapshotDataIntegrityTests-server-1559268353',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1559268353',id=20,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPW2was/W2oV0+Sgn8jzsmfWovebpnmqxoGcbK2sMDQnoW/A2AYcsFBLMhqYOM3Cat20E1mXQf4X4FL1PRDJGYAq8Vmz7xkxcXaOLsIac6k12A/6AzroW3H9mo5zXcbSlw==',key_name='tempest-keypair-1832201527',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:12:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f601b29e4ec41cba8048a7c999ccdce',ramdisk_id='',reservation_id='r-u3pdo3rv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-861206412',owner_user_name='tempest-SnapshotDataIntegrityTests-861206412-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:12:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fc9474087534d659beef3cd9f01eb97',uuid=0ab0c115-74aa-4e55-92a3-6fa91ba753e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "030e12c5-9662-4774-a9fc-5073144043f0", "address": "fa:16:3e:f5:29:5f", "network": {"id": "636c0eca-05bf-45a8-a587-9f9a43f430e8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-52821118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f601b29e4ec41cba8048a7c999ccdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030e12c5-96", "ovs_interfaceid": "030e12c5-9662-4774-a9fc-5073144043f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:20:45 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-a0209850-ea2a-4dc0-924c-2b9a24bd08cc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Converting VIF {"id": "030e12c5-9662-4774-a9fc-5073144043f0", "address": "fa:16:3e:f5:29:5f", "network": {"id": "636c0eca-05bf-45a8-a587-9f9a43f430e8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-52821118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f601b29e4ec41cba8048a7c999ccdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap030e12c5-96", "ovs_interfaceid": "030e12c5-9662-4774-a9fc-5073144043f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:20:45 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-a0209850-ea2a-4dc0-924c-2b9a24bd08cc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:29:5f,bridge_name='br-int',has_traffic_filtering=True,id=030e12c5-9662-4774-a9fc-5073144043f0,network=Network(636c0eca-05bf-45a8-a587-9f9a43f430e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap030e12c5-96') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:20:45 user nova-compute[75745]: DEBUG os_vif [None req-a0209850-ea2a-4dc0-924c-2b9a24bd08cc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:29:5f,bridge_name='br-int',has_traffic_filtering=True,id=030e12c5-9662-4774-a9fc-5073144043f0,network=Network(636c0eca-05bf-45a8-a587-9f9a43f430e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap030e12c5-96') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:20:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap030e12c5-96, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:20:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:20:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=28df9a16-4e99-47e3-b102-b9ca8193cb96) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:20:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:20:45 user nova-compute[75745]: INFO os_vif [None req-a0209850-ea2a-4dc0-924c-2b9a24bd08cc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:29:5f,bridge_name='br-int',has_traffic_filtering=True,id=030e12c5-9662-4774-a9fc-5073144043f0,network=Network(636c0eca-05bf-45a8-a587-9f9a43f430e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap030e12c5-96')
Dec 01 17:20:45 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-a0209850-ea2a-4dc0-924c-2b9a24bd08cc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Deleting instance files /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3_del
Dec 01 17:20:45 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-a0209850-ea2a-4dc0-924c-2b9a24bd08cc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Deletion of /opt/stack/data/nova/instances/0ab0c115-74aa-4e55-92a3-6fa91ba753e3_del complete
Dec 01 17:20:46 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-6c24f0c7-7a00-4d1b-93d4-21d779edb285 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:20:46 user nova-compute[75745]: INFO nova.compute.manager [None req-a0209850-ea2a-4dc0-924c-2b9a24bd08cc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Took 1.02 seconds to destroy the instance on the hypervisor.
Dec 01 17:20:46 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-a0209850-ea2a-4dc0-924c-2b9a24bd08cc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:20:46 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:20:46 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:20:46 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-6c24f0c7-7a00-4d1b-93d4-21d779edb285 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:20:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6c24f0c7-7a00-4d1b-93d4-21d779edb285 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.506s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:20:46 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-6c24f0c7-7a00-4d1b-93d4-21d779edb285 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Deleted allocations for instance 9aca117f-581a-4625-abf1-c7faba669572
Dec 01 17:20:46 user nova-compute[75745]: DEBUG nova.compute.manager [req-0329332a-e19d-48ab-b3b9-f8aeaa08a1c6 req-8f73afb4-35f4-42e1-8a02-cf561d4f18d2 service nova] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Received event network-vif-plugged-30260fca-fac2-4377-b514-add8784429c4 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:20:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0329332a-e19d-48ab-b3b9-f8aeaa08a1c6 req-8f73afb4-35f4-42e1-8a02-cf561d4f18d2 service nova] Acquiring lock "9aca117f-581a-4625-abf1-c7faba669572-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:20:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0329332a-e19d-48ab-b3b9-f8aeaa08a1c6 req-8f73afb4-35f4-42e1-8a02-cf561d4f18d2 service nova] Lock "9aca117f-581a-4625-abf1-c7faba669572-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:20:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0329332a-e19d-48ab-b3b9-f8aeaa08a1c6 req-8f73afb4-35f4-42e1-8a02-cf561d4f18d2 service nova] Lock "9aca117f-581a-4625-abf1-c7faba669572-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:20:46 user nova-compute[75745]: DEBUG nova.compute.manager [req-0329332a-e19d-48ab-b3b9-f8aeaa08a1c6 req-8f73afb4-35f4-42e1-8a02-cf561d4f18d2 service nova] [instance: 9aca117f-581a-4625-abf1-c7faba669572] No waiting events found dispatching network-vif-plugged-30260fca-fac2-4377-b514-add8784429c4 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:20:46 user nova-compute[75745]: WARNING nova.compute.manager [req-0329332a-e19d-48ab-b3b9-f8aeaa08a1c6 req-8f73afb4-35f4-42e1-8a02-cf561d4f18d2 service nova] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Received unexpected event network-vif-plugged-30260fca-fac2-4377-b514-add8784429c4 for instance with vm_state deleted and task_state None.
Dec 01 17:20:46 user nova-compute[75745]: DEBUG nova.compute.manager [req-0329332a-e19d-48ab-b3b9-f8aeaa08a1c6 req-8f73afb4-35f4-42e1-8a02-cf561d4f18d2 service nova] [instance: 9aca117f-581a-4625-abf1-c7faba669572] Received event network-vif-deleted-30260fca-fac2-4377-b514-add8784429c4 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:20:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6c24f0c7-7a00-4d1b-93d4-21d779edb285 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "9aca117f-581a-4625-abf1-c7faba669572" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.626s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:20:47 user nova-compute[75745]: DEBUG nova.compute.manager [req-675b6b8e-fa0a-49dc-a937-041cda3845da req-85580ac1-2b87-41e0-9619-5cd17966e93b service nova] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Received event network-vif-plugged-030e12c5-9662-4774-a9fc-5073144043f0 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:20:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-675b6b8e-fa0a-49dc-a937-041cda3845da req-85580ac1-2b87-41e0-9619-5cd17966e93b service nova] Acquiring lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:20:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-675b6b8e-fa0a-49dc-a937-041cda3845da req-85580ac1-2b87-41e0-9619-5cd17966e93b service nova] Lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:20:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-675b6b8e-fa0a-49dc-a937-041cda3845da req-85580ac1-2b87-41e0-9619-5cd17966e93b service nova] Lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:20:47 user nova-compute[75745]: DEBUG nova.compute.manager [req-675b6b8e-fa0a-49dc-a937-041cda3845da req-85580ac1-2b87-41e0-9619-5cd17966e93b service nova] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] No waiting events found dispatching network-vif-plugged-030e12c5-9662-4774-a9fc-5073144043f0 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:20:47 user nova-compute[75745]: WARNING nova.compute.manager [req-675b6b8e-fa0a-49dc-a937-041cda3845da req-85580ac1-2b87-41e0-9619-5cd17966e93b service nova] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Received unexpected event network-vif-plugged-030e12c5-9662-4774-a9fc-5073144043f0 for instance with vm_state active and task_state deleting.
Dec 01 17:20:47 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:20:47 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Took 1.55 seconds to deallocate network for instance.
Dec 01 17:20:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a0209850-ea2a-4dc0-924c-2b9a24bd08cc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:20:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a0209850-ea2a-4dc0-924c-2b9a24bd08cc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:20:48 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-a0209850-ea2a-4dc0-924c-2b9a24bd08cc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:20:48 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-a0209850-ea2a-4dc0-924c-2b9a24bd08cc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:20:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a0209850-ea2a-4dc0-924c-2b9a24bd08cc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:20:48 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-a0209850-ea2a-4dc0-924c-2b9a24bd08cc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Deleted allocations for instance 0ab0c115-74aa-4e55-92a3-6fa91ba753e3
Dec 01 17:20:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a0209850-ea2a-4dc0-924c-2b9a24bd08cc tempest-SnapshotDataIntegrityTests-861206412 tempest-SnapshotDataIntegrityTests-861206412-project-member] Lock "0ab0c115-74aa-4e55-92a3-6fa91ba753e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.135s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:20:48 user nova-compute[75745]: DEBUG nova.compute.manager [req-c820a5ae-18a1-45c4-99ff-02a173434e6c req-60763333-70cf-41a0-a569-aee09411fb06 service nova] [instance: 0ab0c115-74aa-4e55-92a3-6fa91ba753e3] Received event network-vif-deleted-030e12c5-9662-4774-a9fc-5073144043f0 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:20:49 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:20:49 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:20:49 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:20:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:50 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:20:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:51 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:20:51 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:20:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:20:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:20:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:20:51 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:20:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:20:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:20:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:20:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:20:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:20:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:20:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:20:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:20:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:20:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:20:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:20:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:20:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0959ad6-3d88-47d7-bf74-58fcb727fb3e/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:20:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0959ad6-3d88-47d7-bf74-58fcb727fb3e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:20:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0959ad6-3d88-47d7-bf74-58fcb727fb3e/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:20:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0959ad6-3d88-47d7-bf74-58fcb727fb3e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:20:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41b0b06-5f6d-4985-9f11-842f678ad1e6/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:20:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41b0b06-5f6d-4985-9f11-842f678ad1e6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:20:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41b0b06-5f6d-4985-9f11-842f678ad1e6/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:20:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41b0b06-5f6d-4985-9f11-842f678ad1e6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:20:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:20:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:20:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:20:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:20:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:20:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:20:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:20:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:20:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:20:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:20:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:20:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:20:55 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:20:55 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:20:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=8081MB free_disk=25.328208923339844GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:20:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:20:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:20:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance d997cdd6-67c6-4263-814a-17cf9e27bbeb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:20:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance e4ffb96e-456c-4fb9-9850-9e98310d63e5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:20:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 80962f79-dbb2-4380-b2c8-791642cfa86b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:20:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance a690fa65-078d-4ffd-bc62-3366aaa3d681 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:20:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance e0959ad6-3d88-47d7-bf74-58fcb727fb3e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:20:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 5e631ac3-8122-46a3-a54f-2395c0f7cf7c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:20:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance b41b0b06-5f6d-4985-9f11-842f678ad1e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:20:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:20:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:20:55 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:20:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:56 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:20:56 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:20:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.550s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:20:57 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:20:58 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:20:58 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:20:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-e4ffb96e-456c-4fb9-9850-9e98310d63e5" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:20:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-e4ffb96e-456c-4fb9-9850-9e98310d63e5" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:20:59 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:20:59 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Updating instance_info_cache with network_info: [{"id": "ebf45b7a-1ee5-43d6-9940-0ca049c95d71", "address": "fa:16:3e:39:c0:e3", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf45b7a-1e", "ovs_interfaceid": "ebf45b7a-1ee5-43d6-9940-0ca049c95d71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:20:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-e4ffb96e-456c-4fb9-9850-9e98310d63e5" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:20:59 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:20:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:20:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "5aee52eb-78e3-4f60-a920-7ade912735e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:21:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "5aee52eb-78e3-4f60-a920-7ade912735e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:21:16 user nova-compute[75745]: DEBUG nova.compute.manager [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:21:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:21:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:21:16 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:21:16 user nova-compute[75745]: INFO nova.compute.claims [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Claim successful on node user
Dec 01 17:21:16 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:21:16 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:21:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.361s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:21:16 user nova-compute[75745]: DEBUG nova.compute.manager [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:21:17 user nova-compute[75745]: DEBUG nova.compute.manager [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:21:17 user nova-compute[75745]: DEBUG nova.network.neutron [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:21:17 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:21:17 user nova-compute[75745]: DEBUG nova.compute.manager [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:21:17 user nova-compute[75745]: DEBUG nova.policy [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b319a47b86c04affa1858e1c2359876b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb3ba16695543cab6f10932fd6b2d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:21:17 user nova-compute[75745]: INFO nova.virt.block_device [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Booting with blank volume at /dev/vda
Dec 01 17:21:17 user nova-compute[75745]: DEBUG nova.network.neutron [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Successfully created port: 7c69901c-a94e-47f8-8a4a-1654ed728b83 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:21:18 user nova-compute[75745]: DEBUG nova.network.neutron [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Successfully updated port: 7c69901c-a94e-47f8-8a4a-1654ed728b83 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:21:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "refresh_cache-5aee52eb-78e3-4f60-a920-7ade912735e8" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:21:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquired lock "refresh_cache-5aee52eb-78e3-4f60-a920-7ade912735e8" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:21:18 user nova-compute[75745]: DEBUG nova.network.neutron [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:21:18 user nova-compute[75745]: DEBUG nova.network.neutron [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:21:18 user nova-compute[75745]: DEBUG nova.compute.manager [req-51e2d927-2b04-418f-b26a-39e971238ed0 req-5acc4ca4-51fd-4a1f-b54e-8e4ebd731a6e service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Received event network-changed-7c69901c-a94e-47f8-8a4a-1654ed728b83 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:21:18 user nova-compute[75745]: DEBUG nova.compute.manager [req-51e2d927-2b04-418f-b26a-39e971238ed0 req-5acc4ca4-51fd-4a1f-b54e-8e4ebd731a6e service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Refreshing instance network info cache due to event network-changed-7c69901c-a94e-47f8-8a4a-1654ed728b83. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:21:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-51e2d927-2b04-418f-b26a-39e971238ed0 req-5acc4ca4-51fd-4a1f-b54e-8e4ebd731a6e service nova] Acquiring lock "refresh_cache-5aee52eb-78e3-4f60-a920-7ade912735e8" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:21:18 user nova-compute[75745]: DEBUG nova.network.neutron [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Updating instance_info_cache with network_info: [{"id": "7c69901c-a94e-47f8-8a4a-1654ed728b83", "address": "fa:16:3e:2e:86:ec", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c69901c-a9", "ovs_interfaceid": "7c69901c-a94e-47f8-8a4a-1654ed728b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:21:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Releasing lock "refresh_cache-5aee52eb-78e3-4f60-a920-7ade912735e8" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:21:18 user nova-compute[75745]: DEBUG nova.compute.manager [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Instance network_info: |[{"id": "7c69901c-a94e-47f8-8a4a-1654ed728b83", "address": "fa:16:3e:2e:86:ec", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c69901c-a9", "ovs_interfaceid": "7c69901c-a94e-47f8-8a4a-1654ed728b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:21:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-51e2d927-2b04-418f-b26a-39e971238ed0 req-5acc4ca4-51fd-4a1f-b54e-8e4ebd731a6e service nova] Acquired lock "refresh_cache-5aee52eb-78e3-4f60-a920-7ade912735e8" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:21:18 user nova-compute[75745]: DEBUG nova.network.neutron [req-51e2d927-2b04-418f-b26a-39e971238ed0 req-5acc4ca4-51fd-4a1f-b54e-8e4ebd731a6e service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Refreshing network info cache for port 7c69901c-a94e-47f8-8a4a-1654ed728b83 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:21:19 user nova-compute[75745]: DEBUG nova.network.neutron [req-51e2d927-2b04-418f-b26a-39e971238ed0 req-5acc4ca4-51fd-4a1f-b54e-8e4ebd731a6e service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Updated VIF entry in instance network info cache for port 7c69901c-a94e-47f8-8a4a-1654ed728b83. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:21:19 user nova-compute[75745]: DEBUG nova.network.neutron [req-51e2d927-2b04-418f-b26a-39e971238ed0 req-5acc4ca4-51fd-4a1f-b54e-8e4ebd731a6e service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Updating instance_info_cache with network_info: [{"id": "7c69901c-a94e-47f8-8a4a-1654ed728b83", "address": "fa:16:3e:2e:86:ec", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c69901c-a9", "ovs_interfaceid": "7c69901c-a94e-47f8-8a4a-1654ed728b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:21:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-51e2d927-2b04-418f-b26a-39e971238ed0 req-5acc4ca4-51fd-4a1f-b54e-8e4ebd731a6e service nova] Releasing lock "refresh_cache-5aee52eb-78e3-4f60-a920-7ade912735e8" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:21:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:22 user nova-compute[75745]: DEBUG os_brick.utils [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:21:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:21:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:21:22 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d451d9-a62c-4134-99f5-4739c7e49270]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:21:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:21:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:21:22 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[15371f33-c7d8-4b14-b7aa-135a3d876505]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:21:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:21:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:21:22 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f92e8f0-a7fd-4e13-9c7d-46676ab32d6e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:21:22 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[461c5aff-90c0-4e44-9c50-e102d4bb7711]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:21:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:21:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:21:22 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:21:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:21:22 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:21:22 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:21:22 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f80b4e-5779-4c22-8e11-a72ce5399b62]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:21:22 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:21:22 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:21:22 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:21:22 user nova-compute[75745]: DEBUG os_brick.utils [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:21:22 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Updating existing volume attachment record: eeabfbd5-c9bc-43fc-b37d-6ce9e09b8043 {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:21:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b4277f83-bb8e-4727-a5ea-03f93fd46304 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "e0959ad6-3d88-47d7-bf74-58fcb727fb3e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:21:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b4277f83-bb8e-4727-a5ea-03f93fd46304 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "e0959ad6-3d88-47d7-bf74-58fcb727fb3e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:21:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b4277f83-bb8e-4727-a5ea-03f93fd46304 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "e0959ad6-3d88-47d7-bf74-58fcb727fb3e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:21:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b4277f83-bb8e-4727-a5ea-03f93fd46304 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "e0959ad6-3d88-47d7-bf74-58fcb727fb3e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:21:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b4277f83-bb8e-4727-a5ea-03f93fd46304 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "e0959ad6-3d88-47d7-bf74-58fcb727fb3e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:21:29 user nova-compute[75745]: INFO nova.compute.manager [None req-b4277f83-bb8e-4727-a5ea-03f93fd46304 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Terminating instance
Dec 01 17:21:29 user nova-compute[75745]: DEBUG nova.compute.manager [None req-b4277f83-bb8e-4727-a5ea-03f93fd46304 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:21:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:29 user nova-compute[75745]: DEBUG nova.compute.manager [req-aca3f335-549e-4160-8f60-08e5d6a724ff req-8e85b39e-cbe5-4dc2-8b53-13da6c75fcb0 service nova] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Received event network-vif-unplugged-1af2d3d8-d2bb-4203-a6e2-f179af1228be {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:21:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-aca3f335-549e-4160-8f60-08e5d6a724ff req-8e85b39e-cbe5-4dc2-8b53-13da6c75fcb0 service nova] Acquiring lock "e0959ad6-3d88-47d7-bf74-58fcb727fb3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:21:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-aca3f335-549e-4160-8f60-08e5d6a724ff req-8e85b39e-cbe5-4dc2-8b53-13da6c75fcb0 service nova] Lock "e0959ad6-3d88-47d7-bf74-58fcb727fb3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:21:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-aca3f335-549e-4160-8f60-08e5d6a724ff req-8e85b39e-cbe5-4dc2-8b53-13da6c75fcb0 service nova] Lock "e0959ad6-3d88-47d7-bf74-58fcb727fb3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:21:29 user nova-compute[75745]: DEBUG nova.compute.manager [req-aca3f335-549e-4160-8f60-08e5d6a724ff req-8e85b39e-cbe5-4dc2-8b53-13da6c75fcb0 service nova] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] No waiting events found dispatching network-vif-unplugged-1af2d3d8-d2bb-4203-a6e2-f179af1228be {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:21:29 user nova-compute[75745]: DEBUG nova.compute.manager [req-aca3f335-549e-4160-8f60-08e5d6a724ff req-8e85b39e-cbe5-4dc2-8b53-13da6c75fcb0 service nova] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Received event network-vif-unplugged-1af2d3d8-d2bb-4203-a6e2-f179af1228be for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:21:29 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Instance destroyed successfully.
Dec 01 17:21:29 user nova-compute[75745]: DEBUG nova.objects.instance [None req-b4277f83-bb8e-4727-a5ea-03f93fd46304 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lazy-loading 'resources' on Instance uuid e0959ad6-3d88-47d7-bf74-58fcb727fb3e {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:21:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-b4277f83-bb8e-4727-a5ea-03f93fd46304 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:16:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-687059891',display_name='tempest-AttachVolumeNegativeTest-server-687059891',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-687059891',id=28,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDoR9Tf7o8dlfSMjbqP7HcirYiwZT/0IQXHhK1XGkYS+ckNMaT2cVkzTsledS5Pqf9BaLyecjIQMcK58DbD/lGi/UDivWFksvgQMLiSpUtR3oIFLFJeQ5QgYkcxdW2ntA==',key_name='tempest-keypair-1533402473',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:16:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1730419061445f98680b8c81753a4f3',ramdisk_id='',reservation_id='r-lpj9kjei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1227943771',owner_user_name='tempest-AttachVolumeNegativeTest-1227943771-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:16:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76845c98f91449df9196e19187b1b786',uuid=e0959ad6-3d88-47d7-bf74-58fcb727fb3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1af2d3d8-d2bb-4203-a6e2-f179af1228be", "address": "fa:16:3e:26:bd:7c", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1af2d3d8-d2", "ovs_interfaceid": "1af2d3d8-d2bb-4203-a6e2-f179af1228be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:21:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-b4277f83-bb8e-4727-a5ea-03f93fd46304 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Converting VIF {"id": "1af2d3d8-d2bb-4203-a6e2-f179af1228be", "address": "fa:16:3e:26:bd:7c", "network": {"id": "8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1006131945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1730419061445f98680b8c81753a4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1af2d3d8-d2", "ovs_interfaceid": "1af2d3d8-d2bb-4203-a6e2-f179af1228be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:21:29 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-b4277f83-bb8e-4727-a5ea-03f93fd46304 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:bd:7c,bridge_name='br-int',has_traffic_filtering=True,id=1af2d3d8-d2bb-4203-a6e2-f179af1228be,network=Network(8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1af2d3d8-d2') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:21:29 user nova-compute[75745]: DEBUG os_vif [None req-b4277f83-bb8e-4727-a5ea-03f93fd46304 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:bd:7c,bridge_name='br-int',has_traffic_filtering=True,id=1af2d3d8-d2bb-4203-a6e2-f179af1228be,network=Network(8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1af2d3d8-d2') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:21:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1af2d3d8-d2, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:21:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:21:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8f72f7c0-c510-4bbc-8156-acb9b68ce523) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:21:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:29 user nova-compute[75745]: INFO os_vif [None req-b4277f83-bb8e-4727-a5ea-03f93fd46304 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:bd:7c,bridge_name='br-int',has_traffic_filtering=True,id=1af2d3d8-d2bb-4203-a6e2-f179af1228be,network=Network(8d0c57c0-8b01-4a0a-a15f-5fb8f83e1174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1af2d3d8-d2')
Dec 01 17:21:29 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-b4277f83-bb8e-4727-a5ea-03f93fd46304 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Deleting instance files /opt/stack/data/nova/instances/e0959ad6-3d88-47d7-bf74-58fcb727fb3e_del
Dec 01 17:21:29 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-b4277f83-bb8e-4727-a5ea-03f93fd46304 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Deletion of /opt/stack/data/nova/instances/e0959ad6-3d88-47d7-bf74-58fcb727fb3e_del complete
Dec 01 17:21:29 user nova-compute[75745]: INFO nova.compute.manager [None req-b4277f83-bb8e-4727-a5ea-03f93fd46304 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Took 0.70 seconds to destroy the instance on the hypervisor.
Dec 01 17:21:29 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-b4277f83-bb8e-4727-a5ea-03f93fd46304 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:21:29 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:21:29 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:21:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:30 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:21:30 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Took 0.96 seconds to deallocate network for instance.
Dec 01 17:21:30 user nova-compute[75745]: DEBUG nova.compute.manager [req-0e68a531-3ae4-4d0c-9c32-a83e489b7899 req-4da8619e-d905-41c9-96b8-81c6778093fc service nova] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Received event network-vif-deleted-1af2d3d8-d2bb-4203-a6e2-f179af1228be {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:21:30 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b4277f83-bb8e-4727-a5ea-03f93fd46304 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:21:30 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b4277f83-bb8e-4727-a5ea-03f93fd46304 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:21:31 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-b4277f83-bb8e-4727-a5ea-03f93fd46304 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:21:31 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-b4277f83-bb8e-4727-a5ea-03f93fd46304 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:21:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b4277f83-bb8e-4727-a5ea-03f93fd46304 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:21:31 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-b4277f83-bb8e-4727-a5ea-03f93fd46304 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Deleted allocations for instance e0959ad6-3d88-47d7-bf74-58fcb727fb3e
Dec 01 17:21:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b4277f83-bb8e-4727-a5ea-03f93fd46304 tempest-AttachVolumeNegativeTest-1227943771 tempest-AttachVolumeNegativeTest-1227943771-project-member] Lock "e0959ad6-3d88-47d7-bf74-58fcb727fb3e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.191s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG nova.compute.manager [req-b6746d8b-6a92-4e1b-8d17-e600aea660c9 req-32ab2af0-828c-4581-8d07-7187c4202601 service nova] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Received event network-vif-plugged-1af2d3d8-d2bb-4203-a6e2-f179af1228be {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b6746d8b-6a92-4e1b-8d17-e600aea660c9 req-32ab2af0-828c-4581-8d07-7187c4202601 service nova] Acquiring lock "e0959ad6-3d88-47d7-bf74-58fcb727fb3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b6746d8b-6a92-4e1b-8d17-e600aea660c9 req-32ab2af0-828c-4581-8d07-7187c4202601 service nova] Lock "e0959ad6-3d88-47d7-bf74-58fcb727fb3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b6746d8b-6a92-4e1b-8d17-e600aea660c9 req-32ab2af0-828c-4581-8d07-7187c4202601 service nova] Lock "e0959ad6-3d88-47d7-bf74-58fcb727fb3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG nova.compute.manager [req-b6746d8b-6a92-4e1b-8d17-e600aea660c9 req-32ab2af0-828c-4581-8d07-7187c4202601 service nova] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] No waiting events found dispatching network-vif-plugged-1af2d3d8-d2bb-4203-a6e2-f179af1228be {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:21:32 user nova-compute[75745]: WARNING nova.compute.manager [req-b6746d8b-6a92-4e1b-8d17-e600aea660c9 req-32ab2af0-828c-4581-8d07-7187c4202601 service nova] [instance: e0959ad6-3d88-47d7-bf74-58fcb727fb3e] Received unexpected event network-vif-plugged-1af2d3d8-d2bb-4203-a6e2-f179af1228be for instance with vm_state deleted and task_state None.
Dec 01 17:21:32 user nova-compute[75745]: DEBUG nova.compute.manager [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:21:32 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Creating image(s)
Dec 01 17:21:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Did not create local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Ensure instance console log exists: /opt/stack/data/nova/instances/5aee52eb-78e3-4f60-a920-7ade912735e8/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Start _get_guest_xml network_info=[{"id": "7c69901c-a94e-47f8-8a4a-1654ed728b83", "address": "fa:16:3e:2e:86:ec", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c69901c-a9", "ovs_interfaceid": "7c69901c-a94e-47f8-8a4a-1654ed728b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': 'eeabfbd5-c9bc-43fc-b37d-6ce9e09b8043', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yjLwTGef', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5aee52eb-78e3-4f60-a920-7ade912735e8', 'attached_at': '', 'detached_at': '', 'volume_id': 'b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0', 'serial': 'b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0'}, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:21:32 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:21:32 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:21:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yjLwTGef', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:21:32 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:21:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:21:32 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:21:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:21:32 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1e6fc1-b2f8-4e9c-aa4a-0083cac8dce8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:21:32 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b654af90-c668-4d09-9b14-3f1896bf72be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0] added
Dec 01 17:21:32 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0ad04c-2d93-49c0-8e59-a31aa21cbd5c]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[436e1dd6-dda3-4503-a695-8ed0003e7546]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yjLwTGef {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yjLwTGef" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae7c46b-ba37-47a3-b9a3-9f4bcf016efd]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yjLwTGef'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b31911f-6625-40fe-ab47-9d64445db666]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aff391a-9157-4147-8992-08aacbaad2ea]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 01 17:21:32 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 01 17:21:32 user nova-compute[75745]:  {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:21:32 user nova-compute[75745]: WARNING os_brick.initiator.connectors.iscsi [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 01 17:21:32 user nova-compute[75745]: 
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c69d6ff-6003-4602-b954-78df72a7c0d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0, portal: 172.16.0.220,3260]
Dec 01 17:21:32 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0, portal: 172.16.0.220,3260] successful.
Dec 01 17:21:32 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c984075-950d-406d-84eb-18fbbed5bb00]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d118ab8-fb6c-4a2f-80f4-6a33dc8139c2]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:21:32 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:21:32 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f979e25-9c70-4a8b-8200-469f5dc229b8]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:21:32 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: None {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:21:33 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:21:33 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yjLwTGef', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:21:33 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:21:33 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23330643163373933', 'path': '/dev/sdb'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:21:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330643163373933', 'path': '/dev/sdb'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:21:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-957931660',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-957931660',id=32,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='adb3ba16695543cab6f10932fd6b2d2d',ramdisk_id='',reservation_id='r-ehd8ztzo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-90723689',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:21:17Z,user_data=None,user_id='b319a47b86c04affa1858e1c2359876b',uuid=5aee52eb-78e3-4f60-a920-7ade912735e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c69901c-a94e-47f8-8a4a-1654ed728b83", "address": "fa:16:3e:2e:86:ec", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c69901c-a9", "ovs_interfaceid": "7c69901c-a94e-47f8-8a4a-1654ed728b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:21:33 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Converting VIF {"id": "7c69901c-a94e-47f8-8a4a-1654ed728b83", "address": "fa:16:3e:2e:86:ec", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c69901c-a9", "ovs_interfaceid": "7c69901c-a94e-47f8-8a4a-1654ed728b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:21:33 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:86:ec,bridge_name='br-int',has_traffic_filtering=True,id=7c69901c-a94e-47f8-8a4a-1654ed728b83,network=Network(bf1db63d-d427-41c2-ac82-6fab9483a423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c69901c-a9') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:21:33 user nova-compute[75745]: DEBUG nova.objects.instance [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lazy-loading 'pci_devices' on Instance uuid 5aee52eb-78e3-4f60-a920-7ade912735e8 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:21:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:21:33 user nova-compute[75745]:   <uuid>5aee52eb-78e3-4f60-a920-7ade912735e8</uuid>
Dec 01 17:21:33 user nova-compute[75745]:   <name>instance-00000020</name>
Dec 01 17:21:33 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:21:33 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:21:33 user nova-compute[75745]:   <metadata>
Dec 01 17:21:33 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:21:33 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:21:33 user nova-compute[75745]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-957931660</nova:name>
Dec 01 17:21:33 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:21:32</nova:creationTime>
Dec 01 17:21:33 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:21:33 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:21:33 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:21:33 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:21:33 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:21:33 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:21:33 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:21:33 user nova-compute[75745]:       <nova:owner>
Dec 01 17:21:33 user nova-compute[75745]:         <nova:user uuid="b319a47b86c04affa1858e1c2359876b">tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member</nova:user>
Dec 01 17:21:33 user nova-compute[75745]:         <nova:project uuid="adb3ba16695543cab6f10932fd6b2d2d">tempest-ServerBootFromVolumeStableRescueTest-90723689</nova:project>
Dec 01 17:21:33 user nova-compute[75745]:       </nova:owner>
Dec 01 17:21:33 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:21:33 user nova-compute[75745]:       <nova:ports>
Dec 01 17:21:33 user nova-compute[75745]:         <nova:port uuid="7c69901c-a94e-47f8-8a4a-1654ed728b83">
Dec 01 17:21:33 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 01 17:21:33 user nova-compute[75745]:         </nova:port>
Dec 01 17:21:33 user nova-compute[75745]:       </nova:ports>
Dec 01 17:21:33 user nova-compute[75745]:     </nova:instance>
Dec 01 17:21:33 user nova-compute[75745]:   </metadata>
Dec 01 17:21:33 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:21:33 user nova-compute[75745]:     <system>
Dec 01 17:21:33 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:21:33 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:21:33 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:21:33 user nova-compute[75745]:       <entry name="serial">5aee52eb-78e3-4f60-a920-7ade912735e8</entry>
Dec 01 17:21:33 user nova-compute[75745]:       <entry name="uuid">5aee52eb-78e3-4f60-a920-7ade912735e8</entry>
Dec 01 17:21:33 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:21:33 user nova-compute[75745]:     </system>
Dec 01 17:21:33 user nova-compute[75745]:   </sysinfo>
Dec 01 17:21:33 user nova-compute[75745]:   <os>
Dec 01 17:21:33 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:21:33 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:21:33 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:21:33 user nova-compute[75745]:   </os>
Dec 01 17:21:33 user nova-compute[75745]:   <features>
Dec 01 17:21:33 user nova-compute[75745]:     <acpi/>
Dec 01 17:21:33 user nova-compute[75745]:     <apic/>
Dec 01 17:21:33 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:21:33 user nova-compute[75745]:   </features>
Dec 01 17:21:33 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:21:33 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:21:33 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:21:33 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:21:33 user nova-compute[75745]:   </clock>
Dec 01 17:21:33 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:21:33 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:21:33 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:21:33 user nova-compute[75745]:   </cpu>
Dec 01 17:21:33 user nova-compute[75745]:   <devices>
Dec 01 17:21:33 user nova-compute[75745]:     <disk type="block" device="disk">
Dec 01 17:21:33 user nova-compute[75745]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:21:33 user nova-compute[75745]:       <source dev="/dev/sdb"/>
Dec 01 17:21:33 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:21:33 user nova-compute[75745]:       <serial>b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0</serial>
Dec 01 17:21:33 user nova-compute[75745]:     </disk>
Dec 01 17:21:33 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:21:33 user nova-compute[75745]:       <mac address="fa:16:3e:2e:86:ec"/>
Dec 01 17:21:33 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:21:33 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:21:33 user nova-compute[75745]:       <target dev="tap7c69901c-a9"/>
Dec 01 17:21:33 user nova-compute[75745]:     </interface>
Dec 01 17:21:33 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:21:33 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/5aee52eb-78e3-4f60-a920-7ade912735e8/console.log" append="off"/>
Dec 01 17:21:33 user nova-compute[75745]:     </serial>
Dec 01 17:21:33 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:21:33 user nova-compute[75745]:     <video>
Dec 01 17:21:33 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:21:33 user nova-compute[75745]:     </video>
Dec 01 17:21:33 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:21:33 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:21:33 user nova-compute[75745]:     </rng>
Dec 01 17:21:33 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:21:33 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:21:33 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:21:33 user nova-compute[75745]:     </memballoon>
Dec 01 17:21:33 user nova-compute[75745]:   </devices>
Dec 01 17:21:33 user nova-compute[75745]: </domain>
Dec 01 17:21:33 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:21:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-957931660',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-957931660',id=32,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='adb3ba16695543cab6f10932fd6b2d2d',ramdisk_id='',reservation_id='r-ehd8ztzo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-90723689',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:21:17Z,user_data=None,user_id='b319a47b86c04affa1858e1c2359876b',uuid=5aee52eb-78e3-4f60-a920-7ade912735e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c69901c-a94e-47f8-8a4a-1654ed728b83", "address": "fa:16:3e:2e:86:ec", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c69901c-a9", "ovs_interfaceid": "7c69901c-a94e-47f8-8a4a-1654ed728b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:21:33 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Converting VIF {"id": "7c69901c-a94e-47f8-8a4a-1654ed728b83", "address": "fa:16:3e:2e:86:ec", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c69901c-a9", "ovs_interfaceid": "7c69901c-a94e-47f8-8a4a-1654ed728b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:21:33 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:86:ec,bridge_name='br-int',has_traffic_filtering=True,id=7c69901c-a94e-47f8-8a4a-1654ed728b83,network=Network(bf1db63d-d427-41c2-ac82-6fab9483a423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c69901c-a9') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:21:33 user nova-compute[75745]: DEBUG os_vif [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:86:ec,bridge_name='br-int',has_traffic_filtering=True,id=7c69901c-a94e-47f8-8a4a-1654ed728b83,network=Network(bf1db63d-d427-41c2-ac82-6fab9483a423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c69901c-a9') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:21:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:21:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:21:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '541e0d79-26fe-56ab-9099-81286f7137b6', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:21:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c69901c-a9, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:21:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7c69901c-a9, col_values=(('qos', UUID('5cc4f4cc-a175-451d-b4bd-499876e80828')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:21:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7c69901c-a9, col_values=(('external_ids', {'iface-id': '7c69901c-a94e-47f8-8a4a-1654ed728b83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:86:ec', 'vm-uuid': '5aee52eb-78e3-4f60-a920-7ade912735e8'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:21:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:21:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:33 user nova-compute[75745]: INFO os_vif [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:86:ec,bridge_name='br-int',has_traffic_filtering=True,id=7c69901c-a94e-47f8-8a4a-1654ed728b83,network=Network(bf1db63d-d427-41c2-ac82-6fab9483a423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c69901c-a9')
Dec 01 17:21:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:21:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] No VIF found with MAC fa:16:3e:2e:86:ec, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:21:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:35 user nova-compute[75745]: DEBUG nova.compute.manager [req-22187bdd-ad4c-465d-9a17-e39d644cfa61 req-ec912c2a-d85b-4c95-bf56-e6dca49a380c service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Received event network-vif-plugged-7c69901c-a94e-47f8-8a4a-1654ed728b83 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:21:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-22187bdd-ad4c-465d-9a17-e39d644cfa61 req-ec912c2a-d85b-4c95-bf56-e6dca49a380c service nova] Acquiring lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:21:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-22187bdd-ad4c-465d-9a17-e39d644cfa61 req-ec912c2a-d85b-4c95-bf56-e6dca49a380c service nova] Lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:21:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-22187bdd-ad4c-465d-9a17-e39d644cfa61 req-ec912c2a-d85b-4c95-bf56-e6dca49a380c service nova] Lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:21:35 user nova-compute[75745]: DEBUG nova.compute.manager [req-22187bdd-ad4c-465d-9a17-e39d644cfa61 req-ec912c2a-d85b-4c95-bf56-e6dca49a380c service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] No waiting events found dispatching network-vif-plugged-7c69901c-a94e-47f8-8a4a-1654ed728b83 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:21:35 user nova-compute[75745]: WARNING nova.compute.manager [req-22187bdd-ad4c-465d-9a17-e39d644cfa61 req-ec912c2a-d85b-4c95-bf56-e6dca49a380c service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Received unexpected event network-vif-plugged-7c69901c-a94e-47f8-8a4a-1654ed728b83 for instance with vm_state building and task_state spawning.
Dec 01 17:21:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:36 user nova-compute[75745]: DEBUG nova.compute.manager [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:21:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:21:36 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Instance spawned successfully.
Dec 01 17:21:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:21:37 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:21:37 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:21:37 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:21:37 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:21:37 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:21:37 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:21:37 user nova-compute[75745]: INFO nova.compute.manager [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Took 4.99 seconds to spawn the instance on the hypervisor.
Dec 01 17:21:37 user nova-compute[75745]: DEBUG nova.compute.manager [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:21:37 user nova-compute[75745]: DEBUG nova.compute.manager [req-a3504ac4-65c8-44bc-afaa-be0aaefca2d2 req-86edf7ce-21f8-4c72-87bd-81d98a19ff3c service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Received event network-vif-plugged-7c69901c-a94e-47f8-8a4a-1654ed728b83 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:21:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a3504ac4-65c8-44bc-afaa-be0aaefca2d2 req-86edf7ce-21f8-4c72-87bd-81d98a19ff3c service nova] Acquiring lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:21:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a3504ac4-65c8-44bc-afaa-be0aaefca2d2 req-86edf7ce-21f8-4c72-87bd-81d98a19ff3c service nova] Lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:21:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a3504ac4-65c8-44bc-afaa-be0aaefca2d2 req-86edf7ce-21f8-4c72-87bd-81d98a19ff3c service nova] Lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:21:37 user nova-compute[75745]: DEBUG nova.compute.manager [req-a3504ac4-65c8-44bc-afaa-be0aaefca2d2 req-86edf7ce-21f8-4c72-87bd-81d98a19ff3c service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] No waiting events found dispatching network-vif-plugged-7c69901c-a94e-47f8-8a4a-1654ed728b83 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:21:37 user nova-compute[75745]: WARNING nova.compute.manager [req-a3504ac4-65c8-44bc-afaa-be0aaefca2d2 req-86edf7ce-21f8-4c72-87bd-81d98a19ff3c service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Received unexpected event network-vif-plugged-7c69901c-a94e-47f8-8a4a-1654ed728b83 for instance with vm_state building and task_state spawning.
Dec 01 17:21:37 user nova-compute[75745]: INFO nova.compute.manager [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Took 20.60 seconds to build instance.
Dec 01 17:21:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-82fbdca0-5730-4fd9-a9ca-23f50b9de888 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "5aee52eb-78e3-4f60-a920-7ade912735e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.731s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:21:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:41 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:21:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:43 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:47 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:21:47 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:21:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:21:49 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:21:50 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:21:50 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:21:51 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:21:51 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:21:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:21:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:21:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:21:51 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:21:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:21:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:21:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:21:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:21:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:21:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:21:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:21:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:21:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:21:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:21:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:21:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:21:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41b0b06-5f6d-4985-9f11-842f678ad1e6/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:21:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:21:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41b0b06-5f6d-4985-9f11-842f678ad1e6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:21:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41b0b06-5f6d-4985-9f11-842f678ad1e6/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:21:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41b0b06-5f6d-4985-9f11-842f678ad1e6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:21:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:21:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:21:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:21:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:21:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:21:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:21:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:21:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:21:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:21:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:21:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:21:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:21:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:21:55 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:21:55 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:21:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=8204MB free_disk=25.33940887451172GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:21:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:21:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:21:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance d997cdd6-67c6-4263-814a-17cf9e27bbeb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:21:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance e4ffb96e-456c-4fb9-9850-9e98310d63e5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:21:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 80962f79-dbb2-4380-b2c8-791642cfa86b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:21:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance a690fa65-078d-4ffd-bc62-3366aaa3d681 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:21:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 5e631ac3-8122-46a3-a54f-2395c0f7cf7c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:21:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance b41b0b06-5f6d-4985-9f11-842f678ad1e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:21:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 5aee52eb-78e3-4f60-a920-7ade912735e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:21:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:21:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:21:55 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:21:55 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:21:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:21:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.375s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:21:55 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:21:55 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Cleaning up deleted instances {{(pid=75745) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 01 17:21:55 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] There are 0 instances to clean {{(pid=75745) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 01 17:21:55 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:21:55 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75745) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 01 17:21:56 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:21:56 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:21:56 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:21:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:00 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:22:00 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:22:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-80962f79-dbb2-4380-b2c8-791642cfa86b" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:22:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-80962f79-dbb2-4380-b2c8-791642cfa86b" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:22:00 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:22:01 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Updating instance_info_cache with network_info: [{"id": "68718048-8e77-438b-a7e0-15675cc9e543", "address": "fa:16:3e:bf:09:08", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68718048-8e", "ovs_interfaceid": "68718048-8e77-438b-a7e0-15675cc9e543", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:22:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-80962f79-dbb2-4380-b2c8-791642cfa86b" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:22:01 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:22:03 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:17 user nova-compute[75745]: DEBUG nova.compute.manager [req-360f5d6b-f701-4087-a7f5-bc8528010e43 req-fad36bf8-7f55-447d-9c06-df2c36d78d0b service nova] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Received event network-changed-05ab914d-2ae5-44a9-9d2c-41d968056d8f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:22:17 user nova-compute[75745]: DEBUG nova.compute.manager [req-360f5d6b-f701-4087-a7f5-bc8528010e43 req-fad36bf8-7f55-447d-9c06-df2c36d78d0b service nova] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Refreshing instance network info cache due to event network-changed-05ab914d-2ae5-44a9-9d2c-41d968056d8f. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:22:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-360f5d6b-f701-4087-a7f5-bc8528010e43 req-fad36bf8-7f55-447d-9c06-df2c36d78d0b service nova] Acquiring lock "refresh_cache-b41b0b06-5f6d-4985-9f11-842f678ad1e6" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:22:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-360f5d6b-f701-4087-a7f5-bc8528010e43 req-fad36bf8-7f55-447d-9c06-df2c36d78d0b service nova] Acquired lock "refresh_cache-b41b0b06-5f6d-4985-9f11-842f678ad1e6" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:22:17 user nova-compute[75745]: DEBUG nova.network.neutron [req-360f5d6b-f701-4087-a7f5-bc8528010e43 req-fad36bf8-7f55-447d-9c06-df2c36d78d0b service nova] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Refreshing network info cache for port 05ab914d-2ae5-44a9-9d2c-41d968056d8f {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:22:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Acquiring lock "b41b0b06-5f6d-4985-9f11-842f678ad1e6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:22:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "b41b0b06-5f6d-4985-9f11-842f678ad1e6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:22:17 user nova-compute[75745]: DEBUG nova.objects.instance [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lazy-loading 'flavor' on Instance uuid b41b0b06-5f6d-4985-9f11-842f678ad1e6 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:22:17 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Ignoring supplied device name: /dev/vdb
Dec 01 17:22:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "b41b0b06-5f6d-4985-9f11-842f678ad1e6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:22:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Acquiring lock "b41b0b06-5f6d-4985-9f11-842f678ad1e6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:22:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "b41b0b06-5f6d-4985-9f11-842f678ad1e6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:22:17 user nova-compute[75745]: INFO nova.compute.manager [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Attaching volume 826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 to /dev/vdb
Dec 01 17:22:18 user nova-compute[75745]: DEBUG os_brick.utils [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:22:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:18 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee480a9f-48ec-4066-ad75-58360fe24d99]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:22:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:18 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c274fc5-5bd1-46d1-9d59-b0ded9a8b07e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:22:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:18 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9592df-1f91-456f-8ec7-c10e0b5420fa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:22:18 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eaad881-e096-4de3-bba8-5377d4f92768]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:22:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:22:18 user nova-compute[75745]: DEBUG nova.network.neutron [req-360f5d6b-f701-4087-a7f5-bc8528010e43 req-fad36bf8-7f55-447d-9c06-df2c36d78d0b service nova] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Updated VIF entry in instance network info cache for port 05ab914d-2ae5-44a9-9d2c-41d968056d8f. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:22:18 user nova-compute[75745]: DEBUG nova.network.neutron [req-360f5d6b-f701-4087-a7f5-bc8528010e43 req-fad36bf8-7f55-447d-9c06-df2c36d78d0b service nova] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Updating instance_info_cache with network_info: [{"id": "05ab914d-2ae5-44a9-9d2c-41d968056d8f", "address": "fa:16:3e:1a:39:b9", "network": {"id": "ccf83dac-fecd-4f65-baf8-740ff63f51a0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-804694060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5ee303033640e7adebbc0c949be9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ab914d-2a", "ovs_interfaceid": "05ab914d-2ae5-44a9-9d2c-41d968056d8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:22:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:22:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-360f5d6b-f701-4087-a7f5-bc8528010e43 req-fad36bf8-7f55-447d-9c06-df2c36d78d0b service nova] Releasing lock "refresh_cache-b41b0b06-5f6d-4985-9f11-842f678ad1e6" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:22:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:22:18 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:22:18 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[af850dc1-558c-4ad6-b0e3-ce63c5dcee60]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:22:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:22:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:22:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:22:18 user nova-compute[75745]: DEBUG os_brick.utils [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:22:18 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Updating existing volume attachment record: bced13e9-5db5-4331-ba0c-7e321d1944c2 {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:22:18 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:22:18 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:18 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:22:18 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:22:18 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:22:18 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:25 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:22:25 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Triggering sync for uuid d997cdd6-67c6-4263-814a-17cf9e27bbeb {{(pid=75745) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 17:22:25 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Triggering sync for uuid e4ffb96e-456c-4fb9-9850-9e98310d63e5 {{(pid=75745) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 17:22:25 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Triggering sync for uuid 80962f79-dbb2-4380-b2c8-791642cfa86b {{(pid=75745) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 17:22:25 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Triggering sync for uuid a690fa65-078d-4ffd-bc62-3366aaa3d681 {{(pid=75745) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 17:22:25 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Triggering sync for uuid 5e631ac3-8122-46a3-a54f-2395c0f7cf7c {{(pid=75745) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 17:22:25 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Triggering sync for uuid b41b0b06-5f6d-4985-9f11-842f678ad1e6 {{(pid=75745) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 17:22:25 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Triggering sync for uuid 5aee52eb-78e3-4f60-a920-7ade912735e8 {{(pid=75745) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 17:22:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "d997cdd6-67c6-4263-814a-17cf9e27bbeb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:22:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "d997cdd6-67c6-4263-814a-17cf9e27bbeb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:22:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:22:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:22:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "80962f79-dbb2-4380-b2c8-791642cfa86b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:22:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "80962f79-dbb2-4380-b2c8-791642cfa86b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:22:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "a690fa65-078d-4ffd-bc62-3366aaa3d681" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:22:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "a690fa65-078d-4ffd-bc62-3366aaa3d681" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:22:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "5e631ac3-8122-46a3-a54f-2395c0f7cf7c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:22:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "5e631ac3-8122-46a3-a54f-2395c0f7cf7c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:22:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "b41b0b06-5f6d-4985-9f11-842f678ad1e6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:22:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "5aee52eb-78e3-4f60-a920-7ade912735e8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:22:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "5aee52eb-78e3-4f60-a920-7ade912735e8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:22:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "d997cdd6-67c6-4263-814a-17cf9e27bbeb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:22:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "80962f79-dbb2-4380-b2c8-791642cfa86b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:22:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:22:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "a690fa65-078d-4ffd-bc62-3366aaa3d681" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:22:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "5aee52eb-78e3-4f60-a920-7ade912735e8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:22:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "5e631ac3-8122-46a3-a54f-2395c0f7cf7c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAhEkWCH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:22:27 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:22:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:22:27 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:22:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:22:27 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:22:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[586ef10e-6225-45ab-a209-904300091067]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:22:27 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57ed86d-e9ce-4a49-b341-d4d8cf35ea26]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2] added
Dec 01 17:22:27 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a564bf-8ea3-441b-87d1-0c5d58e4c039]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[56453234-ce64-4640-a4b2-bf36086eb01e]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tAhEkWCH {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tAhEkWCH" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e547c56-cb5d-4e71-b9bf-41340532f948]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tAhEkWCH'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[971d1bca-4cae-4c46-85e8-336604e36f31]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[43425214-ca40-40c3-a529-3ecc1e1928a3]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:22:27 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:22:27 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9dbbcd-0748-462a-8ea3-d6e7900535d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2, portal: 172.16.0.220,3260]
Dec 01 17:22:27 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2, portal: 172.16.0.220,3260] successful.
Dec 01 17:22:27 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab44157-1b2a-449f-a1eb-823418c56dc9]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1445063-abc0-458c-943c-88c067f0584d]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:22:27 user nova-compute[75745]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 (non-flash)
Dec 01 17:22:27 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:22:27 user nova-compute[75745]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 (non-flash)
Dec 01 17:22:27 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7e5427-e17d-4eb1-9bda-776923d5de23]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:22:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAhEkWCH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:22:28 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:22:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23239313431373165', 'path': '/dev/sdc'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:22:28 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239313431373165', 'path': '/dev/sdc'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:22:28 user nova-compute[75745]: DEBUG nova.objects.instance [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lazy-loading 'flavor' on Instance uuid b41b0b06-5f6d-4985-9f11-842f678ad1e6 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:22:28 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 17:22:28 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:22:28 user nova-compute[75745]:   <source dev="/dev/sdc"/>
Dec 01 17:22:28 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:22:28 user nova-compute[75745]:   <serial>826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2</serial>
Dec 01 17:22:28 user nova-compute[75745]: </disk>
Dec 01 17:22:28 user nova-compute[75745]:  {{(pid=75745) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 17:22:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:22:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:22:29 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] No VIF found with MAC fa:16:3e:1a:39:b9, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:22:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d24ca8c4-e59e-4abc-ab8f-4ec5c8f3dba3 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "b41b0b06-5f6d-4985-9f11-842f678ad1e6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.444s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:22:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "b41b0b06-5f6d-4985-9f11-842f678ad1e6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.126s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:22:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "b41b0b06-5f6d-4985-9f11-842f678ad1e6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:22:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:22:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:22:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:22:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:22:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:22:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:22:35 user nova-compute[75745]: DEBUG nova.compute.manager [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:22:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:22:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:22:36 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:22:36 user nova-compute[75745]: INFO nova.compute.claims [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Claim successful on node user
Dec 01 17:22:36 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:22:36 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:22:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:22:36 user nova-compute[75745]: DEBUG nova.compute.manager [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:22:36 user nova-compute[75745]: DEBUG nova.compute.manager [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:22:36 user nova-compute[75745]: DEBUG nova.network.neutron [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:22:36 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:22:36 user nova-compute[75745]: DEBUG nova.compute.manager [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:22:36 user nova-compute[75745]: DEBUG nova.policy [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7bd90117cc3c433d953b7e0de3718f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4542114c14774241bb138dfafe3441ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:22:36 user nova-compute[75745]: DEBUG nova.compute.manager [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:22:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:22:36 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Creating image(s)
Dec 01 17:22:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "/opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:22:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "/opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:22:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "/opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:22:36 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:37 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.235s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:22:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:22:37 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:37 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.196s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:37 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:37 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk 1073741824" returned: 0 in 0.054s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:22:37 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:37 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.179s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:37 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:22:37 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:37 user nova-compute[75745]: DEBUG nova.network.neutron [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Successfully created port: d4c74908-1bd2-4891-b4d7-932d73d78217 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:22:37 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:37 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Cannot resize image /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:22:37 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:22:37 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Ensure instance console log exists: /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:22:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:22:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:22:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG nova.network.neutron [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Successfully updated port: d4c74908-1bd2-4891-b4d7-932d73d78217 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "refresh_cache-c358f18c-44c4-45d4-a1eb-4f259c36a0d9" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquired lock "refresh_cache-c358f18c-44c4-45d4-a1eb-4f259c36a0d9" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG nova.network.neutron [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG nova.compute.manager [req-cdbae068-68e0-4b2e-882c-61fae534d21d req-a04369f0-cad5-4b82-9b52-f9908284d5bc service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Received event network-changed-d4c74908-1bd2-4891-b4d7-932d73d78217 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG nova.compute.manager [req-cdbae068-68e0-4b2e-882c-61fae534d21d req-a04369f0-cad5-4b82-9b52-f9908284d5bc service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Refreshing instance network info cache due to event network-changed-d4c74908-1bd2-4891-b4d7-932d73d78217. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-cdbae068-68e0-4b2e-882c-61fae534d21d req-a04369f0-cad5-4b82-9b52-f9908284d5bc service nova] Acquiring lock "refresh_cache-c358f18c-44c4-45d4-a1eb-4f259c36a0d9" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG nova.network.neutron [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG nova.network.neutron [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Updating instance_info_cache with network_info: [{"id": "d4c74908-1bd2-4891-b4d7-932d73d78217", "address": "fa:16:3e:f0:97:04", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c74908-1b", "ovs_interfaceid": "d4c74908-1bd2-4891-b4d7-932d73d78217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Releasing lock "refresh_cache-c358f18c-44c4-45d4-a1eb-4f259c36a0d9" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG nova.compute.manager [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Instance network_info: |[{"id": "d4c74908-1bd2-4891-b4d7-932d73d78217", "address": "fa:16:3e:f0:97:04", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c74908-1b", "ovs_interfaceid": "d4c74908-1bd2-4891-b4d7-932d73d78217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-cdbae068-68e0-4b2e-882c-61fae534d21d req-a04369f0-cad5-4b82-9b52-f9908284d5bc service nova] Acquired lock "refresh_cache-c358f18c-44c4-45d4-a1eb-4f259c36a0d9" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG nova.network.neutron [req-cdbae068-68e0-4b2e-882c-61fae534d21d req-a04369f0-cad5-4b82-9b52-f9908284d5bc service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Refreshing network info cache for port d4c74908-1bd2-4891-b4d7-932d73d78217 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Start _get_guest_xml network_info=[{"id": "d4c74908-1bd2-4891-b4d7-932d73d78217", "address": "fa:16:3e:f0:97:04", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c74908-1b", "ovs_interfaceid": "d4c74908-1bd2-4891-b4d7-932d73d78217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:22:38 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:22:38 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:22:38 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:22:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1788989126',display_name='tempest-ServerRescueNegativeTestJSON-server-1788989126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1788989126',id=33,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8Ny/kflSsA/c+tWkGK85ReUuke09ZnT0oGtBWkatJTKiv30mPJKfLxH/UO+SRW8uuaOsr7cRtGJRij8ZM2s2C3b2cN6ruVTZIIna3IJLwAR8q4wG9dKDCFKwRXopbBew==',key_name='tempest-keypair-1045907146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4542114c14774241bb138dfafe3441ad',ramdisk_id='',reservation_id='r-3z4xnddl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1719994145',owner_user_name='tempest-ServerRescueNegativeTestJSON-1719994145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:22:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bd90117cc3c433d953b7e0de3718f0d',uuid=c358f18c-44c4-45d4-a1eb-4f259c36a0d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4c74908-1bd2-4891-b4d7-932d73d78217", "address": "fa:16:3e:f0:97:04", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c74908-1b", "ovs_interfaceid": "d4c74908-1bd2-4891-b4d7-932d73d78217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Converting VIF {"id": "d4c74908-1bd2-4891-b4d7-932d73d78217", "address": "fa:16:3e:f0:97:04", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c74908-1b", "ovs_interfaceid": "d4c74908-1bd2-4891-b4d7-932d73d78217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:97:04,bridge_name='br-int',has_traffic_filtering=True,id=d4c74908-1bd2-4891-b4d7-932d73d78217,network=Network(fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4c74908-1b') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG nova.objects.instance [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lazy-loading 'pci_devices' on Instance uuid c358f18c-44c4-45d4-a1eb-4f259c36a0d9 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:22:38 user nova-compute[75745]:   <uuid>c358f18c-44c4-45d4-a1eb-4f259c36a0d9</uuid>
Dec 01 17:22:38 user nova-compute[75745]:   <name>instance-00000021</name>
Dec 01 17:22:38 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:22:38 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:22:38 user nova-compute[75745]:   <metadata>
Dec 01 17:22:38 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:22:38 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:22:38 user nova-compute[75745]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1788989126</nova:name>
Dec 01 17:22:38 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:22:38</nova:creationTime>
Dec 01 17:22:38 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:22:38 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:22:38 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:22:38 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:22:38 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:22:38 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:22:38 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:22:38 user nova-compute[75745]:       <nova:owner>
Dec 01 17:22:38 user nova-compute[75745]:         <nova:user uuid="7bd90117cc3c433d953b7e0de3718f0d">tempest-ServerRescueNegativeTestJSON-1719994145-project-member</nova:user>
Dec 01 17:22:38 user nova-compute[75745]:         <nova:project uuid="4542114c14774241bb138dfafe3441ad">tempest-ServerRescueNegativeTestJSON-1719994145</nova:project>
Dec 01 17:22:38 user nova-compute[75745]:       </nova:owner>
Dec 01 17:22:38 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:22:38 user nova-compute[75745]:       <nova:ports>
Dec 01 17:22:38 user nova-compute[75745]:         <nova:port uuid="d4c74908-1bd2-4891-b4d7-932d73d78217">
Dec 01 17:22:38 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 01 17:22:38 user nova-compute[75745]:         </nova:port>
Dec 01 17:22:38 user nova-compute[75745]:       </nova:ports>
Dec 01 17:22:38 user nova-compute[75745]:     </nova:instance>
Dec 01 17:22:38 user nova-compute[75745]:   </metadata>
Dec 01 17:22:38 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:22:38 user nova-compute[75745]:     <system>
Dec 01 17:22:38 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:22:38 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:22:38 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:22:38 user nova-compute[75745]:       <entry name="serial">c358f18c-44c4-45d4-a1eb-4f259c36a0d9</entry>
Dec 01 17:22:38 user nova-compute[75745]:       <entry name="uuid">c358f18c-44c4-45d4-a1eb-4f259c36a0d9</entry>
Dec 01 17:22:38 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:22:38 user nova-compute[75745]:     </system>
Dec 01 17:22:38 user nova-compute[75745]:   </sysinfo>
Dec 01 17:22:38 user nova-compute[75745]:   <os>
Dec 01 17:22:38 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:22:38 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:22:38 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:22:38 user nova-compute[75745]:   </os>
Dec 01 17:22:38 user nova-compute[75745]:   <features>
Dec 01 17:22:38 user nova-compute[75745]:     <acpi/>
Dec 01 17:22:38 user nova-compute[75745]:     <apic/>
Dec 01 17:22:38 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:22:38 user nova-compute[75745]:   </features>
Dec 01 17:22:38 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:22:38 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:22:38 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:22:38 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:22:38 user nova-compute[75745]:   </clock>
Dec 01 17:22:38 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:22:38 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:22:38 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:22:38 user nova-compute[75745]:   </cpu>
Dec 01 17:22:38 user nova-compute[75745]:   <devices>
Dec 01 17:22:38 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:22:38 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:22:38 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk"/>
Dec 01 17:22:38 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:22:38 user nova-compute[75745]:     </disk>
Dec 01 17:22:38 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:22:38 user nova-compute[75745]:       <mac address="fa:16:3e:f0:97:04"/>
Dec 01 17:22:38 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:22:38 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:22:38 user nova-compute[75745]:       <target dev="tapd4c74908-1b"/>
Dec 01 17:22:38 user nova-compute[75745]:     </interface>
Dec 01 17:22:38 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:22:38 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/console.log" append="off"/>
Dec 01 17:22:38 user nova-compute[75745]:     </serial>
Dec 01 17:22:38 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:22:38 user nova-compute[75745]:     <video>
Dec 01 17:22:38 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:22:38 user nova-compute[75745]:     </video>
Dec 01 17:22:38 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:22:38 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:22:38 user nova-compute[75745]:     </rng>
Dec 01 17:22:38 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:22:38 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:22:38 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:22:38 user nova-compute[75745]:     </memballoon>
Dec 01 17:22:38 user nova-compute[75745]:   </devices>
Dec 01 17:22:38 user nova-compute[75745]: </domain>
Dec 01 17:22:38 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:22:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1788989126',display_name='tempest-ServerRescueNegativeTestJSON-server-1788989126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1788989126',id=33,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8Ny/kflSsA/c+tWkGK85ReUuke09ZnT0oGtBWkatJTKiv30mPJKfLxH/UO+SRW8uuaOsr7cRtGJRij8ZM2s2C3b2cN6ruVTZIIna3IJLwAR8q4wG9dKDCFKwRXopbBew==',key_name='tempest-keypair-1045907146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4542114c14774241bb138dfafe3441ad',ramdisk_id='',reservation_id='r-3z4xnddl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1719994145',owner_user_name='tempest-ServerRescueNegativeTestJSON-1719994145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:22:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bd90117cc3c433d953b7e0de3718f0d',uuid=c358f18c-44c4-45d4-a1eb-4f259c36a0d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4c74908-1bd2-4891-b4d7-932d73d78217", "address": "fa:16:3e:f0:97:04", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c74908-1b", "ovs_interfaceid": "d4c74908-1bd2-4891-b4d7-932d73d78217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Converting VIF {"id": "d4c74908-1bd2-4891-b4d7-932d73d78217", "address": "fa:16:3e:f0:97:04", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c74908-1b", "ovs_interfaceid": "d4c74908-1bd2-4891-b4d7-932d73d78217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:97:04,bridge_name='br-int',has_traffic_filtering=True,id=d4c74908-1bd2-4891-b4d7-932d73d78217,network=Network(fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4c74908-1b') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG os_vif [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:97:04,bridge_name='br-int',has_traffic_filtering=True,id=d4c74908-1bd2-4891-b4d7-932d73d78217,network=Network(fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4c74908-1b') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b1575962-cece-5103-a23a-4bce3125df4a', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4c74908-1b, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd4c74908-1b, col_values=(('qos', UUID('09284a82-a505-42b8-86c4-1cd7308a41da')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd4c74908-1b, col_values=(('external_ids', {'iface-id': 'd4c74908-1bd2-4891-b4d7-932d73d78217', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:97:04', 'vm-uuid': 'c358f18c-44c4-45d4-a1eb-4f259c36a0d9'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:38 user nova-compute[75745]: INFO os_vif [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:97:04,bridge_name='br-int',has_traffic_filtering=True,id=d4c74908-1bd2-4891-b4d7-932d73d78217,network=Network(fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4c74908-1b')
Dec 01 17:22:38 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:22:38 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] No VIF found with MAC fa:16:3e:f0:97:04, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:22:39 user nova-compute[75745]: DEBUG nova.network.neutron [req-cdbae068-68e0-4b2e-882c-61fae534d21d req-a04369f0-cad5-4b82-9b52-f9908284d5bc service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Updated VIF entry in instance network info cache for port d4c74908-1bd2-4891-b4d7-932d73d78217. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:22:39 user nova-compute[75745]: DEBUG nova.network.neutron [req-cdbae068-68e0-4b2e-882c-61fae534d21d req-a04369f0-cad5-4b82-9b52-f9908284d5bc service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Updating instance_info_cache with network_info: [{"id": "d4c74908-1bd2-4891-b4d7-932d73d78217", "address": "fa:16:3e:f0:97:04", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c74908-1b", "ovs_interfaceid": "d4c74908-1bd2-4891-b4d7-932d73d78217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:22:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-cdbae068-68e0-4b2e-882c-61fae534d21d req-a04369f0-cad5-4b82-9b52-f9908284d5bc service nova] Releasing lock "refresh_cache-c358f18c-44c4-45d4-a1eb-4f259c36a0d9" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:22:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:40 user nova-compute[75745]: DEBUG nova.compute.manager [req-2fa8ec0d-6fd6-4164-9c24-2263f5538b39 req-01ef1419-c8b2-42b0-8e46-c77d15cc9b15 service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Received event network-vif-plugged-d4c74908-1bd2-4891-b4d7-932d73d78217 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:22:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2fa8ec0d-6fd6-4164-9c24-2263f5538b39 req-01ef1419-c8b2-42b0-8e46-c77d15cc9b15 service nova] Acquiring lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:22:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2fa8ec0d-6fd6-4164-9c24-2263f5538b39 req-01ef1419-c8b2-42b0-8e46-c77d15cc9b15 service nova] Lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:22:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2fa8ec0d-6fd6-4164-9c24-2263f5538b39 req-01ef1419-c8b2-42b0-8e46-c77d15cc9b15 service nova] Lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:22:40 user nova-compute[75745]: DEBUG nova.compute.manager [req-2fa8ec0d-6fd6-4164-9c24-2263f5538b39 req-01ef1419-c8b2-42b0-8e46-c77d15cc9b15 service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] No waiting events found dispatching network-vif-plugged-d4c74908-1bd2-4891-b4d7-932d73d78217 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:22:40 user nova-compute[75745]: WARNING nova.compute.manager [req-2fa8ec0d-6fd6-4164-9c24-2263f5538b39 req-01ef1419-c8b2-42b0-8e46-c77d15cc9b15 service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Received unexpected event network-vif-plugged-d4c74908-1bd2-4891-b4d7-932d73d78217 for instance with vm_state building and task_state spawning.
Dec 01 17:22:42 user nova-compute[75745]: DEBUG nova.compute.manager [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:22:42 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:22:42 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Instance spawned successfully.
Dec 01 17:22:42 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:22:42 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:22:42 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:22:42 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:22:42 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:22:42 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:22:42 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:22:42 user nova-compute[75745]: INFO nova.compute.manager [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Took 6.02 seconds to spawn the instance on the hypervisor.
Dec 01 17:22:42 user nova-compute[75745]: DEBUG nova.compute.manager [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:22:42 user nova-compute[75745]: INFO nova.compute.manager [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Took 6.83 seconds to build instance.
Dec 01 17:22:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-95b01d6c-c869-43b1-b3e3-83f8957b39b4 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.961s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:22:42 user nova-compute[75745]: DEBUG nova.compute.manager [req-50abd4ed-a781-4ac4-bccb-8470391a74cc req-ca00c245-f550-4e6d-bbcd-bc1f1203aebb service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Received event network-vif-plugged-d4c74908-1bd2-4891-b4d7-932d73d78217 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:22:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-50abd4ed-a781-4ac4-bccb-8470391a74cc req-ca00c245-f550-4e6d-bbcd-bc1f1203aebb service nova] Acquiring lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:22:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-50abd4ed-a781-4ac4-bccb-8470391a74cc req-ca00c245-f550-4e6d-bbcd-bc1f1203aebb service nova] Lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:22:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-50abd4ed-a781-4ac4-bccb-8470391a74cc req-ca00c245-f550-4e6d-bbcd-bc1f1203aebb service nova] Lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:22:42 user nova-compute[75745]: DEBUG nova.compute.manager [req-50abd4ed-a781-4ac4-bccb-8470391a74cc req-ca00c245-f550-4e6d-bbcd-bc1f1203aebb service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] No waiting events found dispatching network-vif-plugged-d4c74908-1bd2-4891-b4d7-932d73d78217 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:22:42 user nova-compute[75745]: WARNING nova.compute.manager [req-50abd4ed-a781-4ac4-bccb-8470391a74cc req-ca00c245-f550-4e6d-bbcd-bc1f1203aebb service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Received unexpected event network-vif-plugged-d4c74908-1bd2-4891-b4d7-932d73d78217 for instance with vm_state active and task_state None.
Dec 01 17:22:43 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:22:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:22:44 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:22:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:22:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:22:44 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:22:44 user nova-compute[75745]: INFO nova.compute.claims [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Claim successful on node user
Dec 01 17:22:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:45 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:22:45 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:22:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.647s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:22:45 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:22:45 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:22:45 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:22:45 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:22:45 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:22:45 user nova-compute[75745]: DEBUG nova.policy [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5204ecaa9b354d10bac514c27acbccc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409356993ea442c5abdf4269aebe43ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:22:45 user nova-compute[75745]: INFO nova.virt.block_device [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Booting with volume 0457077a-1184-47fe-a03d-ceedda41d0df at /dev/vda
Dec 01 17:22:46 user nova-compute[75745]: DEBUG os_brick.utils [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:22:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:46 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f04e03-afaa-491e-b76f-10d8e605f832]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:22:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:46 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[218267c8-77ad-456f-886f-2cd90e8cb600]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:22:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:46 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[70598549-33f5-4f99-870a-3e3308267835]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:22:46 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec5fd23-cd70-4904-8d10-c66443df0986]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:22:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:22:46 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:22:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:22:46 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:22:46 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[383eaa24-27bb-48fc-8f2e-c394a4cbad7c]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:22:46 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:22:46 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:22:46 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:22:46 user nova-compute[75745]: DEBUG os_brick.utils [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:22:46 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Updating existing volume attachment record: f3412dd6-42f9-41d8-9d68-8cce21667b25 {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:22:47 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Successfully created port: eeff2c22-349b-42cf-9290-6efccc7686d6 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:22:48 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Successfully updated port: eeff2c22-349b-42cf-9290-6efccc7686d6 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:22:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "refresh_cache-2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:22:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquired lock "refresh_cache-2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:22:48 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:22:48 user nova-compute[75745]: DEBUG nova.compute.manager [req-4c358e5c-d305-42cc-9fb9-b63db4156a2d req-cf09a361-d73c-4fa3-a720-16a428c90cb2 service nova] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Received event network-changed-eeff2c22-349b-42cf-9290-6efccc7686d6 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:22:48 user nova-compute[75745]: DEBUG nova.compute.manager [req-4c358e5c-d305-42cc-9fb9-b63db4156a2d req-cf09a361-d73c-4fa3-a720-16a428c90cb2 service nova] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Refreshing instance network info cache due to event network-changed-eeff2c22-349b-42cf-9290-6efccc7686d6. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:22:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-4c358e5c-d305-42cc-9fb9-b63db4156a2d req-cf09a361-d73c-4fa3-a720-16a428c90cb2 service nova] Acquiring lock "refresh_cache-2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:22:48 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:22:48 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Updating instance_info_cache with network_info: [{"id": "eeff2c22-349b-42cf-9290-6efccc7686d6", "address": "fa:16:3e:67:06:2e", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeff2c22-34", "ovs_interfaceid": "eeff2c22-349b-42cf-9290-6efccc7686d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:22:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Releasing lock "refresh_cache-2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:22:48 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Instance network_info: |[{"id": "eeff2c22-349b-42cf-9290-6efccc7686d6", "address": "fa:16:3e:67:06:2e", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeff2c22-34", "ovs_interfaceid": "eeff2c22-349b-42cf-9290-6efccc7686d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:22:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-4c358e5c-d305-42cc-9fb9-b63db4156a2d req-cf09a361-d73c-4fa3-a720-16a428c90cb2 service nova] Acquired lock "refresh_cache-2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:22:48 user nova-compute[75745]: DEBUG nova.network.neutron [req-4c358e5c-d305-42cc-9fb9-b63db4156a2d req-cf09a361-d73c-4fa3-a720-16a428c90cb2 service nova] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Refreshing network info cache for port eeff2c22-349b-42cf-9290-6efccc7686d6 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:22:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:49 user nova-compute[75745]: DEBUG nova.network.neutron [req-4c358e5c-d305-42cc-9fb9-b63db4156a2d req-cf09a361-d73c-4fa3-a720-16a428c90cb2 service nova] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Updated VIF entry in instance network info cache for port eeff2c22-349b-42cf-9290-6efccc7686d6. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:22:49 user nova-compute[75745]: DEBUG nova.network.neutron [req-4c358e5c-d305-42cc-9fb9-b63db4156a2d req-cf09a361-d73c-4fa3-a720-16a428c90cb2 service nova] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Updating instance_info_cache with network_info: [{"id": "eeff2c22-349b-42cf-9290-6efccc7686d6", "address": "fa:16:3e:67:06:2e", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeff2c22-34", "ovs_interfaceid": "eeff2c22-349b-42cf-9290-6efccc7686d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:22:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-4c358e5c-d305-42cc-9fb9-b63db4156a2d req-cf09a361-d73c-4fa3-a720-16a428c90cb2 service nova] Releasing lock "refresh_cache-2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:22:49 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:22:49 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:22:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:50 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:22:50 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:22:52 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:22:52 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:22:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:22:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:22:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:22:52 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:22:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41b0b06-5f6d-4985-9f11-842f678ad1e6/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41b0b06-5f6d-4985-9f11-842f678ad1e6/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41b0b06-5f6d-4985-9f11-842f678ad1e6/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41b0b06-5f6d-4985-9f11-842f678ad1e6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:55 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:22:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:22:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Acquiring lock "b41b0b06-5f6d-4985-9f11-842f678ad1e6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:22:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "b41b0b06-5f6d-4985-9f11-842f678ad1e6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:22:56 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:22:56 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:22:56 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=8171MB free_disk=25.332534790039062GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:22:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:22:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:22:57 user nova-compute[75745]: INFO nova.compute.manager [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Detaching volume 826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Acquiring lock "b41b0b06-5f6d-4985-9f11-842f678ad1e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:22:57 user nova-compute[75745]: INFO nova.virt.block_device [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Attempting to driver detach volume 826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 from mountpoint /dev/vdb
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Attempting to detach device vdb from instance b41b0b06-5f6d-4985-9f11-842f678ad1e6 from the persistent domain config. {{(pid=75745) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:22:57 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:22:57 user nova-compute[75745]:   <source dev="/dev/sdc"/>
Dec 01 17:22:57 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:22:57 user nova-compute[75745]:   <serial>826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2</serial>
Dec 01 17:22:57 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 17:22:57 user nova-compute[75745]: </disk>
Dec 01 17:22:57 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:22:57 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Successfully detached device vdb from instance b41b0b06-5f6d-4985-9f11-842f678ad1e6 from the persistent domain config.
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b41b0b06-5f6d-4985-9f11-842f678ad1e6 from the live domain config. {{(pid=75745) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:22:57 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:22:57 user nova-compute[75745]:   <source dev="/dev/sdc"/>
Dec 01 17:22:57 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:22:57 user nova-compute[75745]:   <serial>826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2</serial>
Dec 01 17:22:57 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 17:22:57 user nova-compute[75745]: </disk>
Dec 01 17:22:57 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:22:57 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Creating image(s)
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Did not create local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Ensure instance console log exists: /opt/stack/data/nova/instances/2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Start _get_guest_xml network_info=[{"id": "eeff2c22-349b-42cf-9290-6efccc7686d6", "address": "fa:16:3e:67:06:2e", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeff2c22-34", "ovs_interfaceid": "eeff2c22-349b-42cf-9290-6efccc7686d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': 'f3412dd6-42f9-41d8-9d68-8cce21667b25', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DeWhlKJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13', 'attached_at': '', 'detached_at': '', 'volume_id': '0457077a-1184-47fe-a03d-ceedda41d0df', 'serial': '0457077a-1184-47fe-a03d-ceedda41d0df'}, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:22:57 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:22:57 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DeWhlKJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:22:57 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:22:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:22:57 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:22:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:22:57 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[368af3c0-d420-4c8a-8ef1-98f0187685d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:22:57 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2746e86-296c-4a09-9703-9bec569a1d59]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df] added
Dec 01 17:22:57 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance d997cdd6-67c6-4263-814a-17cf9e27bbeb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance e4ffb96e-456c-4fb9-9850-9e98310d63e5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 80962f79-dbb2-4380-b2c8-791642cfa86b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance a690fa65-078d-4ffd-bc62-3366aaa3d681 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 5e631ac3-8122-46a3-a54f-2395c0f7cf7c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance b41b0b06-5f6d-4985-9f11-842f678ad1e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 5aee52eb-78e3-4f60-a920-7ade912735e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance c358f18c-44c4-45d4-a1eb-4f259c36a0d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bb519f-6826-4bdf-b60d-40e0e8452646]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b20c4a-45e2-462d-b187-a7ff12245dea]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DeWhlKJB {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Refreshing inventories for resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DeWhlKJB" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1166bb60-312d-43ad-9318-083d87872290]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DeWhlKJB'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Updating ProviderTree inventory for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Updating inventory in ProviderTree for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[888e9413-f744-4f33-91be-fed71cdb55cb]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Refreshing aggregate associations for resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9, aggregates: None {{(pid=75745) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa35542-0a72-4e60-9949-509a11ccfd63]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:22:57 user nova-compute[75745]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 (non-flash)
Dec 01 17:22:57 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:22:57 user nova-compute[75745]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 (non-flash)
Dec 01 17:22:57 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Refreshing trait associations for resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9, traits: COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=75745) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[277a0a9a-d934-43bb-af03-1d18d204d7ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df, portal: 172.16.0.220,3260]
Dec 01 17:22:57 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df, portal: 172.16.0.220,3260] successful.
Dec 01 17:22:57 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0070c145-5294-4bb0-a984-25247e0e895b]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce42566d-da62-4d5d-a8ea-9cf6d539350e]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:22:57 user nova-compute[75745]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 (non-flash)
Dec 01 17:22:57 user nova-compute[75745]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:22:57 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:22:57 user nova-compute[75745]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 (non-flash)
Dec 01 17:22:57 user nova-compute[75745]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:22:57 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f10369-d783-44b5-a4b4-cc9bef50cd39]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: None {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b41b0b06-5f6d-4985-9f11-842f678ad1e6 {{(pid=75745) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:22:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.900s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:22:58 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:22:58 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DeWhlKJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:22:58 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:22:58 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '26365393231383963', 'path': '/dev/sdd'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:22:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365393231383963', 'path': '/dev/sdd'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:22:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:22:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1848665207',display_name='tempest-ServerActionsTestOtherA-server-1848665207',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1848665207',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEe39hBsqXh7qTHbR/1n4TCThkWTxdl0f3mcj7VutursSM+B5AqiMiKGVg5IqL9MYbDfyNfGcyjgOxxpAU4qczogEswNK8dvSit+JyFqtuJxlzPiy3ZkcIr+yzYcqZB0A==',key_name='tempest-keypair-3711887',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='409356993ea442c5abdf4269aebe43ab',ramdisk_id='',reservation_id='r-0dzhv7we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1500186869',owner_user_name='tempest-ServerActionsTestOtherA-1500186869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5204ecaa9b354d10bac514c27acbccc6',uuid=2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eeff2c22-349b-42cf-9290-6efccc7686d6", "address": "fa:16:3e:67:06:2e", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeff2c22-34", "ovs_interfaceid": "eeff2c22-349b-42cf-9290-6efccc7686d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:22:58 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Converting VIF {"id": "eeff2c22-349b-42cf-9290-6efccc7686d6", "address": "fa:16:3e:67:06:2e", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeff2c22-34", "ovs_interfaceid": "eeff2c22-349b-42cf-9290-6efccc7686d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:22:58 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:06:2e,bridge_name='br-int',has_traffic_filtering=True,id=eeff2c22-349b-42cf-9290-6efccc7686d6,network=Network(f7cefc9d-2279-4601-8a81-a640ad1aea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeff2c22-34') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:22:58 user nova-compute[75745]: DEBUG nova.objects.instance [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:22:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:22:58 user nova-compute[75745]:   <uuid>2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13</uuid>
Dec 01 17:22:58 user nova-compute[75745]:   <name>instance-00000022</name>
Dec 01 17:22:58 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:22:58 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:22:58 user nova-compute[75745]:   <metadata>
Dec 01 17:22:58 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:22:58 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:22:58 user nova-compute[75745]:       <nova:name>tempest-ServerActionsTestOtherA-server-1848665207</nova:name>
Dec 01 17:22:58 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:22:57</nova:creationTime>
Dec 01 17:22:58 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:22:58 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:22:58 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:22:58 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:22:58 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:22:58 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:22:58 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:22:58 user nova-compute[75745]:       <nova:owner>
Dec 01 17:22:58 user nova-compute[75745]:         <nova:user uuid="5204ecaa9b354d10bac514c27acbccc6">tempest-ServerActionsTestOtherA-1500186869-project-member</nova:user>
Dec 01 17:22:58 user nova-compute[75745]:         <nova:project uuid="409356993ea442c5abdf4269aebe43ab">tempest-ServerActionsTestOtherA-1500186869</nova:project>
Dec 01 17:22:58 user nova-compute[75745]:       </nova:owner>
Dec 01 17:22:58 user nova-compute[75745]:       <nova:ports>
Dec 01 17:22:58 user nova-compute[75745]:         <nova:port uuid="eeff2c22-349b-42cf-9290-6efccc7686d6">
Dec 01 17:22:58 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 01 17:22:58 user nova-compute[75745]:         </nova:port>
Dec 01 17:22:58 user nova-compute[75745]:       </nova:ports>
Dec 01 17:22:58 user nova-compute[75745]:     </nova:instance>
Dec 01 17:22:58 user nova-compute[75745]:   </metadata>
Dec 01 17:22:58 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:22:58 user nova-compute[75745]:     <system>
Dec 01 17:22:58 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:22:58 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:22:58 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:22:58 user nova-compute[75745]:       <entry name="serial">2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13</entry>
Dec 01 17:22:58 user nova-compute[75745]:       <entry name="uuid">2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13</entry>
Dec 01 17:22:58 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:22:58 user nova-compute[75745]:     </system>
Dec 01 17:22:58 user nova-compute[75745]:   </sysinfo>
Dec 01 17:22:58 user nova-compute[75745]:   <os>
Dec 01 17:22:58 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:22:58 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:22:58 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:22:58 user nova-compute[75745]:   </os>
Dec 01 17:22:58 user nova-compute[75745]:   <features>
Dec 01 17:22:58 user nova-compute[75745]:     <acpi/>
Dec 01 17:22:58 user nova-compute[75745]:     <apic/>
Dec 01 17:22:58 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:22:58 user nova-compute[75745]:   </features>
Dec 01 17:22:58 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:22:58 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:22:58 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:22:58 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:22:58 user nova-compute[75745]:   </clock>
Dec 01 17:22:58 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:22:58 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:22:58 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:22:58 user nova-compute[75745]:   </cpu>
Dec 01 17:22:58 user nova-compute[75745]:   <devices>
Dec 01 17:22:58 user nova-compute[75745]:     <disk type="block" device="disk">
Dec 01 17:22:58 user nova-compute[75745]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:22:58 user nova-compute[75745]:       <source dev="/dev/sdd"/>
Dec 01 17:22:58 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:22:58 user nova-compute[75745]:       <serial>0457077a-1184-47fe-a03d-ceedda41d0df</serial>
Dec 01 17:22:58 user nova-compute[75745]:     </disk>
Dec 01 17:22:58 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:22:58 user nova-compute[75745]:       <mac address="fa:16:3e:67:06:2e"/>
Dec 01 17:22:58 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:22:58 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:22:58 user nova-compute[75745]:       <target dev="tapeeff2c22-34"/>
Dec 01 17:22:58 user nova-compute[75745]:     </interface>
Dec 01 17:22:58 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:22:58 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13/console.log" append="off"/>
Dec 01 17:22:58 user nova-compute[75745]:     </serial>
Dec 01 17:22:58 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:22:58 user nova-compute[75745]:     <video>
Dec 01 17:22:58 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:22:58 user nova-compute[75745]:     </video>
Dec 01 17:22:58 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:22:58 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:22:58 user nova-compute[75745]:     </rng>
Dec 01 17:22:58 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:22:58 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:22:58 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:22:58 user nova-compute[75745]:     </memballoon>
Dec 01 17:22:58 user nova-compute[75745]:   </devices>
Dec 01 17:22:58 user nova-compute[75745]: </domain>
Dec 01 17:22:58 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:22:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:22:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1848665207',display_name='tempest-ServerActionsTestOtherA-server-1848665207',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1848665207',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEe39hBsqXh7qTHbR/1n4TCThkWTxdl0f3mcj7VutursSM+B5AqiMiKGVg5IqL9MYbDfyNfGcyjgOxxpAU4qczogEswNK8dvSit+JyFqtuJxlzPiy3ZkcIr+yzYcqZB0A==',key_name='tempest-keypair-3711887',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='409356993ea442c5abdf4269aebe43ab',ramdisk_id='',reservation_id='r-0dzhv7we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1500186869',owner_user_name='tempest-ServerActionsTestOtherA-1500186869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5204ecaa9b354d10bac514c27acbccc6',uuid=2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eeff2c22-349b-42cf-9290-6efccc7686d6", "address": "fa:16:3e:67:06:2e", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeff2c22-34", "ovs_interfaceid": "eeff2c22-349b-42cf-9290-6efccc7686d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:22:58 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Converting VIF {"id": "eeff2c22-349b-42cf-9290-6efccc7686d6", "address": "fa:16:3e:67:06:2e", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeff2c22-34", "ovs_interfaceid": "eeff2c22-349b-42cf-9290-6efccc7686d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:22:58 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:06:2e,bridge_name='br-int',has_traffic_filtering=True,id=eeff2c22-349b-42cf-9290-6efccc7686d6,network=Network(f7cefc9d-2279-4601-8a81-a640ad1aea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeff2c22-34') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:22:58 user nova-compute[75745]: DEBUG os_vif [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:06:2e,bridge_name='br-int',has_traffic_filtering=True,id=eeff2c22-349b-42cf-9290-6efccc7686d6,network=Network(f7cefc9d-2279-4601-8a81-a640ad1aea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeff2c22-34') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:22:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:22:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:22:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '851172fb-a582-520d-9dde-7fa5759092f4', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:22:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:22:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeeff2c22-34, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:22:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeeff2c22-34, col_values=(('qos', UUID('e025641c-be21-4a08-baf7-24651e7faa14')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:22:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeeff2c22-34, col_values=(('external_ids', {'iface-id': 'eeff2c22-349b-42cf-9290-6efccc7686d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:06:2e', 'vm-uuid': '2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:22:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:22:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:22:58 user nova-compute[75745]: INFO os_vif [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:06:2e,bridge_name='br-int',has_traffic_filtering=True,id=eeff2c22-349b-42cf-9290-6efccc7686d6,network=Network(f7cefc9d-2279-4601-8a81-a640ad1aea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeff2c22-34')
Dec 01 17:22:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:22:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] No VIF found with MAC fa:16:3e:67:06:2e, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:22:58 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:22:58 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:22:58 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:23:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:00 user nova-compute[75745]: DEBUG nova.compute.manager [req-108cb2d9-223b-4cf7-8cc0-f6aeb5ccffaf req-41b81094-3a1c-4896-bf33-d4d50b4c7f3b service nova] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Received event network-vif-plugged-eeff2c22-349b-42cf-9290-6efccc7686d6 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:23:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-108cb2d9-223b-4cf7-8cc0-f6aeb5ccffaf req-41b81094-3a1c-4896-bf33-d4d50b4c7f3b service nova] Acquiring lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:23:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-108cb2d9-223b-4cf7-8cc0-f6aeb5ccffaf req-41b81094-3a1c-4896-bf33-d4d50b4c7f3b service nova] Lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:23:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-108cb2d9-223b-4cf7-8cc0-f6aeb5ccffaf req-41b81094-3a1c-4896-bf33-d4d50b4c7f3b service nova] Lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:23:00 user nova-compute[75745]: DEBUG nova.compute.manager [req-108cb2d9-223b-4cf7-8cc0-f6aeb5ccffaf req-41b81094-3a1c-4896-bf33-d4d50b4c7f3b service nova] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] No waiting events found dispatching network-vif-plugged-eeff2c22-349b-42cf-9290-6efccc7686d6 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:23:00 user nova-compute[75745]: WARNING nova.compute.manager [req-108cb2d9-223b-4cf7-8cc0-f6aeb5ccffaf req-41b81094-3a1c-4896-bf33-d4d50b4c7f3b service nova] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Received unexpected event network-vif-plugged-eeff2c22-349b-42cf-9290-6efccc7686d6 for instance with vm_state building and task_state spawning.
Dec 01 17:23:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:00 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:23:00 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:23:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-a690fa65-078d-4ffd-bc62-3366aaa3d681" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:23:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-a690fa65-078d-4ffd-bc62-3366aaa3d681" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:23:00 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:23:01 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Updating instance_info_cache with network_info: [{"id": "09c7de0f-2e4a-4fda-993c-bd5f781692eb", "address": "fa:16:3e:38:8b:25", "network": {"id": "3b2feb84-7495-4ea1-8eb4-6fcb4763a75a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1599091175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0d8924495d400d978d7107a78b3167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c7de0f-2e", "ovs_interfaceid": "09c7de0f-2e4a-4fda-993c-bd5f781692eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:23:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-a690fa65-078d-4ffd-bc62-3366aaa3d681" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:23:01 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:23:02 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:23:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:23:02 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Instance spawned successfully.
Dec 01 17:23:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:23:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:23:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:23:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:23:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:23:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:23:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:23:02 user nova-compute[75745]: DEBUG nova.compute.manager [req-e0465d69-020f-40fe-8792-bfc0e0875402 req-f62e2231-bfcd-4567-af74-941420da14e2 service nova] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Received event network-vif-plugged-eeff2c22-349b-42cf-9290-6efccc7686d6 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:23:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e0465d69-020f-40fe-8792-bfc0e0875402 req-f62e2231-bfcd-4567-af74-941420da14e2 service nova] Acquiring lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:23:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e0465d69-020f-40fe-8792-bfc0e0875402 req-f62e2231-bfcd-4567-af74-941420da14e2 service nova] Lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:23:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e0465d69-020f-40fe-8792-bfc0e0875402 req-f62e2231-bfcd-4567-af74-941420da14e2 service nova] Lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:23:02 user nova-compute[75745]: DEBUG nova.compute.manager [req-e0465d69-020f-40fe-8792-bfc0e0875402 req-f62e2231-bfcd-4567-af74-941420da14e2 service nova] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] No waiting events found dispatching network-vif-plugged-eeff2c22-349b-42cf-9290-6efccc7686d6 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:23:02 user nova-compute[75745]: WARNING nova.compute.manager [req-e0465d69-020f-40fe-8792-bfc0e0875402 req-f62e2231-bfcd-4567-af74-941420da14e2 service nova] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Received unexpected event network-vif-plugged-eeff2c22-349b-42cf-9290-6efccc7686d6 for instance with vm_state building and task_state spawning.
Dec 01 17:23:02 user nova-compute[75745]: INFO nova.compute.manager [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Took 5.18 seconds to spawn the instance on the hypervisor.
Dec 01 17:23:02 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:23:02 user nova-compute[75745]: INFO nova.compute.manager [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Took 17.54 seconds to build instance.
Dec 01 17:23:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d01fa524-a9bb-4868-84b3-08fecec2dbd0 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.661s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:23:03 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8c2bd34e-f943-4f7f-90ab-b554470c2916 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Acquiring lock "a690fa65-078d-4ffd-bc62-3366aaa3d681" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:23:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8c2bd34e-f943-4f7f-90ab-b554470c2916 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Lock "a690fa65-078d-4ffd-bc62-3366aaa3d681" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:23:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8c2bd34e-f943-4f7f-90ab-b554470c2916 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Acquiring lock "a690fa65-078d-4ffd-bc62-3366aaa3d681-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:23:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8c2bd34e-f943-4f7f-90ab-b554470c2916 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Lock "a690fa65-078d-4ffd-bc62-3366aaa3d681-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:23:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8c2bd34e-f943-4f7f-90ab-b554470c2916 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Lock "a690fa65-078d-4ffd-bc62-3366aaa3d681-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:23:05 user nova-compute[75745]: INFO nova.compute.manager [None req-8c2bd34e-f943-4f7f-90ab-b554470c2916 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Terminating instance
Dec 01 17:23:05 user nova-compute[75745]: DEBUG nova.compute.manager [None req-8c2bd34e-f943-4f7f-90ab-b554470c2916 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:23:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:06 user nova-compute[75745]: DEBUG nova.compute.manager [req-57dff4db-5f2a-4b30-8c19-817b653c626c req-3993f466-07f5-4f51-81fc-08c538b3c234 service nova] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Received event network-vif-unplugged-09c7de0f-2e4a-4fda-993c-bd5f781692eb {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:23:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-57dff4db-5f2a-4b30-8c19-817b653c626c req-3993f466-07f5-4f51-81fc-08c538b3c234 service nova] Acquiring lock "a690fa65-078d-4ffd-bc62-3366aaa3d681-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:23:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-57dff4db-5f2a-4b30-8c19-817b653c626c req-3993f466-07f5-4f51-81fc-08c538b3c234 service nova] Lock "a690fa65-078d-4ffd-bc62-3366aaa3d681-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:23:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-57dff4db-5f2a-4b30-8c19-817b653c626c req-3993f466-07f5-4f51-81fc-08c538b3c234 service nova] Lock "a690fa65-078d-4ffd-bc62-3366aaa3d681-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:23:06 user nova-compute[75745]: DEBUG nova.compute.manager [req-57dff4db-5f2a-4b30-8c19-817b653c626c req-3993f466-07f5-4f51-81fc-08c538b3c234 service nova] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] No waiting events found dispatching network-vif-unplugged-09c7de0f-2e4a-4fda-993c-bd5f781692eb {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:23:06 user nova-compute[75745]: DEBUG nova.compute.manager [req-57dff4db-5f2a-4b30-8c19-817b653c626c req-3993f466-07f5-4f51-81fc-08c538b3c234 service nova] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Received event network-vif-unplugged-09c7de0f-2e4a-4fda-993c-bd5f781692eb for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:23:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:06 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Instance destroyed successfully.
Dec 01 17:23:06 user nova-compute[75745]: DEBUG nova.objects.instance [None req-8c2bd34e-f943-4f7f-90ab-b554470c2916 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Lazy-loading 'resources' on Instance uuid a690fa65-078d-4ffd-bc62-3366aaa3d681 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:23:06 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-8c2bd34e-f943-4f7f-90ab-b554470c2916 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:14:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1430692133',display_name='tempest-ServersNegativeTestJSON-server-1430692133',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1430692133',id=24,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:14:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d0d8924495d400d978d7107a78b3167',ramdisk_id='',reservation_id='r-lid8m60t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-67621407',owner_user_name='tempest-ServersNegativeTestJSON-67621407-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:14:24Z,user_data=None,user_id='8b524e70f3794e81a2111cd12cab9abc',uuid=a690fa65-078d-4ffd-bc62-3366aaa3d681,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09c7de0f-2e4a-4fda-993c-bd5f781692eb", "address": "fa:16:3e:38:8b:25", "network": {"id": "3b2feb84-7495-4ea1-8eb4-6fcb4763a75a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1599091175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0d8924495d400d978d7107a78b3167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c7de0f-2e", "ovs_interfaceid": "09c7de0f-2e4a-4fda-993c-bd5f781692eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:23:06 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-8c2bd34e-f943-4f7f-90ab-b554470c2916 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Converting VIF {"id": "09c7de0f-2e4a-4fda-993c-bd5f781692eb", "address": "fa:16:3e:38:8b:25", "network": {"id": "3b2feb84-7495-4ea1-8eb4-6fcb4763a75a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1599091175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0d8924495d400d978d7107a78b3167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c7de0f-2e", "ovs_interfaceid": "09c7de0f-2e4a-4fda-993c-bd5f781692eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:23:06 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-8c2bd34e-f943-4f7f-90ab-b554470c2916 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:8b:25,bridge_name='br-int',has_traffic_filtering=True,id=09c7de0f-2e4a-4fda-993c-bd5f781692eb,network=Network(3b2feb84-7495-4ea1-8eb4-6fcb4763a75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09c7de0f-2e') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:23:06 user nova-compute[75745]: DEBUG os_vif [None req-8c2bd34e-f943-4f7f-90ab-b554470c2916 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:8b:25,bridge_name='br-int',has_traffic_filtering=True,id=09c7de0f-2e4a-4fda-993c-bd5f781692eb,network=Network(3b2feb84-7495-4ea1-8eb4-6fcb4763a75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09c7de0f-2e') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:23:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09c7de0f-2e, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:23:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=90cb2e6e-1eb1-4b55-a240-31d199273026) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:23:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:23:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:06 user nova-compute[75745]: INFO os_vif [None req-8c2bd34e-f943-4f7f-90ab-b554470c2916 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:8b:25,bridge_name='br-int',has_traffic_filtering=True,id=09c7de0f-2e4a-4fda-993c-bd5f781692eb,network=Network(3b2feb84-7495-4ea1-8eb4-6fcb4763a75a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09c7de0f-2e')
Dec 01 17:23:06 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-8c2bd34e-f943-4f7f-90ab-b554470c2916 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Deleting instance files /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681_del
Dec 01 17:23:06 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-8c2bd34e-f943-4f7f-90ab-b554470c2916 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Deletion of /opt/stack/data/nova/instances/a690fa65-078d-4ffd-bc62-3366aaa3d681_del complete
Dec 01 17:23:06 user nova-compute[75745]: INFO nova.compute.manager [None req-8c2bd34e-f943-4f7f-90ab-b554470c2916 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Took 0.81 seconds to destroy the instance on the hypervisor.
Dec 01 17:23:06 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-8c2bd34e-f943-4f7f-90ab-b554470c2916 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:23:06 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:23:06 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:23:07 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:23:07 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Took 0.61 seconds to deallocate network for instance.
Dec 01 17:23:07 user nova-compute[75745]: DEBUG nova.compute.manager [req-939f9269-fabc-4b58-9e3c-539953069d90 req-1fc999ca-9fb9-4e73-871b-64524cafef57 service nova] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Received event network-vif-deleted-09c7de0f-2e4a-4fda-993c-bd5f781692eb {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:23:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8c2bd34e-f943-4f7f-90ab-b554470c2916 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:23:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8c2bd34e-f943-4f7f-90ab-b554470c2916 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:23:07 user nova-compute[75745]: INFO nova.compute.manager [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Rescuing
Dec 01 17:23:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "refresh_cache-5aee52eb-78e3-4f60-a920-7ade912735e8" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:23:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquired lock "refresh_cache-5aee52eb-78e3-4f60-a920-7ade912735e8" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:23:07 user nova-compute[75745]: DEBUG nova.network.neutron [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:23:07 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-8c2bd34e-f943-4f7f-90ab-b554470c2916 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:23:07 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-8c2bd34e-f943-4f7f-90ab-b554470c2916 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:23:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8c2bd34e-f943-4f7f-90ab-b554470c2916 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:23:07 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-8c2bd34e-f943-4f7f-90ab-b554470c2916 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Deleted allocations for instance a690fa65-078d-4ffd-bc62-3366aaa3d681
Dec 01 17:23:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8c2bd34e-f943-4f7f-90ab-b554470c2916 tempest-ServersNegativeTestJSON-67621407 tempest-ServersNegativeTestJSON-67621407-project-member] Lock "a690fa65-078d-4ffd-bc62-3366aaa3d681" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.030s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:23:08 user nova-compute[75745]: DEBUG nova.network.neutron [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Updating instance_info_cache with network_info: [{"id": "7c69901c-a94e-47f8-8a4a-1654ed728b83", "address": "fa:16:3e:2e:86:ec", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c69901c-a9", "ovs_interfaceid": "7c69901c-a94e-47f8-8a4a-1654ed728b83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:23:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Releasing lock "refresh_cache-5aee52eb-78e3-4f60-a920-7ade912735e8" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:23:08 user nova-compute[75745]: DEBUG nova.compute.manager [req-48ddf7ec-c364-4f8f-bb9a-2c6ccdff32bb req-d167dd4e-7133-4aef-a01d-4e4a37ceb342 service nova] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Received event network-vif-plugged-09c7de0f-2e4a-4fda-993c-bd5f781692eb {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:23:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-48ddf7ec-c364-4f8f-bb9a-2c6ccdff32bb req-d167dd4e-7133-4aef-a01d-4e4a37ceb342 service nova] Acquiring lock "a690fa65-078d-4ffd-bc62-3366aaa3d681-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:23:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-48ddf7ec-c364-4f8f-bb9a-2c6ccdff32bb req-d167dd4e-7133-4aef-a01d-4e4a37ceb342 service nova] Lock "a690fa65-078d-4ffd-bc62-3366aaa3d681-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:23:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-48ddf7ec-c364-4f8f-bb9a-2c6ccdff32bb req-d167dd4e-7133-4aef-a01d-4e4a37ceb342 service nova] Lock "a690fa65-078d-4ffd-bc62-3366aaa3d681-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:23:08 user nova-compute[75745]: DEBUG nova.compute.manager [req-48ddf7ec-c364-4f8f-bb9a-2c6ccdff32bb req-d167dd4e-7133-4aef-a01d-4e4a37ceb342 service nova] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] No waiting events found dispatching network-vif-plugged-09c7de0f-2e4a-4fda-993c-bd5f781692eb {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:23:08 user nova-compute[75745]: WARNING nova.compute.manager [req-48ddf7ec-c364-4f8f-bb9a-2c6ccdff32bb req-d167dd4e-7133-4aef-a01d-4e4a37ceb342 service nova] [instance: a690fa65-078d-4ffd-bc62-3366aaa3d681] Received unexpected event network-vif-plugged-09c7de0f-2e4a-4fda-993c-bd5f781692eb for instance with vm_state deleted and task_state None.
Dec 01 17:23:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:09 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Instance destroyed successfully.
Dec 01 17:23:09 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Attempting a stable device rescue
Dec 01 17:23:09 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75745) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 01 17:23:09 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Instance directory exists: not creating {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Dec 01 17:23:09 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Creating image(s)
Dec 01 17:23:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "/opt/stack/data/nova/instances/5aee52eb-78e3-4f60-a920-7ade912735e8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:23:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "/opt/stack/data/nova/instances/5aee52eb-78e3-4f60-a920-7ade912735e8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:23:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "/opt/stack/data/nova/instances/5aee52eb-78e3-4f60-a920-7ade912735e8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:23:09 user nova-compute[75745]: DEBUG nova.objects.instance [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5aee52eb-78e3-4f60-a920-7ade912735e8 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:23:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "a4c04ba342c0aeea48d647aae442fc0990563d86" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:23:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "a4c04ba342c0aeea48d647aae442fc0990563d86" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:23:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4c04ba342c0aeea48d647aae442fc0990563d86.part --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:10 user nova-compute[75745]: DEBUG nova.compute.manager [req-50775548-cafb-4b45-b159-a8d0e978d9a6 req-20ae3fe1-a3ba-4776-ba5f-b97d6bb9c136 service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Received event network-vif-unplugged-7c69901c-a94e-47f8-8a4a-1654ed728b83 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:23:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-50775548-cafb-4b45-b159-a8d0e978d9a6 req-20ae3fe1-a3ba-4776-ba5f-b97d6bb9c136 service nova] Acquiring lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:23:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-50775548-cafb-4b45-b159-a8d0e978d9a6 req-20ae3fe1-a3ba-4776-ba5f-b97d6bb9c136 service nova] Lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:23:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-50775548-cafb-4b45-b159-a8d0e978d9a6 req-20ae3fe1-a3ba-4776-ba5f-b97d6bb9c136 service nova] Lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:23:10 user nova-compute[75745]: DEBUG nova.compute.manager [req-50775548-cafb-4b45-b159-a8d0e978d9a6 req-20ae3fe1-a3ba-4776-ba5f-b97d6bb9c136 service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] No waiting events found dispatching network-vif-unplugged-7c69901c-a94e-47f8-8a4a-1654ed728b83 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:23:10 user nova-compute[75745]: WARNING nova.compute.manager [req-50775548-cafb-4b45-b159-a8d0e978d9a6 req-20ae3fe1-a3ba-4776-ba5f-b97d6bb9c136 service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Received unexpected event network-vif-unplugged-7c69901c-a94e-47f8-8a4a-1654ed728b83 for instance with vm_state active and task_state rescuing.
Dec 01 17:23:10 user nova-compute[75745]: DEBUG nova.compute.manager [req-50775548-cafb-4b45-b159-a8d0e978d9a6 req-20ae3fe1-a3ba-4776-ba5f-b97d6bb9c136 service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Received event network-vif-plugged-7c69901c-a94e-47f8-8a4a-1654ed728b83 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:23:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-50775548-cafb-4b45-b159-a8d0e978d9a6 req-20ae3fe1-a3ba-4776-ba5f-b97d6bb9c136 service nova] Acquiring lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:23:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-50775548-cafb-4b45-b159-a8d0e978d9a6 req-20ae3fe1-a3ba-4776-ba5f-b97d6bb9c136 service nova] Lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:23:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-50775548-cafb-4b45-b159-a8d0e978d9a6 req-20ae3fe1-a3ba-4776-ba5f-b97d6bb9c136 service nova] Lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:23:10 user nova-compute[75745]: DEBUG nova.compute.manager [req-50775548-cafb-4b45-b159-a8d0e978d9a6 req-20ae3fe1-a3ba-4776-ba5f-b97d6bb9c136 service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] No waiting events found dispatching network-vif-plugged-7c69901c-a94e-47f8-8a4a-1654ed728b83 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:23:10 user nova-compute[75745]: WARNING nova.compute.manager [req-50775548-cafb-4b45-b159-a8d0e978d9a6 req-20ae3fe1-a3ba-4776-ba5f-b97d6bb9c136 service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Received unexpected event network-vif-plugged-7c69901c-a94e-47f8-8a4a-1654ed728b83 for instance with vm_state active and task_state rescuing.
Dec 01 17:23:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4c04ba342c0aeea48d647aae442fc0990563d86.part --force-share --output=json" returned: 0 in 0.200s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:10 user nova-compute[75745]: DEBUG nova.virt.images [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] d453e975-e3d1-4203-9b5e-a9c0886fab07 was qcow2, converting to raw {{(pid=75745) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 01 17:23:10 user nova-compute[75745]: DEBUG nova.privsep.utils [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75745) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 17:23:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a4c04ba342c0aeea48d647aae442fc0990563d86.part /opt/stack/data/nova/instances/_base/a4c04ba342c0aeea48d647aae442fc0990563d86.converted {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a4c04ba342c0aeea48d647aae442fc0990563d86.part /opt/stack/data/nova/instances/_base/a4c04ba342c0aeea48d647aae442fc0990563d86.converted" returned: 0 in 0.701s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4c04ba342c0aeea48d647aae442fc0990563d86.converted --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4c04ba342c0aeea48d647aae442fc0990563d86.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "a4c04ba342c0aeea48d647aae442fc0990563d86" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.503s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:23:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "a4c04ba342c0aeea48d647aae442fc0990563d86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:23:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "a4c04ba342c0aeea48d647aae442fc0990563d86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:23:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4c04ba342c0aeea48d647aae442fc0990563d86 --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4c04ba342c0aeea48d647aae442fc0990563d86 --force-share --output=json" returned: 0 in 0.192s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a4c04ba342c0aeea48d647aae442fc0990563d86,backing_fmt=raw /opt/stack/data/nova/instances/5aee52eb-78e3-4f60-a920-7ade912735e8/disk.rescue {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a4c04ba342c0aeea48d647aae442fc0990563d86,backing_fmt=raw /opt/stack/data/nova/instances/5aee52eb-78e3-4f60-a920-7ade912735e8/disk.rescue" returned: 0 in 0.060s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "a4c04ba342c0aeea48d647aae442fc0990563d86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:23:11 user nova-compute[75745]: DEBUG nova.objects.instance [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lazy-loading 'migration_context' on Instance uuid 5aee52eb-78e3-4f60-a920-7ade912735e8 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:23:11 user nova-compute[75745]: DEBUG nova.objects.base [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Object Instance<5aee52eb-78e3-4f60-a920-7ade912735e8> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:23:11 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:23:11 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Start _get_guest_xml network_info=[{"id": "7c69901c-a94e-47f8-8a4a-1654ed728b83", "address": "fa:16:3e:2e:86:ec", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "vif_mac": "fa:16:3e:2e:86:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c69901c-a9", "ovs_interfaceid": "7c69901c-a94e-47f8-8a4a-1654ed728b83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd453e975-e3d1-4203-9b5e-a9c0886fab07', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': 'eeabfbd5-c9bc-43fc-b37d-6ce9e09b8043', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yjLwTGef', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '5aee52eb-78e3-4f60-a920-7ade912735e8', 'attached_at': '', 'detached_at': '', 'volume_id': 'b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0', 'serial': 'b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0'}, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:23:11 user nova-compute[75745]: DEBUG nova.objects.instance [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lazy-loading 'resources' on Instance uuid 5aee52eb-78e3-4f60-a920-7ade912735e8 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:23:11 user nova-compute[75745]: DEBUG nova.objects.base [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Object Instance<5aee52eb-78e3-4f60-a920-7ade912735e8> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:23:11 user nova-compute[75745]: DEBUG nova.objects.instance [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lazy-loading 'numa_topology' on Instance uuid 5aee52eb-78e3-4f60-a920-7ade912735e8 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:23:11 user nova-compute[75745]: DEBUG nova.objects.base [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Object Instance<5aee52eb-78e3-4f60-a920-7ade912735e8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:23:11 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:23:11 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:23:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG nova.objects.instance [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5aee52eb-78e3-4f60-a920-7ade912735e8 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG nova.objects.base [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Object Instance<5aee52eb-78e3-4f60-a920-7ade912735e8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yjLwTGef', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:23:12 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:23:12 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:23:12 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:23:12 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:23:12 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:23:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 -p 172.16.0.220:3260" returned: 0 in 0.025s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfd336b-869e-4882-afe9-8959e10058a7]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = yjLwTGef\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Dec 01 17:23:12 user nova-compute[75745]: node.name = iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0
Dec 01 17:23:12 user nova-compute[75745]: node.tpgt = -1
Dec 01 17:23:12 user nova-compute[75745]: node.startup = automatic
Dec 01 17:23:12 user nova-compute[75745]: node.leading_login = No
Dec 01 17:23:12 user nova-compute[75745]: iface.iscsi_ifacename = default
Dec 01 17:23:12 user nova-compute[75745]: iface.net_ifacename = <empty>
Dec 01 17:23:12 user nova-compute[75745]: iface.ipaddress = <empty>
Dec 01 17:23:12 user nova-compute[75745]: iface.prefix_len = 0
Dec 01 17:23:12 user nova-compute[75745]: iface.hwaddress = <empty>
Dec 01 17:23:12 user nova-compute[75745]: iface.transport_name = tcp
Dec 01 17:23:12 user nova-compute[75745]: iface.initiatorname = <empty>
Dec 01 17:23:12 user nova-compute[75745]: iface.state = <empty>
Dec 01 17:23:12 user nova-compute[75745]: iface.vlan_id = 0
Dec 01 17:23:12 user nova-compute[75745]: iface.vlan_priority = 0
Dec 01 17:23:12 user nova-compute[75745]: iface.vlan_state = <empty>
Dec 01 17:23:12 user nova-compute[75745]: iface.iface_num = 0
Dec 01 17:23:12 user nova-compute[75745]: iface.mtu = 0
Dec 01 17:23:12 user nova-compute[75745]: iface.port = 0
Dec 01 17:23:12 user nova-compute[75745]: iface.bootproto = <empty>
Dec 01 17:23:12 user nova-compute[75745]: iface.subnet_mask = <empty>
Dec 01 17:23:12 user nova-compute[75745]: iface.gateway = <empty>
Dec 01 17:23:12 user nova-compute[75745]: iface.dhcp_alt_client_id_state = <empty>
Dec 01 17:23:12 user nova-compute[75745]: iface.dhcp_alt_client_id = <empty>
Dec 01 17:23:12 user nova-compute[75745]: iface.dhcp_dns = <empty>
Dec 01 17:23:12 user nova-compute[75745]: iface.dhcp_learn_iqn = <empty>
Dec 01 17:23:12 user nova-compute[75745]: iface.dhcp_req_vendor_id_state = <empty>
Dec 01 17:23:12 user nova-compute[75745]: iface.dhcp_vendor_id_state = <empty>
Dec 01 17:23:12 user nova-compute[75745]: iface.dhcp_vendor_id = <empty>
Dec 01 17:23:12 user nova-compute[75745]: iface.dhcp_slp_da = <empty>
Dec 01 17:23:12 user nova-compute[75745]: iface.fragmentation = <empty>
Dec 01 17:23:12 user nova-compute[75745]: iface.gratuitous_arp = <empty>
Dec 01 17:23:12 user nova-compute[75745]: iface.incoming_forwarding = <empty>
Dec 01 17:23:12 user nova-compute[75745]: iface.tos_state = <empty>
Dec 01 17:23:12 user nova-compute[75745]: iface.tos = 0
Dec 01 17:23:12 user nova-compute[75745]: iface.ttl = 0
Dec 01 17:23:12 user nova-compute[75745]: iface.delayed_ack = <empty>
Dec 01 17:23:12 user nova-compute[75745]: iface.tcp_nagle = <empty>
Dec 01 17:23:12 user nova-compute[75745]: iface.tcp_wsf_state = <empty>
Dec 01 17:23:12 user nova-compute[75745]: iface.tcp_wsf = 0
Dec 01 17:23:12 user nova-compute[75745]: iface.tcp_timer_scale = 0
Dec 01 17:23:12 user nova-compute[75745]: iface.tcp_timestamp = <empty>
Dec 01 17:23:12 user nova-compute[75745]: iface.redirect = <empty>
Dec 01 17:23:12 user nova-compute[75745]: iface.def_task_mgmt_timeout = 0
Dec 01 17:23:12 user nova-compute[75745]: iface.header_digest = <empty>
Dec 01 17:23:12 user nova-compute[75745]: iface.data_digest = <empty>
Dec 01 17:23:12 user nova-compute[75745]: iface.immediate_data = <empty>
Dec 01 17:23:12 user nova-compute[75745]: iface.initial_r2t = <empty>
Dec 01 17:23:12 user nova-compute[75745]: iface.data_seq_inorder = <empty>
Dec 01 17:23:12 user nova-compute[75745]: iface.data_pdu_inorder = <empty>
Dec 01 17:23:12 user nova-compute[75745]: iface.erl = 0
Dec 01 17:23:12 user nova-compute[75745]: iface.max_receive_data_len = 0
Dec 01 17:23:12 user nova-compute[75745]: iface.first_burst_len = 0
Dec 01 17:23:12 user nova-compute[75745]: iface.max_outstanding_r2t = 0
Dec 01 17:23:12 user nova-compute[75745]: iface.max_burst_len = 0
Dec 01 17:23:12 user nova-compute[75745]: iface.chap_auth = <empty>
Dec 01 17:23:12 user nova-compute[75745]: iface.bidi_chap = <empty>
Dec 01 17:23:12 user nova-compute[75745]: iface.strict_login_compliance = <empty>
Dec 01 17:23:12 user nova-compute[75745]: iface.discovery_auth = <empty>
Dec 01 17:23:12 user nova-compute[75745]: iface.discovery_logout = <empty>
Dec 01 17:23:12 user nova-compute[75745]: node.discovery_address = <empty>
Dec 01 17:23:12 user nova-compute[75745]: node.discovery_port = 0
Dec 01 17:23:12 user nova-compute[75745]: node.discovery_type = static
Dec 01 17:23:12 user nova-compute[75745]: node.session.initial_cmdsn = 0
Dec 01 17:23:12 user nova-compute[75745]: node.session.initial_login_retry_max = 8
Dec 01 17:23:12 user nova-compute[75745]: node.session.xmit_thread_priority = -20
Dec 01 17:23:12 user nova-compute[75745]: node.session.cmds_max = 128
Dec 01 17:23:12 user nova-compute[75745]: node.session.queue_depth = 32
Dec 01 17:23:12 user nova-compute[75745]: node.session.nr_sessions = 1
Dec 01 17:23:12 user nova-compute[75745]: node.session.auth.authmethod = CHAP
Dec 01 17:23:12 user nova-compute[75745]: node.session.auth.username = yjLwTGef
Dec 01 17:23:12 user nova-compute[75745]: node.session.auth.password = ***
Dec 01 17:23:12 user nova-compute[75745]: node.session.auth.username_in = <empty>
Dec 01 17:23:12 user nova-compute[75745]: node.session.auth.password_in = <empty>
Dec 01 17:23:12 user nova-compute[75745]: node.session.auth.chap_algs = MD5
Dec 01 17:23:12 user nova-compute[75745]: node.session.timeo.replacement_timeout = 120
Dec 01 17:23:12 user nova-compute[75745]: node.session.err_timeo.abort_timeout = 15
Dec 01 17:23:12 user nova-compute[75745]: node.session.err_timeo.lu_reset_timeout = 30
Dec 01 17:23:12 user nova-compute[75745]: node.session.err_timeo.tgt_reset_timeout = 30
Dec 01 17:23:12 user nova-compute[75745]: node.session.err_timeo.host_reset_timeout = 60
Dec 01 17:23:12 user nova-compute[75745]: node.session.iscsi.FastAbort = Yes
Dec 01 17:23:12 user nova-compute[75745]: node.session.iscsi.InitialR2T = No
Dec 01 17:23:12 user nova-compute[75745]: node.session.iscsi.ImmediateData = Yes
Dec 01 17:23:12 user nova-compute[75745]: node.session.iscsi.FirstBurstLength = 262144
Dec 01 17:23:12 user nova-compute[75745]: node.session.iscsi.MaxBurstLength = 16776192
Dec 01 17:23:12 user nova-compute[75745]: node.session.iscsi.DefaultTime2Retain = 0
Dec 01 17:23:12 user nova-compute[75745]: node.session.iscsi.DefaultTime2Wait = 2
Dec 01 17:23:12 user nova-compute[75745]: node.session.iscsi.MaxConnections = 1
Dec 01 17:23:12 user nova-compute[75745]: node.session.iscsi.MaxOutstandingR2T = 1
Dec 01 17:23:12 user nova-compute[75745]: node.session.iscsi.ERL = 0
Dec 01 17:23:12 user nova-compute[75745]: node.session.scan = manual
Dec 01 17:23:12 user nova-compute[75745]: node.session.reopen_max = 0
Dec 01 17:23:12 user nova-compute[75745]: node.conn[0].address = 172.16.0.220
Dec 01 17:23:12 user nova-compute[75745]: node.conn[0].port = 3260
Dec 01 17:23:12 user nova-compute[75745]: node.conn[0].startup = manual
Dec 01 17:23:12 user nova-compute[75745]: node.conn[0].tcp.window_size = 524288
Dec 01 17:23:12 user nova-compute[75745]: node.conn[0].tcp.type_of_service = 0
Dec 01 17:23:12 user nova-compute[75745]: node.conn[0].timeo.logout_timeout = 15
Dec 01 17:23:12 user nova-compute[75745]: node.conn[0].timeo.login_timeout = 15
Dec 01 17:23:12 user nova-compute[75745]: node.conn[0].timeo.auth_timeout = 45
Dec 01 17:23:12 user nova-compute[75745]: node.conn[0].timeo.noop_out_interval = 5
Dec 01 17:23:12 user nova-compute[75745]: node.conn[0].timeo.noop_out_timeout = 5
Dec 01 17:23:12 user nova-compute[75745]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Dec 01 17:23:12 user nova-compute[75745]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Dec 01 17:23:12 user nova-compute[75745]: node.conn[0].iscsi.HeaderDigest = None
Dec 01 17:23:12 user nova-compute[75745]: node.conn[0].iscsi.DataDigest = None
Dec 01 17:23:12 user nova-compute[75745]: node.conn[0].iscsi.IFMarker = No
Dec 01 17:23:12 user nova-compute[75745]: node.conn[0].iscsi.OFMarker = No
Dec 01 17:23:12 user nova-compute[75745]: # END RECORD
Dec 01 17:23:12 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1631e4a0-b19e-4623-ac6f-b25e9170f30c]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae1d1ec-2d66-4db7-b324-e561e3c7dd32]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yjLwTGef {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yjLwTGef" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[81443cea-b62a-4c18-a757-ff9c757dee02]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yjLwTGef'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7876dd75-b18c-4aab-a8fb-8c31544ad4ce]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b720cc-b8a1-48f3-a56d-513ae19c023c]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:23:12 user nova-compute[75745]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 (non-flash)
Dec 01 17:23:12 user nova-compute[75745]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:23:12 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:23:12 user nova-compute[75745]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 (non-flash)
Dec 01 17:23:12 user nova-compute[75745]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:23:12 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.162s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] HCTL ('33', '0', '0', 0) found on session 35 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2661483-8022-4bdc-8357-a24caded6df3]: (4, ('0 0 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Searching for a device in session 35 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yjLwTGef', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.188s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] <== connect_volume: return (189ms) {'type': 'block', 'scsi_wwn': '23330643163373933', 'path': '/dev/sdb'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330643163373933', 'path': '/dev/sdb'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-957931660',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-957931660',id=32,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:21:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='adb3ba16695543cab6f10932fd6b2d2d',ramdisk_id='',reservation_id='r-ehd8ztzo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-90723689',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:21:37Z,user_data=None,user_id='b319a47b86c04affa1858e1c2359876b',uuid=5aee52eb-78e3-4f60-a920-7ade912735e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c69901c-a94e-47f8-8a4a-1654ed728b83", "address": "fa:16:3e:2e:86:ec", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "vif_mac": "fa:16:3e:2e:86:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c69901c-a9", "ovs_interfaceid": "7c69901c-a94e-47f8-8a4a-1654ed728b83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Converting VIF {"id": "7c69901c-a94e-47f8-8a4a-1654ed728b83", "address": "fa:16:3e:2e:86:ec", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "vif_mac": "fa:16:3e:2e:86:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c69901c-a9", "ovs_interfaceid": "7c69901c-a94e-47f8-8a4a-1654ed728b83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:86:ec,bridge_name='br-int',has_traffic_filtering=True,id=7c69901c-a94e-47f8-8a4a-1654ed728b83,network=Network(bf1db63d-d427-41c2-ac82-6fab9483a423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c69901c-a9') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG nova.objects.instance [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lazy-loading 'pci_devices' on Instance uuid 5aee52eb-78e3-4f60-a920-7ade912735e8 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG nova.objects.base [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Object Instance<5aee52eb-78e3-4f60-a920-7ade912735e8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:23:12 user nova-compute[75745]:   <uuid>5aee52eb-78e3-4f60-a920-7ade912735e8</uuid>
Dec 01 17:23:12 user nova-compute[75745]:   <name>instance-00000020</name>
Dec 01 17:23:12 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:23:12 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:23:12 user nova-compute[75745]:   <metadata>
Dec 01 17:23:12 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:23:12 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:23:12 user nova-compute[75745]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-957931660</nova:name>
Dec 01 17:23:12 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:23:11</nova:creationTime>
Dec 01 17:23:12 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:23:12 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:23:12 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:23:12 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:23:12 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:23:12 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:23:12 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:23:12 user nova-compute[75745]:       <nova:owner>
Dec 01 17:23:12 user nova-compute[75745]:         <nova:user uuid="b319a47b86c04affa1858e1c2359876b">tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member</nova:user>
Dec 01 17:23:12 user nova-compute[75745]:         <nova:project uuid="adb3ba16695543cab6f10932fd6b2d2d">tempest-ServerBootFromVolumeStableRescueTest-90723689</nova:project>
Dec 01 17:23:12 user nova-compute[75745]:       </nova:owner>
Dec 01 17:23:12 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:23:12 user nova-compute[75745]:       <nova:ports>
Dec 01 17:23:12 user nova-compute[75745]:         <nova:port uuid="7c69901c-a94e-47f8-8a4a-1654ed728b83">
Dec 01 17:23:12 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 01 17:23:12 user nova-compute[75745]:         </nova:port>
Dec 01 17:23:12 user nova-compute[75745]:       </nova:ports>
Dec 01 17:23:12 user nova-compute[75745]:     </nova:instance>
Dec 01 17:23:12 user nova-compute[75745]:   </metadata>
Dec 01 17:23:12 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:23:12 user nova-compute[75745]:     <system>
Dec 01 17:23:12 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:23:12 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:23:12 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:23:12 user nova-compute[75745]:       <entry name="serial">5aee52eb-78e3-4f60-a920-7ade912735e8</entry>
Dec 01 17:23:12 user nova-compute[75745]:       <entry name="uuid">5aee52eb-78e3-4f60-a920-7ade912735e8</entry>
Dec 01 17:23:12 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:23:12 user nova-compute[75745]:     </system>
Dec 01 17:23:12 user nova-compute[75745]:   </sysinfo>
Dec 01 17:23:12 user nova-compute[75745]:   <os>
Dec 01 17:23:12 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:23:12 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:23:12 user nova-compute[75745]:   </os>
Dec 01 17:23:12 user nova-compute[75745]:   <features>
Dec 01 17:23:12 user nova-compute[75745]:     <acpi/>
Dec 01 17:23:12 user nova-compute[75745]:     <apic/>
Dec 01 17:23:12 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:23:12 user nova-compute[75745]:   </features>
Dec 01 17:23:12 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:23:12 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:23:12 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:23:12 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:23:12 user nova-compute[75745]:   </clock>
Dec 01 17:23:12 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:23:12 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:23:12 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:23:12 user nova-compute[75745]:   </cpu>
Dec 01 17:23:12 user nova-compute[75745]:   <devices>
Dec 01 17:23:12 user nova-compute[75745]:     <disk type="block" device="disk">
Dec 01 17:23:12 user nova-compute[75745]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:23:12 user nova-compute[75745]:       <source dev="/dev/sdb"/>
Dec 01 17:23:12 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:23:12 user nova-compute[75745]:       <serial>b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0</serial>
Dec 01 17:23:12 user nova-compute[75745]:     </disk>
Dec 01 17:23:12 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:23:12 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:23:12 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/5aee52eb-78e3-4f60-a920-7ade912735e8/disk.rescue"/>
Dec 01 17:23:12 user nova-compute[75745]:       <target dev="vdb" bus="virtio"/>
Dec 01 17:23:12 user nova-compute[75745]:       <boot order="1"/>
Dec 01 17:23:12 user nova-compute[75745]:     </disk>
Dec 01 17:23:12 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:23:12 user nova-compute[75745]:       <mac address="fa:16:3e:2e:86:ec"/>
Dec 01 17:23:12 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:23:12 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:23:12 user nova-compute[75745]:       <target dev="tap7c69901c-a9"/>
Dec 01 17:23:12 user nova-compute[75745]:     </interface>
Dec 01 17:23:12 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:23:12 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/5aee52eb-78e3-4f60-a920-7ade912735e8/console.log" append="off"/>
Dec 01 17:23:12 user nova-compute[75745]:     </serial>
Dec 01 17:23:12 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:23:12 user nova-compute[75745]:     <video>
Dec 01 17:23:12 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:23:12 user nova-compute[75745]:     </video>
Dec 01 17:23:12 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:23:12 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:23:12 user nova-compute[75745]:     </rng>
Dec 01 17:23:12 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:23:12 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:23:12 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:23:12 user nova-compute[75745]:     </memballoon>
Dec 01 17:23:12 user nova-compute[75745]:   </devices>
Dec 01 17:23:12 user nova-compute[75745]: </domain>
Dec 01 17:23:12 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:23:12 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Instance destroyed successfully.
Dec 01 17:23:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:23:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] No VIF found with MAC fa:16:3e:2e:86:ec, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:23:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:14 user nova-compute[75745]: DEBUG nova.compute.manager [req-3ac1300b-4867-4ba6-ac83-da611a131985 req-a7cd381a-c0f8-479e-af83-eaea4e7acb43 service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Received event network-vif-plugged-7c69901c-a94e-47f8-8a4a-1654ed728b83 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:23:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3ac1300b-4867-4ba6-ac83-da611a131985 req-a7cd381a-c0f8-479e-af83-eaea4e7acb43 service nova] Acquiring lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:23:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3ac1300b-4867-4ba6-ac83-da611a131985 req-a7cd381a-c0f8-479e-af83-eaea4e7acb43 service nova] Lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:23:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3ac1300b-4867-4ba6-ac83-da611a131985 req-a7cd381a-c0f8-479e-af83-eaea4e7acb43 service nova] Lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:23:14 user nova-compute[75745]: DEBUG nova.compute.manager [req-3ac1300b-4867-4ba6-ac83-da611a131985 req-a7cd381a-c0f8-479e-af83-eaea4e7acb43 service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] No waiting events found dispatching network-vif-plugged-7c69901c-a94e-47f8-8a4a-1654ed728b83 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:23:14 user nova-compute[75745]: WARNING nova.compute.manager [req-3ac1300b-4867-4ba6-ac83-da611a131985 req-a7cd381a-c0f8-479e-af83-eaea4e7acb43 service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Received unexpected event network-vif-plugged-7c69901c-a94e-47f8-8a4a-1654ed728b83 for instance with vm_state active and task_state rescuing.
Dec 01 17:23:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:16 user nova-compute[75745]: DEBUG nova.compute.manager [req-58126b1b-9d4e-4c26-b864-e788d93be3cb req-6a46a293-4808-48af-a299-a7bad514c68e service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Received event network-vif-plugged-7c69901c-a94e-47f8-8a4a-1654ed728b83 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:23:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-58126b1b-9d4e-4c26-b864-e788d93be3cb req-6a46a293-4808-48af-a299-a7bad514c68e service nova] Acquiring lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:23:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-58126b1b-9d4e-4c26-b864-e788d93be3cb req-6a46a293-4808-48af-a299-a7bad514c68e service nova] Lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:23:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-58126b1b-9d4e-4c26-b864-e788d93be3cb req-6a46a293-4808-48af-a299-a7bad514c68e service nova] Lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:23:16 user nova-compute[75745]: DEBUG nova.compute.manager [req-58126b1b-9d4e-4c26-b864-e788d93be3cb req-6a46a293-4808-48af-a299-a7bad514c68e service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] No waiting events found dispatching network-vif-plugged-7c69901c-a94e-47f8-8a4a-1654ed728b83 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:23:16 user nova-compute[75745]: WARNING nova.compute.manager [req-58126b1b-9d4e-4c26-b864-e788d93be3cb req-6a46a293-4808-48af-a299-a7bad514c68e service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Received unexpected event network-vif-plugged-7c69901c-a94e-47f8-8a4a-1654ed728b83 for instance with vm_state active and task_state rescuing.
Dec 01 17:23:16 user nova-compute[75745]: DEBUG nova.compute.manager [None req-96b54a46-5600-4546-a275-da1796c51472 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:23:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:17 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b41b0b06-5f6d-4985-9f11-842f678ad1e6 is timed out.
Dec 01 17:23:17 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Successfully detached device vdb from instance b41b0b06-5f6d-4985-9f11-842f678ad1e6 from the live domain config.
Dec 01 17:23:17 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAhEkWCH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:23:17 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:23:17 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c7b0ac-20fc-49d5-8801-f930cbd45015]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:23:17 user nova-compute[75745]: No targets found.
Dec 01 17:23:17 user nova-compute[75745]: iSNS:
Dec 01 17:23:17 user nova-compute[75745]: No targets found.
Dec 01 17:23:17 user nova-compute[75745]: STATIC:
Dec 01 17:23:17 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2
Dec 01 17:23:17 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:23:17 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:23:17 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df
Dec 01 17:23:17 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:23:17 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:23:17 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0
Dec 01 17:23:17 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:23:17 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:23:17 user nova-compute[75745]: FIRMWARE:
Dec 01 17:23:17 user nova-compute[75745]: No targets found.
Dec 01 17:23:17 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:23:17 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:23:17 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de3104f-a542-4cd4-973f-f9e81ad0ad47]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c29967-b622-4d99-81d4-b379fa4c47cc]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:23:17 user nova-compute[75745]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 (non-flash)
Dec 01 17:23:17 user nova-compute[75745]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:23:17 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:23:17 user nova-compute[75745]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 (non-flash)
Dec 01 17:23:17 user nova-compute[75745]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:23:17 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b85f7b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2'): ({'sdc'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Removing single pathed devices sdc {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b87ee34-f68c-461c-9b2e-7834024a4661]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[654bd8e0-662e-4ec0-b123-1ca43dff68a3]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Flushing IO for device /dev/sdc {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[580f833a-b900-4e47-96e8-95ede740f85f]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06d4050-59ef-4bbb-8b00-7eb03629243d]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] SCSI volumes sdc have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb08b2a6-cdd6-41d4-8734-dc7f22f494c8]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:23:17 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:18 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[31244cd0-d511-44db-b8c7-1dbe5eb2793f]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:23:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2, portal: 172.16.0.220,3260]
Dec 01 17:23:18 user nova-compute[75745]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2, portal: 172.16.0.220,3260] successful.
Dec 01 17:23:18 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:23:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:18 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7d7c4f-1993-4ab2-a1d5-54e9d64d3caf]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:23:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:23:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:23:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] <== disconnect_volume: return (337ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:23:18 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:23:18 user nova-compute[75745]: DEBUG nova.objects.instance [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lazy-loading 'flavor' on Instance uuid b41b0b06-5f6d-4985-9f11-842f678ad1e6 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-97979754-7b9a-4f36-acaf-39458b4e1aca tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "b41b0b06-5f6d-4985-9f11-842f678ad1e6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.018s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "b41b0b06-5f6d-4985-9f11-842f678ad1e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.997s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Acquiring lock "b41b0b06-5f6d-4985-9f11-842f678ad1e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "b41b0b06-5f6d-4985-9f11-842f678ad1e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "b41b0b06-5f6d-4985-9f11-842f678ad1e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:23:19 user nova-compute[75745]: INFO nova.compute.manager [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Terminating instance
Dec 01 17:23:19 user nova-compute[75745]: DEBUG nova.compute.manager [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG nova.compute.manager [req-b30bdf11-c8d6-4e2b-9172-add7812ddbd3 req-ff77ecaa-76c0-4357-9a5b-f71a59ba894a service nova] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Received event network-vif-unplugged-05ab914d-2ae5-44a9-9d2c-41d968056d8f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b30bdf11-c8d6-4e2b-9172-add7812ddbd3 req-ff77ecaa-76c0-4357-9a5b-f71a59ba894a service nova] Acquiring lock "b41b0b06-5f6d-4985-9f11-842f678ad1e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b30bdf11-c8d6-4e2b-9172-add7812ddbd3 req-ff77ecaa-76c0-4357-9a5b-f71a59ba894a service nova] Lock "b41b0b06-5f6d-4985-9f11-842f678ad1e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b30bdf11-c8d6-4e2b-9172-add7812ddbd3 req-ff77ecaa-76c0-4357-9a5b-f71a59ba894a service nova] Lock "b41b0b06-5f6d-4985-9f11-842f678ad1e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG nova.compute.manager [req-b30bdf11-c8d6-4e2b-9172-add7812ddbd3 req-ff77ecaa-76c0-4357-9a5b-f71a59ba894a service nova] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] No waiting events found dispatching network-vif-unplugged-05ab914d-2ae5-44a9-9d2c-41d968056d8f {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG nova.compute.manager [req-b30bdf11-c8d6-4e2b-9172-add7812ddbd3 req-ff77ecaa-76c0-4357-9a5b-f71a59ba894a service nova] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Received event network-vif-unplugged-05ab914d-2ae5-44a9-9d2c-41d968056d8f for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:23:19 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Instance destroyed successfully.
Dec 01 17:23:19 user nova-compute[75745]: DEBUG nova.objects.instance [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lazy-loading 'resources' on Instance uuid b41b0b06-5f6d-4985-9f11-842f678ad1e6 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:20:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1273692104',display_name='tempest-VolumesSnapshotTestJSON-instance-1273692104',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1273692104',id=31,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLU9spMA9DkIPuYlz6a8/cmHYfhZPwjDtvajCOW1rTWWN6ssszNfcR+1l21qY0kJE5gm2muPcvwIVXqVmGLUMoXRvcR2+hZi+jgG+PNMzC8x3bHP7tUcDNcW9wxGeqYJzA==',key_name='tempest-keypair-394183901',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:20:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c5ee303033640e7adebbc0c949be9cc',ramdisk_id='',reservation_id='r-ikir68jd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1764036907',owner_user_name='tempest-VolumesSnapshotTestJSON-1764036907-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:20:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc207653aa7c407f92a01ba7cfe89572',uuid=b41b0b06-5f6d-4985-9f11-842f678ad1e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05ab914d-2ae5-44a9-9d2c-41d968056d8f", "address": "fa:16:3e:1a:39:b9", "network": {"id": "ccf83dac-fecd-4f65-baf8-740ff63f51a0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-804694060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5ee303033640e7adebbc0c949be9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ab914d-2a", "ovs_interfaceid": "05ab914d-2ae5-44a9-9d2c-41d968056d8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Converting VIF {"id": "05ab914d-2ae5-44a9-9d2c-41d968056d8f", "address": "fa:16:3e:1a:39:b9", "network": {"id": "ccf83dac-fecd-4f65-baf8-740ff63f51a0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-804694060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5ee303033640e7adebbc0c949be9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ab914d-2a", "ovs_interfaceid": "05ab914d-2ae5-44a9-9d2c-41d968056d8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:39:b9,bridge_name='br-int',has_traffic_filtering=True,id=05ab914d-2ae5-44a9-9d2c-41d968056d8f,network=Network(ccf83dac-fecd-4f65-baf8-740ff63f51a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05ab914d-2a') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG os_vif [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:39:b9,bridge_name='br-int',has_traffic_filtering=True,id=05ab914d-2ae5-44a9-9d2c-41d968056d8f,network=Network(ccf83dac-fecd-4f65-baf8-740ff63f51a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05ab914d-2a') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05ab914d-2a, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a3c76660-57dc-4431-a523-fe9dad77e0f6) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:19 user nova-compute[75745]: INFO os_vif [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:39:b9,bridge_name='br-int',has_traffic_filtering=True,id=05ab914d-2ae5-44a9-9d2c-41d968056d8f,network=Network(ccf83dac-fecd-4f65-baf8-740ff63f51a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05ab914d-2a')
Dec 01 17:23:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAhEkWCH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:23:19 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:23:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.006s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68fb83d-fa58-4005-8299-85e738ac73bd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:23:19 user nova-compute[75745]: No targets found.
Dec 01 17:23:19 user nova-compute[75745]: iSNS:
Dec 01 17:23:19 user nova-compute[75745]: No targets found.
Dec 01 17:23:19 user nova-compute[75745]: STATIC:
Dec 01 17:23:19 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df
Dec 01 17:23:19 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:23:19 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:23:19 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0
Dec 01 17:23:19 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:23:19 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:23:19 user nova-compute[75745]: FIRMWARE:
Dec 01 17:23:19 user nova-compute[75745]: No targets found.
Dec 01 17:23:19 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:23:19 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:23:19 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:826fb4ce-40f8-4ca6-9c0b-f9d1c3f5e8c2', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0dae0f-cefb-4ef2-9387-1d67fe5be868]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c115fb2-eefa-48b3-be9f-b51d500acf4c]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:23:19 user nova-compute[75745]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:23:19 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:23:19 user nova-compute[75745]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:23:19 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b819ab00>, {}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Disconnecting from: [] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.072s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] <== disconnect_volume: return (78ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:23:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:23:19 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Deleting instance files /opt/stack/data/nova/instances/b41b0b06-5f6d-4985-9f11-842f678ad1e6_del
Dec 01 17:23:19 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Deletion of /opt/stack/data/nova/instances/b41b0b06-5f6d-4985-9f11-842f678ad1e6_del complete
Dec 01 17:23:20 user nova-compute[75745]: INFO nova.compute.manager [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Took 1.03 seconds to destroy the instance on the hypervisor.
Dec 01 17:23:20 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:23:20 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:23:20 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:23:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:20 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:23:21 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Took 0.95 seconds to deallocate network for instance.
Dec 01 17:23:21 user nova-compute[75745]: WARNING nova.volume.cinder [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Attachment bced13e9-5db5-4331-ba0c-7e321d1944c2 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = bced13e9-5db5-4331-ba0c-7e321d1944c2. (HTTP 404) (Request-ID: req-0c7340d0-3e8c-4607-8d82-c9daf9b48a67)
Dec 01 17:23:21 user nova-compute[75745]: INFO nova.compute.manager [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Took 0.03 seconds to detach 1 volumes for instance.
Dec 01 17:23:21 user nova-compute[75745]: DEBUG nova.compute.manager [req-a2b24669-5950-4255-a625-1bd9d16a2663 req-b0b30082-3253-453c-b079-b77c9ba597de service nova] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Received event network-vif-deleted-05ab914d-2ae5-44a9-9d2c-41d968056d8f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:23:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:23:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:23:21 user nova-compute[75745]: DEBUG nova.compute.manager [req-00a60ea3-ecd7-4f46-ac86-2c3cac5374bc req-f119f519-9255-4fa6-b6e8-15bd880f4be3 service nova] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Received event network-vif-plugged-05ab914d-2ae5-44a9-9d2c-41d968056d8f {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:23:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-00a60ea3-ecd7-4f46-ac86-2c3cac5374bc req-f119f519-9255-4fa6-b6e8-15bd880f4be3 service nova] Acquiring lock "b41b0b06-5f6d-4985-9f11-842f678ad1e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:23:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-00a60ea3-ecd7-4f46-ac86-2c3cac5374bc req-f119f519-9255-4fa6-b6e8-15bd880f4be3 service nova] Lock "b41b0b06-5f6d-4985-9f11-842f678ad1e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:23:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-00a60ea3-ecd7-4f46-ac86-2c3cac5374bc req-f119f519-9255-4fa6-b6e8-15bd880f4be3 service nova] Lock "b41b0b06-5f6d-4985-9f11-842f678ad1e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:23:21 user nova-compute[75745]: DEBUG nova.compute.manager [req-00a60ea3-ecd7-4f46-ac86-2c3cac5374bc req-f119f519-9255-4fa6-b6e8-15bd880f4be3 service nova] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] No waiting events found dispatching network-vif-plugged-05ab914d-2ae5-44a9-9d2c-41d968056d8f {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:23:21 user nova-compute[75745]: WARNING nova.compute.manager [req-00a60ea3-ecd7-4f46-ac86-2c3cac5374bc req-f119f519-9255-4fa6-b6e8-15bd880f4be3 service nova] [instance: b41b0b06-5f6d-4985-9f11-842f678ad1e6] Received unexpected event network-vif-plugged-05ab914d-2ae5-44a9-9d2c-41d968056d8f for instance with vm_state deleted and task_state None.
Dec 01 17:23:21 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:23:21 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:23:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.328s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:23:21 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Deleted allocations for instance b41b0b06-5f6d-4985-9f11-842f678ad1e6
Dec 01 17:23:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-94b65ef7-e18a-4c70-a70c-37386d21d45d tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "b41b0b06-5f6d-4985-9f11-842f678ad1e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.566s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:23:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:50 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:23:50 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:23:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:23:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:23:51 user nova-compute[75745]: DEBUG nova.compute.manager [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:23:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:23:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:23:51 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:23:51 user nova-compute[75745]: INFO nova.compute.claims [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Claim successful on node user
Dec 01 17:23:51 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:23:51 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:23:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.350s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:23:51 user nova-compute[75745]: DEBUG nova.compute.manager [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:23:51 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:23:51 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:23:51 user nova-compute[75745]: DEBUG nova.compute.manager [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:23:51 user nova-compute[75745]: DEBUG nova.network.neutron [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:23:51 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:23:51 user nova-compute[75745]: DEBUG nova.compute.manager [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:23:52 user nova-compute[75745]: DEBUG nova.policy [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f75082346bbd4b2ebfc585a25a897f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3088641ea74a31a80ade2623f85d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:23:52 user nova-compute[75745]: DEBUG nova.compute.manager [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:23:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:23:52 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Creating image(s)
Dec 01 17:23:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "/opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:23:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "/opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:23:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "/opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:23:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "9baa52f0563aa01ef86ccc990e0971563d7e1530" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:23:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "9baa52f0563aa01ef86ccc990e0971563d7e1530" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:23:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9baa52f0563aa01ef86ccc990e0971563d7e1530.part --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:52 user nova-compute[75745]: DEBUG nova.network.neutron [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Successfully created port: fff6dabe-5df3-4db0-85cb-6dce98f4b953 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:23:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9baa52f0563aa01ef86ccc990e0971563d7e1530.part --force-share --output=json" returned: 0 in 0.192s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:52 user nova-compute[75745]: DEBUG nova.virt.images [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] cb76920d-b7bf-4216-9c1a-8314539397bc was qcow2, converting to raw {{(pid=75745) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 01 17:23:52 user nova-compute[75745]: DEBUG nova.privsep.utils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75745) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 17:23:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9baa52f0563aa01ef86ccc990e0971563d7e1530.part /opt/stack/data/nova/instances/_base/9baa52f0563aa01ef86ccc990e0971563d7e1530.converted {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:52 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:23:52 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:23:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:23:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:23:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:23:52 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:23:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9baa52f0563aa01ef86ccc990e0971563d7e1530.part /opt/stack/data/nova/instances/_base/9baa52f0563aa01ef86ccc990e0971563d7e1530.converted" returned: 0 in 0.378s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9baa52f0563aa01ef86ccc990e0971563d7e1530.converted --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9baa52f0563aa01ef86ccc990e0971563d7e1530.converted --force-share --output=json" returned: 0 in 0.205s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "9baa52f0563aa01ef86ccc990e0971563d7e1530" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.260s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:23:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9baa52f0563aa01ef86ccc990e0971563d7e1530 --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9baa52f0563aa01ef86ccc990e0971563d7e1530 --force-share --output=json" returned: 0 in 0.217s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "9baa52f0563aa01ef86ccc990e0971563d7e1530" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:23:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "9baa52f0563aa01ef86ccc990e0971563d7e1530" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:23:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9baa52f0563aa01ef86ccc990e0971563d7e1530 --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9baa52f0563aa01ef86ccc990e0971563d7e1530 --force-share --output=json" returned: 0 in 0.178s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9baa52f0563aa01ef86ccc990e0971563d7e1530,backing_fmt=raw /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9baa52f0563aa01ef86ccc990e0971563d7e1530,backing_fmt=raw /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk 1073741824" returned: 0 in 0.088s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:53 user nova-compute[75745]: DEBUG nova.network.neutron [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Successfully updated port: fff6dabe-5df3-4db0-85cb-6dce98f4b953 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:23:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "9baa52f0563aa01ef86ccc990e0971563d7e1530" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:23:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9baa52f0563aa01ef86ccc990e0971563d7e1530 --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "refresh_cache-b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:23:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquired lock "refresh_cache-b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:23:53 user nova-compute[75745]: DEBUG nova.network.neutron [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:23:53 user nova-compute[75745]: DEBUG nova.compute.manager [req-7bc4e840-b21f-4021-97a0-a05ac2c67bcd req-b42b0d25-f811-4913-961a-39d3546c6900 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Received event network-changed-fff6dabe-5df3-4db0-85cb-6dce98f4b953 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:23:53 user nova-compute[75745]: DEBUG nova.compute.manager [req-7bc4e840-b21f-4021-97a0-a05ac2c67bcd req-b42b0d25-f811-4913-961a-39d3546c6900 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Refreshing instance network info cache due to event network-changed-fff6dabe-5df3-4db0-85cb-6dce98f4b953. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:23:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7bc4e840-b21f-4021-97a0-a05ac2c67bcd req-b42b0d25-f811-4913-961a-39d3546c6900 service nova] Acquiring lock "refresh_cache-b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.network.neutron [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9baa52f0563aa01ef86ccc990e0971563d7e1530 --force-share --output=json" returned: 0 in 0.210s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Cannot resize image /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Ensure instance console log exists: /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.network.neutron [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Updating instance_info_cache with network_info: [{"id": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "address": "fa:16:3e:71:7f:4a", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff6dabe-5d", "ovs_interfaceid": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Releasing lock "refresh_cache-b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.compute.manager [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Instance network_info: |[{"id": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "address": "fa:16:3e:71:7f:4a", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff6dabe-5d", "ovs_interfaceid": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7bc4e840-b21f-4021-97a0-a05ac2c67bcd req-b42b0d25-f811-4913-961a-39d3546c6900 service nova] Acquired lock "refresh_cache-b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.network.neutron [req-7bc4e840-b21f-4021-97a0-a05ac2c67bcd req-b42b0d25-f811-4913-961a-39d3546c6900 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Refreshing network info cache for port fff6dabe-5df3-4db0-85cb-6dce98f4b953 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Start _get_guest_xml network_info=[{"id": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "address": "fa:16:3e:71:7f:4a", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff6dabe-5d", "ovs_interfaceid": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:23:49Z,direct_url=<?>,disk_format='qcow2',id=cb76920d-b7bf-4216-9c1a-8314539397bc,min_disk=0,min_ram=0,name='tempest-scenario-img--1913901487',owner='0c3088641ea74a31a80ade2623f85d91',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:23:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'cb76920d-b7bf-4216-9c1a-8314539397bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:23:54 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:23:54 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:23:49Z,direct_url=<?>,disk_format='qcow2',id=cb76920d-b7bf-4216-9c1a-8314539397bc,min_disk=0,min_ram=0,name='tempest-scenario-img--1913901487',owner='0c3088641ea74a31a80ade2623f85d91',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:23:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:23:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2051733239',display_name='tempest-TestMinimumBasicScenario-server-2051733239',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2051733239',id=35,image_ref='cb76920d-b7bf-4216-9c1a-8314539397bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnn9DbZ1Jp2KhqktMIfJFAy2AJFm/hYRjxHHwLjF9RbFVRyd8+/P6NS2CW73jwkJj6uEU3/IytWVgpFqd2zzTrgAhNQ0E7yUV0tGqXiGTIYZBRqkb4sHdY6cQgszpx+1g==',key_name='tempest-TestMinimumBasicScenario-1212427382',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c3088641ea74a31a80ade2623f85d91',ramdisk_id='',reservation_id='r-i38vr9t0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cb76920d-b7bf-4216-9c1a-8314539397bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-865236074',owner_user_name='tempest-TestMinimumBasicScenario-865236074-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:23:52Z,user_data=None,user_id='f75082346bbd4b2ebfc585a25a897f81',uuid=b26b6ef1-7a8b-4628-8cc1-d27cc27efcac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "address": "fa:16:3e:71:7f:4a", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff6dabe-5d", "ovs_interfaceid": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Converting VIF {"id": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "address": "fa:16:3e:71:7f:4a", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff6dabe-5d", "ovs_interfaceid": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:7f:4a,bridge_name='br-int',has_traffic_filtering=True,id=fff6dabe-5df3-4db0-85cb-6dce98f4b953,network=Network(bfcf7108-b710-4459-bcd7-fbfd464ee6a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfff6dabe-5d') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.objects.instance [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lazy-loading 'pci_devices' on Instance uuid b26b6ef1-7a8b-4628-8cc1-d27cc27efcac {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:23:54 user nova-compute[75745]:   <uuid>b26b6ef1-7a8b-4628-8cc1-d27cc27efcac</uuid>
Dec 01 17:23:54 user nova-compute[75745]:   <name>instance-00000023</name>
Dec 01 17:23:54 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:23:54 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:23:54 user nova-compute[75745]:   <metadata>
Dec 01 17:23:54 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:23:54 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:23:54 user nova-compute[75745]:       <nova:name>tempest-TestMinimumBasicScenario-server-2051733239</nova:name>
Dec 01 17:23:54 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:23:54</nova:creationTime>
Dec 01 17:23:54 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:23:54 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:23:54 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:23:54 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:23:54 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:23:54 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:23:54 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:23:54 user nova-compute[75745]:       <nova:owner>
Dec 01 17:23:54 user nova-compute[75745]:         <nova:user uuid="f75082346bbd4b2ebfc585a25a897f81">tempest-TestMinimumBasicScenario-865236074-project-member</nova:user>
Dec 01 17:23:54 user nova-compute[75745]:         <nova:project uuid="0c3088641ea74a31a80ade2623f85d91">tempest-TestMinimumBasicScenario-865236074</nova:project>
Dec 01 17:23:54 user nova-compute[75745]:       </nova:owner>
Dec 01 17:23:54 user nova-compute[75745]:       <nova:root type="image" uuid="cb76920d-b7bf-4216-9c1a-8314539397bc"/>
Dec 01 17:23:54 user nova-compute[75745]:       <nova:ports>
Dec 01 17:23:54 user nova-compute[75745]:         <nova:port uuid="fff6dabe-5df3-4db0-85cb-6dce98f4b953">
Dec 01 17:23:54 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 01 17:23:54 user nova-compute[75745]:         </nova:port>
Dec 01 17:23:54 user nova-compute[75745]:       </nova:ports>
Dec 01 17:23:54 user nova-compute[75745]:     </nova:instance>
Dec 01 17:23:54 user nova-compute[75745]:   </metadata>
Dec 01 17:23:54 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:23:54 user nova-compute[75745]:     <system>
Dec 01 17:23:54 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:23:54 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:23:54 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:23:54 user nova-compute[75745]:       <entry name="serial">b26b6ef1-7a8b-4628-8cc1-d27cc27efcac</entry>
Dec 01 17:23:54 user nova-compute[75745]:       <entry name="uuid">b26b6ef1-7a8b-4628-8cc1-d27cc27efcac</entry>
Dec 01 17:23:54 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:23:54 user nova-compute[75745]:     </system>
Dec 01 17:23:54 user nova-compute[75745]:   </sysinfo>
Dec 01 17:23:54 user nova-compute[75745]:   <os>
Dec 01 17:23:54 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:23:54 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:23:54 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:23:54 user nova-compute[75745]:   </os>
Dec 01 17:23:54 user nova-compute[75745]:   <features>
Dec 01 17:23:54 user nova-compute[75745]:     <acpi/>
Dec 01 17:23:54 user nova-compute[75745]:     <apic/>
Dec 01 17:23:54 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:23:54 user nova-compute[75745]:   </features>
Dec 01 17:23:54 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:23:54 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:23:54 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:23:54 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:23:54 user nova-compute[75745]:   </clock>
Dec 01 17:23:54 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:23:54 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:23:54 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:23:54 user nova-compute[75745]:   </cpu>
Dec 01 17:23:54 user nova-compute[75745]:   <devices>
Dec 01 17:23:54 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:23:54 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:23:54 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk"/>
Dec 01 17:23:54 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:23:54 user nova-compute[75745]:     </disk>
Dec 01 17:23:54 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:23:54 user nova-compute[75745]:       <mac address="fa:16:3e:71:7f:4a"/>
Dec 01 17:23:54 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:23:54 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:23:54 user nova-compute[75745]:       <target dev="tapfff6dabe-5d"/>
Dec 01 17:23:54 user nova-compute[75745]:     </interface>
Dec 01 17:23:54 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:23:54 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/console.log" append="off"/>
Dec 01 17:23:54 user nova-compute[75745]:     </serial>
Dec 01 17:23:54 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:23:54 user nova-compute[75745]:     <video>
Dec 01 17:23:54 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:23:54 user nova-compute[75745]:     </video>
Dec 01 17:23:54 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:23:54 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:23:54 user nova-compute[75745]:     </rng>
Dec 01 17:23:54 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:23:54 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:23:54 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:23:54 user nova-compute[75745]:     </memballoon>
Dec 01 17:23:54 user nova-compute[75745]:   </devices>
Dec 01 17:23:54 user nova-compute[75745]: </domain>
Dec 01 17:23:54 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:23:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2051733239',display_name='tempest-TestMinimumBasicScenario-server-2051733239',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2051733239',id=35,image_ref='cb76920d-b7bf-4216-9c1a-8314539397bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnn9DbZ1Jp2KhqktMIfJFAy2AJFm/hYRjxHHwLjF9RbFVRyd8+/P6NS2CW73jwkJj6uEU3/IytWVgpFqd2zzTrgAhNQ0E7yUV0tGqXiGTIYZBRqkb4sHdY6cQgszpx+1g==',key_name='tempest-TestMinimumBasicScenario-1212427382',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c3088641ea74a31a80ade2623f85d91',ramdisk_id='',reservation_id='r-i38vr9t0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cb76920d-b7bf-4216-9c1a-8314539397bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-865236074',owner_user_name='tempest-TestMinimumBasicScenario-865236074-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:23:52Z,user_data=None,user_id='f75082346bbd4b2ebfc585a25a897f81',uuid=b26b6ef1-7a8b-4628-8cc1-d27cc27efcac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "address": "fa:16:3e:71:7f:4a", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff6dabe-5d", "ovs_interfaceid": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Converting VIF {"id": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "address": "fa:16:3e:71:7f:4a", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff6dabe-5d", "ovs_interfaceid": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:7f:4a,bridge_name='br-int',has_traffic_filtering=True,id=fff6dabe-5df3-4db0-85cb-6dce98f4b953,network=Network(bfcf7108-b710-4459-bcd7-fbfd464ee6a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfff6dabe-5d') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG os_vif [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:7f:4a,bridge_name='br-int',has_traffic_filtering=True,id=fff6dabe-5df3-4db0-85cb-6dce98f4b953,network=Network(bfcf7108-b710-4459-bcd7-fbfd464ee6a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfff6dabe-5d') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7303f011-b204-569d-8eb1-3e4aaed8bfdb', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfff6dabe-5d, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfff6dabe-5d, col_values=(('qos', UUID('841a5d7d-6a6f-40e2-8f1b-16f217918923')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfff6dabe-5d, col_values=(('external_ids', {'iface-id': 'fff6dabe-5df3-4db0-85cb-6dce98f4b953', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:7f:4a', 'vm-uuid': 'b26b6ef1-7a8b-4628-8cc1-d27cc27efcac'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:54 user nova-compute[75745]: INFO os_vif [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:7f:4a,bridge_name='br-int',has_traffic_filtering=True,id=fff6dabe-5df3-4db0-85cb-6dce98f4b953,network=Network(bfcf7108-b710-4459-bcd7-fbfd464ee6a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfff6dabe-5d')
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] No VIF found with MAC fa:16:3e:71:7f:4a, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.network.neutron [req-7bc4e840-b21f-4021-97a0-a05ac2c67bcd req-b42b0d25-f811-4913-961a-39d3546c6900 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Updated VIF entry in instance network info cache for port fff6dabe-5df3-4db0-85cb-6dce98f4b953. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG nova.network.neutron [req-7bc4e840-b21f-4021-97a0-a05ac2c67bcd req-b42b0d25-f811-4913-961a-39d3546c6900 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Updating instance_info_cache with network_info: [{"id": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "address": "fa:16:3e:71:7f:4a", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff6dabe-5d", "ovs_interfaceid": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:23:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7bc4e840-b21f-4021-97a0-a05ac2c67bcd req-b42b0d25-f811-4913-961a-39d3546c6900 service nova] Releasing lock "refresh_cache-b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:23:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:55 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:23:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aee52eb-78e3-4f60-a920-7ade912735e8/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aee52eb-78e3-4f60-a920-7ade912735e8/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aee52eb-78e3-4f60-a920-7ade912735e8/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:23:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aee52eb-78e3-4f60-a920-7ade912735e8/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:23:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-30fe274a-1bd2-421b-bc5e-11b22c6f979b req-3581b515-89e2-4817-937a-53d45622c00f service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Received event network-vif-plugged-fff6dabe-5df3-4db0-85cb-6dce98f4b953 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:23:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-30fe274a-1bd2-421b-bc5e-11b22c6f979b req-3581b515-89e2-4817-937a-53d45622c00f service nova] Acquiring lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:23:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-30fe274a-1bd2-421b-bc5e-11b22c6f979b req-3581b515-89e2-4817-937a-53d45622c00f service nova] Lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:23:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-30fe274a-1bd2-421b-bc5e-11b22c6f979b req-3581b515-89e2-4817-937a-53d45622c00f service nova] Lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:23:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-30fe274a-1bd2-421b-bc5e-11b22c6f979b req-3581b515-89e2-4817-937a-53d45622c00f service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] No waiting events found dispatching network-vif-plugged-fff6dabe-5df3-4db0-85cb-6dce98f4b953 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:23:58 user nova-compute[75745]: WARNING nova.compute.manager [req-30fe274a-1bd2-421b-bc5e-11b22c6f979b req-3581b515-89e2-4817-937a-53d45622c00f service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Received unexpected event network-vif-plugged-fff6dabe-5df3-4db0-85cb-6dce98f4b953 for instance with vm_state building and task_state spawning.
Dec 01 17:23:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-d6c13c83-df10-4a87-8298-88c74210806b req-b2a57984-ac71-4b78-93c7-8179bc2136b4 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Received event network-vif-plugged-fff6dabe-5df3-4db0-85cb-6dce98f4b953 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:23:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d6c13c83-df10-4a87-8298-88c74210806b req-b2a57984-ac71-4b78-93c7-8179bc2136b4 service nova] Acquiring lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:23:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d6c13c83-df10-4a87-8298-88c74210806b req-b2a57984-ac71-4b78-93c7-8179bc2136b4 service nova] Lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:23:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d6c13c83-df10-4a87-8298-88c74210806b req-b2a57984-ac71-4b78-93c7-8179bc2136b4 service nova] Lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:23:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-d6c13c83-df10-4a87-8298-88c74210806b req-b2a57984-ac71-4b78-93c7-8179bc2136b4 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] No waiting events found dispatching network-vif-plugged-fff6dabe-5df3-4db0-85cb-6dce98f4b953 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:23:58 user nova-compute[75745]: WARNING nova.compute.manager [req-d6c13c83-df10-4a87-8298-88c74210806b req-b2a57984-ac71-4b78-93c7-8179bc2136b4 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Received unexpected event network-vif-plugged-fff6dabe-5df3-4db0-85cb-6dce98f4b953 for instance with vm_state building and task_state spawning.
Dec 01 17:23:58 user nova-compute[75745]: DEBUG nova.compute.manager [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:23:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:23:58 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Instance spawned successfully.
Dec 01 17:23:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:23:58 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:23:58 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:23:58 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=8041MB free_disk=25.18447494506836GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:23:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:23:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:23:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:23:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:23:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:23:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:23:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:23:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:23:58 user nova-compute[75745]: INFO nova.compute.manager [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Took 6.64 seconds to spawn the instance on the hypervisor.
Dec 01 17:23:58 user nova-compute[75745]: DEBUG nova.compute.manager [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:23:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:23:58 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance d997cdd6-67c6-4263-814a-17cf9e27bbeb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:23:58 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance e4ffb96e-456c-4fb9-9850-9e98310d63e5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:23:58 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 80962f79-dbb2-4380-b2c8-791642cfa86b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:23:58 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 5e631ac3-8122-46a3-a54f-2395c0f7cf7c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:23:58 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 5aee52eb-78e3-4f60-a920-7ade912735e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:23:58 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance c358f18c-44c4-45d4-a1eb-4f259c36a0d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:23:58 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:23:58 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance b26b6ef1-7a8b-4628-8cc1-d27cc27efcac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:23:58 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:23:58 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:23:58 user nova-compute[75745]: INFO nova.compute.manager [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Took 7.39 seconds to build instance.
Dec 01 17:23:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-86457ce9-8118-4399-ad1f-0296c94f38c9 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.485s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:23:59 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:23:59 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:23:59 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:23:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.471s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:23:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:00 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:24:00 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:24:00 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:24:00 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:24:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:01 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:24:01 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:24:01 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Didn't find any instances for network info cache update. {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 17:24:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Acquiring lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:24:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:24:08 user nova-compute[75745]: DEBUG nova.compute.manager [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:24:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:24:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:24:08 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:24:08 user nova-compute[75745]: INFO nova.compute.claims [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Claim successful on node user
Dec 01 17:24:08 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:24:08 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:24:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.369s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:24:08 user nova-compute[75745]: DEBUG nova.compute.manager [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:24:08 user nova-compute[75745]: DEBUG nova.compute.manager [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:24:08 user nova-compute[75745]: DEBUG nova.network.neutron [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:24:08 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:24:08 user nova-compute[75745]: DEBUG nova.compute.manager [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:24:08 user nova-compute[75745]: DEBUG nova.policy [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dc207653aa7c407f92a01ba7cfe89572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5ee303033640e7adebbc0c949be9cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:24:08 user nova-compute[75745]: DEBUG nova.compute.manager [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:24:08 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:24:08 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Creating image(s)
Dec 01 17:24:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Acquiring lock "/opt/stack/data/nova/instances/a4f614f2-6b6c-4841-8a67-6231a33bd98e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:24:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "/opt/stack/data/nova/instances/a4f614f2-6b6c-4841-8a67-6231a33bd98e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:24:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "/opt/stack/data/nova/instances/a4f614f2-6b6c-4841-8a67-6231a33bd98e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:24:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.216s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:24:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:24:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.183s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/a4f614f2-6b6c-4841-8a67-6231a33bd98e/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/a4f614f2-6b6c-4841-8a67-6231a33bd98e/disk 1073741824" returned: 0 in 0.053s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:24:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.193s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:09 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a4f614f2-6b6c-4841-8a67-6231a33bd98e/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:24:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f614f2-6b6c-4841-8a67-6231a33bd98e/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:09 user nova-compute[75745]: DEBUG nova.network.neutron [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Successfully created port: b0b6e35c-be93-4ac7-a7ca-2bf50af82eff {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:24:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f614f2-6b6c-4841-8a67-6231a33bd98e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:09 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Cannot resize image /opt/stack/data/nova/instances/a4f614f2-6b6c-4841-8a67-6231a33bd98e/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:24:09 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:24:09 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Ensure instance console log exists: /opt/stack/data/nova/instances/a4f614f2-6b6c-4841-8a67-6231a33bd98e/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:24:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:24:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:24:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG nova.network.neutron [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Successfully updated port: b0b6e35c-be93-4ac7-a7ca-2bf50af82eff {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Acquiring lock "refresh_cache-a4f614f2-6b6c-4841-8a67-6231a33bd98e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Acquired lock "refresh_cache-a4f614f2-6b6c-4841-8a67-6231a33bd98e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG nova.network.neutron [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG nova.compute.manager [req-bdfac86f-cdf2-485c-9a76-47bac23f5239 req-eaa973c8-ef84-495b-904d-8e6abc0ebd67 service nova] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Received event network-changed-b0b6e35c-be93-4ac7-a7ca-2bf50af82eff {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG nova.compute.manager [req-bdfac86f-cdf2-485c-9a76-47bac23f5239 req-eaa973c8-ef84-495b-904d-8e6abc0ebd67 service nova] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Refreshing instance network info cache due to event network-changed-b0b6e35c-be93-4ac7-a7ca-2bf50af82eff. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-bdfac86f-cdf2-485c-9a76-47bac23f5239 req-eaa973c8-ef84-495b-904d-8e6abc0ebd67 service nova] Acquiring lock "refresh_cache-a4f614f2-6b6c-4841-8a67-6231a33bd98e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG nova.network.neutron [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG nova.network.neutron [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Updating instance_info_cache with network_info: [{"id": "b0b6e35c-be93-4ac7-a7ca-2bf50af82eff", "address": "fa:16:3e:b8:34:57", "network": {"id": "ccf83dac-fecd-4f65-baf8-740ff63f51a0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-804694060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5ee303033640e7adebbc0c949be9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0b6e35c-be", "ovs_interfaceid": "b0b6e35c-be93-4ac7-a7ca-2bf50af82eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Releasing lock "refresh_cache-a4f614f2-6b6c-4841-8a67-6231a33bd98e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG nova.compute.manager [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Instance network_info: |[{"id": "b0b6e35c-be93-4ac7-a7ca-2bf50af82eff", "address": "fa:16:3e:b8:34:57", "network": {"id": "ccf83dac-fecd-4f65-baf8-740ff63f51a0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-804694060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5ee303033640e7adebbc0c949be9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0b6e35c-be", "ovs_interfaceid": "b0b6e35c-be93-4ac7-a7ca-2bf50af82eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-bdfac86f-cdf2-485c-9a76-47bac23f5239 req-eaa973c8-ef84-495b-904d-8e6abc0ebd67 service nova] Acquired lock "refresh_cache-a4f614f2-6b6c-4841-8a67-6231a33bd98e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG nova.network.neutron [req-bdfac86f-cdf2-485c-9a76-47bac23f5239 req-eaa973c8-ef84-495b-904d-8e6abc0ebd67 service nova] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Refreshing network info cache for port b0b6e35c-be93-4ac7-a7ca-2bf50af82eff {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Start _get_guest_xml network_info=[{"id": "b0b6e35c-be93-4ac7-a7ca-2bf50af82eff", "address": "fa:16:3e:b8:34:57", "network": {"id": "ccf83dac-fecd-4f65-baf8-740ff63f51a0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-804694060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5ee303033640e7adebbc0c949be9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0b6e35c-be", "ovs_interfaceid": "b0b6e35c-be93-4ac7-a7ca-2bf50af82eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:24:10 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:24:10 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:24:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:24:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-72091441',display_name='tempest-VolumesSnapshotTestJSON-instance-72091441',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-72091441',id=36,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAecSa1/islivxWF7qyrCG39h0nLmAQt2eJT2zFllbykcmefSwqHFIQrhZblqDSEW34R/tMVBvv/Xi60f7bRkR+IgMeD9PRZDHleASo8SRr74pqD85hTWDnm9avOWnmvA==',key_name='tempest-keypair-1821204491',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c5ee303033640e7adebbc0c949be9cc',ramdisk_id='',reservation_id='r-o00okoy3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1764036907',owner_user_name='tempest-VolumesSnapshotTestJSON-1764036907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:24:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc207653aa7c407f92a01ba7cfe89572',uuid=a4f614f2-6b6c-4841-8a67-6231a33bd98e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0b6e35c-be93-4ac7-a7ca-2bf50af82eff", "address": "fa:16:3e:b8:34:57", "network": {"id": "ccf83dac-fecd-4f65-baf8-740ff63f51a0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-804694060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5ee303033640e7adebbc0c949be9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0b6e35c-be", "ovs_interfaceid": "b0b6e35c-be93-4ac7-a7ca-2bf50af82eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Converting VIF {"id": "b0b6e35c-be93-4ac7-a7ca-2bf50af82eff", "address": "fa:16:3e:b8:34:57", "network": {"id": "ccf83dac-fecd-4f65-baf8-740ff63f51a0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-804694060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5ee303033640e7adebbc0c949be9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0b6e35c-be", "ovs_interfaceid": "b0b6e35c-be93-4ac7-a7ca-2bf50af82eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:34:57,bridge_name='br-int',has_traffic_filtering=True,id=b0b6e35c-be93-4ac7-a7ca-2bf50af82eff,network=Network(ccf83dac-fecd-4f65-baf8-740ff63f51a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0b6e35c-be') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG nova.objects.instance [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lazy-loading 'pci_devices' on Instance uuid a4f614f2-6b6c-4841-8a67-6231a33bd98e {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:24:10 user nova-compute[75745]:   <uuid>a4f614f2-6b6c-4841-8a67-6231a33bd98e</uuid>
Dec 01 17:24:10 user nova-compute[75745]:   <name>instance-00000024</name>
Dec 01 17:24:10 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:24:10 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:24:10 user nova-compute[75745]:   <metadata>
Dec 01 17:24:10 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:24:10 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:24:10 user nova-compute[75745]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-72091441</nova:name>
Dec 01 17:24:10 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:24:10</nova:creationTime>
Dec 01 17:24:10 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:24:10 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:24:10 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:24:10 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:24:10 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:24:10 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:24:10 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:24:10 user nova-compute[75745]:       <nova:owner>
Dec 01 17:24:10 user nova-compute[75745]:         <nova:user uuid="dc207653aa7c407f92a01ba7cfe89572">tempest-VolumesSnapshotTestJSON-1764036907-project-member</nova:user>
Dec 01 17:24:10 user nova-compute[75745]:         <nova:project uuid="2c5ee303033640e7adebbc0c949be9cc">tempest-VolumesSnapshotTestJSON-1764036907</nova:project>
Dec 01 17:24:10 user nova-compute[75745]:       </nova:owner>
Dec 01 17:24:10 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:24:10 user nova-compute[75745]:       <nova:ports>
Dec 01 17:24:10 user nova-compute[75745]:         <nova:port uuid="b0b6e35c-be93-4ac7-a7ca-2bf50af82eff">
Dec 01 17:24:10 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 01 17:24:10 user nova-compute[75745]:         </nova:port>
Dec 01 17:24:10 user nova-compute[75745]:       </nova:ports>
Dec 01 17:24:10 user nova-compute[75745]:     </nova:instance>
Dec 01 17:24:10 user nova-compute[75745]:   </metadata>
Dec 01 17:24:10 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:24:10 user nova-compute[75745]:     <system>
Dec 01 17:24:10 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:24:10 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:24:10 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:24:10 user nova-compute[75745]:       <entry name="serial">a4f614f2-6b6c-4841-8a67-6231a33bd98e</entry>
Dec 01 17:24:10 user nova-compute[75745]:       <entry name="uuid">a4f614f2-6b6c-4841-8a67-6231a33bd98e</entry>
Dec 01 17:24:10 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:24:10 user nova-compute[75745]:     </system>
Dec 01 17:24:10 user nova-compute[75745]:   </sysinfo>
Dec 01 17:24:10 user nova-compute[75745]:   <os>
Dec 01 17:24:10 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:24:10 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:24:10 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:24:10 user nova-compute[75745]:   </os>
Dec 01 17:24:10 user nova-compute[75745]:   <features>
Dec 01 17:24:10 user nova-compute[75745]:     <acpi/>
Dec 01 17:24:10 user nova-compute[75745]:     <apic/>
Dec 01 17:24:10 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:24:10 user nova-compute[75745]:   </features>
Dec 01 17:24:10 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:24:10 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:24:10 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:24:10 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:24:10 user nova-compute[75745]:   </clock>
Dec 01 17:24:10 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:24:10 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:24:10 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:24:10 user nova-compute[75745]:   </cpu>
Dec 01 17:24:10 user nova-compute[75745]:   <devices>
Dec 01 17:24:10 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:24:10 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:24:10 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/a4f614f2-6b6c-4841-8a67-6231a33bd98e/disk"/>
Dec 01 17:24:10 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:24:10 user nova-compute[75745]:     </disk>
Dec 01 17:24:10 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:24:10 user nova-compute[75745]:       <mac address="fa:16:3e:b8:34:57"/>
Dec 01 17:24:10 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:24:10 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:24:10 user nova-compute[75745]:       <target dev="tapb0b6e35c-be"/>
Dec 01 17:24:10 user nova-compute[75745]:     </interface>
Dec 01 17:24:10 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:24:10 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/a4f614f2-6b6c-4841-8a67-6231a33bd98e/console.log" append="off"/>
Dec 01 17:24:10 user nova-compute[75745]:     </serial>
Dec 01 17:24:10 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:24:10 user nova-compute[75745]:     <video>
Dec 01 17:24:10 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:24:10 user nova-compute[75745]:     </video>
Dec 01 17:24:10 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:24:10 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:24:10 user nova-compute[75745]:     </rng>
Dec 01 17:24:10 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:24:10 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:24:10 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:24:10 user nova-compute[75745]:     </memballoon>
Dec 01 17:24:10 user nova-compute[75745]:   </devices>
Dec 01 17:24:10 user nova-compute[75745]: </domain>
Dec 01 17:24:10 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:24:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-72091441',display_name='tempest-VolumesSnapshotTestJSON-instance-72091441',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-72091441',id=36,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAecSa1/islivxWF7qyrCG39h0nLmAQt2eJT2zFllbykcmefSwqHFIQrhZblqDSEW34R/tMVBvv/Xi60f7bRkR+IgMeD9PRZDHleASo8SRr74pqD85hTWDnm9avOWnmvA==',key_name='tempest-keypair-1821204491',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c5ee303033640e7adebbc0c949be9cc',ramdisk_id='',reservation_id='r-o00okoy3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1764036907',owner_user_name='tempest-VolumesSnapshotTestJSON-1764036907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:24:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc207653aa7c407f92a01ba7cfe89572',uuid=a4f614f2-6b6c-4841-8a67-6231a33bd98e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0b6e35c-be93-4ac7-a7ca-2bf50af82eff", "address": "fa:16:3e:b8:34:57", "network": {"id": "ccf83dac-fecd-4f65-baf8-740ff63f51a0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-804694060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5ee303033640e7adebbc0c949be9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0b6e35c-be", "ovs_interfaceid": "b0b6e35c-be93-4ac7-a7ca-2bf50af82eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Converting VIF {"id": "b0b6e35c-be93-4ac7-a7ca-2bf50af82eff", "address": "fa:16:3e:b8:34:57", "network": {"id": "ccf83dac-fecd-4f65-baf8-740ff63f51a0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-804694060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5ee303033640e7adebbc0c949be9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0b6e35c-be", "ovs_interfaceid": "b0b6e35c-be93-4ac7-a7ca-2bf50af82eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:34:57,bridge_name='br-int',has_traffic_filtering=True,id=b0b6e35c-be93-4ac7-a7ca-2bf50af82eff,network=Network(ccf83dac-fecd-4f65-baf8-740ff63f51a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0b6e35c-be') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG os_vif [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:34:57,bridge_name='br-int',has_traffic_filtering=True,id=b0b6e35c-be93-4ac7-a7ca-2bf50af82eff,network=Network(ccf83dac-fecd-4f65-baf8-740ff63f51a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0b6e35c-be') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '481dbec3-7f2a-5645-9eb4-5ee5fb41b561', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0b6e35c-be, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb0b6e35c-be, col_values=(('qos', UUID('2f54aa19-0675-4f0e-82e7-b0ada095c604')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb0b6e35c-be, col_values=(('external_ids', {'iface-id': 'b0b6e35c-be93-4ac7-a7ca-2bf50af82eff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:34:57', 'vm-uuid': 'a4f614f2-6b6c-4841-8a67-6231a33bd98e'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:10 user nova-compute[75745]: INFO os_vif [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:34:57,bridge_name='br-int',has_traffic_filtering=True,id=b0b6e35c-be93-4ac7-a7ca-2bf50af82eff,network=Network(ccf83dac-fecd-4f65-baf8-740ff63f51a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0b6e35c-be')
Dec 01 17:24:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:24:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] No VIF found with MAC fa:16:3e:b8:34:57, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:24:11 user nova-compute[75745]: DEBUG nova.network.neutron [req-bdfac86f-cdf2-485c-9a76-47bac23f5239 req-eaa973c8-ef84-495b-904d-8e6abc0ebd67 service nova] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Updated VIF entry in instance network info cache for port b0b6e35c-be93-4ac7-a7ca-2bf50af82eff. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:24:11 user nova-compute[75745]: DEBUG nova.network.neutron [req-bdfac86f-cdf2-485c-9a76-47bac23f5239 req-eaa973c8-ef84-495b-904d-8e6abc0ebd67 service nova] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Updating instance_info_cache with network_info: [{"id": "b0b6e35c-be93-4ac7-a7ca-2bf50af82eff", "address": "fa:16:3e:b8:34:57", "network": {"id": "ccf83dac-fecd-4f65-baf8-740ff63f51a0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-804694060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5ee303033640e7adebbc0c949be9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0b6e35c-be", "ovs_interfaceid": "b0b6e35c-be93-4ac7-a7ca-2bf50af82eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:24:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-bdfac86f-cdf2-485c-9a76-47bac23f5239 req-eaa973c8-ef84-495b-904d-8e6abc0ebd67 service nova] Releasing lock "refresh_cache-a4f614f2-6b6c-4841-8a67-6231a33bd98e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:24:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:12 user nova-compute[75745]: DEBUG nova.compute.manager [req-dd55ffc6-182b-4742-958c-f522dee8b760 req-496896e4-068a-47bc-8c1d-90948d66fff0 service nova] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Received event network-vif-plugged-b0b6e35c-be93-4ac7-a7ca-2bf50af82eff {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:24:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-dd55ffc6-182b-4742-958c-f522dee8b760 req-496896e4-068a-47bc-8c1d-90948d66fff0 service nova] Acquiring lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:24:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-dd55ffc6-182b-4742-958c-f522dee8b760 req-496896e4-068a-47bc-8c1d-90948d66fff0 service nova] Lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:24:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-dd55ffc6-182b-4742-958c-f522dee8b760 req-496896e4-068a-47bc-8c1d-90948d66fff0 service nova] Lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:24:12 user nova-compute[75745]: DEBUG nova.compute.manager [req-dd55ffc6-182b-4742-958c-f522dee8b760 req-496896e4-068a-47bc-8c1d-90948d66fff0 service nova] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] No waiting events found dispatching network-vif-plugged-b0b6e35c-be93-4ac7-a7ca-2bf50af82eff {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:24:12 user nova-compute[75745]: WARNING nova.compute.manager [req-dd55ffc6-182b-4742-958c-f522dee8b760 req-496896e4-068a-47bc-8c1d-90948d66fff0 service nova] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Received unexpected event network-vif-plugged-b0b6e35c-be93-4ac7-a7ca-2bf50af82eff for instance with vm_state building and task_state spawning.
Dec 01 17:24:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:14 user nova-compute[75745]: DEBUG nova.compute.manager [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:24:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:24:14 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Instance spawned successfully.
Dec 01 17:24:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:24:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:24:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:24:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:24:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:24:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:24:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:24:14 user nova-compute[75745]: INFO nova.compute.manager [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Took 5.54 seconds to spawn the instance on the hypervisor.
Dec 01 17:24:14 user nova-compute[75745]: DEBUG nova.compute.manager [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:24:14 user nova-compute[75745]: DEBUG nova.compute.manager [req-d894d805-8e86-4b68-bedf-de3c25d713ff req-67b99009-4496-49e3-aadd-389abb21e696 service nova] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Received event network-vif-plugged-b0b6e35c-be93-4ac7-a7ca-2bf50af82eff {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:24:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d894d805-8e86-4b68-bedf-de3c25d713ff req-67b99009-4496-49e3-aadd-389abb21e696 service nova] Acquiring lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:24:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d894d805-8e86-4b68-bedf-de3c25d713ff req-67b99009-4496-49e3-aadd-389abb21e696 service nova] Lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:24:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d894d805-8e86-4b68-bedf-de3c25d713ff req-67b99009-4496-49e3-aadd-389abb21e696 service nova] Lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:24:14 user nova-compute[75745]: DEBUG nova.compute.manager [req-d894d805-8e86-4b68-bedf-de3c25d713ff req-67b99009-4496-49e3-aadd-389abb21e696 service nova] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] No waiting events found dispatching network-vif-plugged-b0b6e35c-be93-4ac7-a7ca-2bf50af82eff {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:24:14 user nova-compute[75745]: WARNING nova.compute.manager [req-d894d805-8e86-4b68-bedf-de3c25d713ff req-67b99009-4496-49e3-aadd-389abb21e696 service nova] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Received unexpected event network-vif-plugged-b0b6e35c-be93-4ac7-a7ca-2bf50af82eff for instance with vm_state building and task_state spawning.
Dec 01 17:24:14 user nova-compute[75745]: INFO nova.compute.manager [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Took 6.26 seconds to build instance.
Dec 01 17:24:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4c87c80b-81df-4e9f-b232-3cc73b48261f tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.390s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:24:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:26 user nova-compute[75745]: DEBUG nova.compute.manager [req-83e9f7f4-db1a-4cb4-b0f9-698c7a5bf91a req-f42ba4d6-fb50-4748-a7f8-e1b9206cc3bb service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Received event network-changed-d4c74908-1bd2-4891-b4d7-932d73d78217 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:24:26 user nova-compute[75745]: DEBUG nova.compute.manager [req-83e9f7f4-db1a-4cb4-b0f9-698c7a5bf91a req-f42ba4d6-fb50-4748-a7f8-e1b9206cc3bb service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Refreshing instance network info cache due to event network-changed-d4c74908-1bd2-4891-b4d7-932d73d78217. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:24:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-83e9f7f4-db1a-4cb4-b0f9-698c7a5bf91a req-f42ba4d6-fb50-4748-a7f8-e1b9206cc3bb service nova] Acquiring lock "refresh_cache-c358f18c-44c4-45d4-a1eb-4f259c36a0d9" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:24:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-83e9f7f4-db1a-4cb4-b0f9-698c7a5bf91a req-f42ba4d6-fb50-4748-a7f8-e1b9206cc3bb service nova] Acquired lock "refresh_cache-c358f18c-44c4-45d4-a1eb-4f259c36a0d9" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:24:26 user nova-compute[75745]: DEBUG nova.network.neutron [req-83e9f7f4-db1a-4cb4-b0f9-698c7a5bf91a req-f42ba4d6-fb50-4748-a7f8-e1b9206cc3bb service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Refreshing network info cache for port d4c74908-1bd2-4891-b4d7-932d73d78217 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:24:27 user nova-compute[75745]: DEBUG nova.network.neutron [req-83e9f7f4-db1a-4cb4-b0f9-698c7a5bf91a req-f42ba4d6-fb50-4748-a7f8-e1b9206cc3bb service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Updated VIF entry in instance network info cache for port d4c74908-1bd2-4891-b4d7-932d73d78217. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:24:27 user nova-compute[75745]: DEBUG nova.network.neutron [req-83e9f7f4-db1a-4cb4-b0f9-698c7a5bf91a req-f42ba4d6-fb50-4748-a7f8-e1b9206cc3bb service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Updating instance_info_cache with network_info: [{"id": "d4c74908-1bd2-4891-b4d7-932d73d78217", "address": "fa:16:3e:f0:97:04", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c74908-1b", "ovs_interfaceid": "d4c74908-1bd2-4891-b4d7-932d73d78217", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:24:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-83e9f7f4-db1a-4cb4-b0f9-698c7a5bf91a req-f42ba4d6-fb50-4748-a7f8-e1b9206cc3bb service nova] Releasing lock "refresh_cache-c358f18c-44c4-45d4-a1eb-4f259c36a0d9" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:24:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:24:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:24:28 user nova-compute[75745]: DEBUG nova.objects.instance [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lazy-loading 'flavor' on Instance uuid c358f18c-44c4-45d4-a1eb-4f259c36a0d9 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:24:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.136s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:24:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:24:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:24:28 user nova-compute[75745]: INFO nova.compute.manager [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Attaching volume c1bb7743-921b-4683-97c5-13a2e3832740 to /dev/vdb
Dec 01 17:24:28 user nova-compute[75745]: DEBUG os_brick.utils [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:24:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:28 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efa68e6-6190-40cc-b6f4-f1785f7cc465]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:28 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c77689-fdc6-45ed-ad2d-b7156c456a61]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:28 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac36ec0-be90-47c8-a3a9-eaa01f79b279]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:28 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb03cf53-a891-4af9-bc33-623178b5477f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:24:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:24:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:24:28 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:24:28 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e46751d-b0e8-4e7b-8eff-7988cbc51b50]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:24:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:24:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:24:28 user nova-compute[75745]: DEBUG os_brick.utils [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:24:28 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Updating existing volume attachment record: aad17dac-6987-47b5-8832-e9bef8474cb4 {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:24:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:35 user nova-compute[75745]: DEBUG nova.compute.manager [req-38921cf1-e11b-497d-9dbb-300847b487f4 req-2ca70197-ca4c-4e35-9033-09b13626c702 service nova] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Received event network-changed-9d64a643-0dca-4fe1-8734-9778689292bc {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:24:35 user nova-compute[75745]: DEBUG nova.compute.manager [req-38921cf1-e11b-497d-9dbb-300847b487f4 req-2ca70197-ca4c-4e35-9033-09b13626c702 service nova] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Refreshing instance network info cache due to event network-changed-9d64a643-0dca-4fe1-8734-9778689292bc. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:24:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-38921cf1-e11b-497d-9dbb-300847b487f4 req-2ca70197-ca4c-4e35-9033-09b13626c702 service nova] Acquiring lock "refresh_cache-d997cdd6-67c6-4263-814a-17cf9e27bbeb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:24:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-38921cf1-e11b-497d-9dbb-300847b487f4 req-2ca70197-ca4c-4e35-9033-09b13626c702 service nova] Acquired lock "refresh_cache-d997cdd6-67c6-4263-814a-17cf9e27bbeb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:24:35 user nova-compute[75745]: DEBUG nova.network.neutron [req-38921cf1-e11b-497d-9dbb-300847b487f4 req-2ca70197-ca4c-4e35-9033-09b13626c702 service nova] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Refreshing network info cache for port 9d64a643-0dca-4fe1-8734-9778689292bc {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:24:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:36 user nova-compute[75745]: DEBUG nova.network.neutron [req-38921cf1-e11b-497d-9dbb-300847b487f4 req-2ca70197-ca4c-4e35-9033-09b13626c702 service nova] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Updated VIF entry in instance network info cache for port 9d64a643-0dca-4fe1-8734-9778689292bc. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:24:36 user nova-compute[75745]: DEBUG nova.network.neutron [req-38921cf1-e11b-497d-9dbb-300847b487f4 req-2ca70197-ca4c-4e35-9033-09b13626c702 service nova] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Updating instance_info_cache with network_info: [{"id": "9d64a643-0dca-4fe1-8734-9778689292bc", "address": "fa:16:3e:e2:0c:90", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d64a643-0d", "ovs_interfaceid": "9d64a643-0dca-4fe1-8734-9778689292bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:24:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-38921cf1-e11b-497d-9dbb-300847b487f4 req-2ca70197-ca4c-4e35-9033-09b13626c702 service nova] Releasing lock "refresh_cache-d997cdd6-67c6-4263-814a-17cf9e27bbeb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:24:37 user nova-compute[75745]: DEBUG nova.compute.manager [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Stashing vm_state: active {{(pid=75745) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Dec 01 17:24:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:24:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:24:37 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:24:37 user nova-compute[75745]: INFO nova.compute.claims [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Claim successful on node user
Dec 01 17:24:37 user nova-compute[75745]: INFO nova.compute.resource_tracker [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Updating resource usage from migration 320e3003-0dff-4f3d-9818-43eea6fdff82
Dec 01 17:24:37 user nova-compute[75745]: DEBUG nova.compute.manager [req-b28a6c87-a787-4811-92b0-315c1be00753 req-57960fbf-32c1-4059-9e5c-b44e892a0936 service nova] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Received event network-changed-eeff2c22-349b-42cf-9290-6efccc7686d6 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:24:37 user nova-compute[75745]: DEBUG nova.compute.manager [req-b28a6c87-a787-4811-92b0-315c1be00753 req-57960fbf-32c1-4059-9e5c-b44e892a0936 service nova] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Refreshing instance network info cache due to event network-changed-eeff2c22-349b-42cf-9290-6efccc7686d6. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:24:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b28a6c87-a787-4811-92b0-315c1be00753 req-57960fbf-32c1-4059-9e5c-b44e892a0936 service nova] Acquiring lock "refresh_cache-2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:24:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b28a6c87-a787-4811-92b0-315c1be00753 req-57960fbf-32c1-4059-9e5c-b44e892a0936 service nova] Acquired lock "refresh_cache-2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:24:37 user nova-compute[75745]: DEBUG nova.network.neutron [req-b28a6c87-a787-4811-92b0-315c1be00753 req-57960fbf-32c1-4059-9e5c-b44e892a0936 service nova] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Refreshing network info cache for port eeff2c22-349b-42cf-9290-6efccc7686d6 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:24:37 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.433s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:24:38 user nova-compute[75745]: INFO nova.compute.manager [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Migrating
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "refresh_cache-2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JrvSuhAq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:24:38 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:24:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:24:38 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:24:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:24:38 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG nova.network.neutron [req-b28a6c87-a787-4811-92b0-315c1be00753 req-57960fbf-32c1-4059-9e5c-b44e892a0936 service nova] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Updated VIF entry in instance network info cache for port eeff2c22-349b-42cf-9290-6efccc7686d6. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG nova.network.neutron [req-b28a6c87-a787-4811-92b0-315c1be00753 req-57960fbf-32c1-4059-9e5c-b44e892a0936 service nova] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Updating instance_info_cache with network_info: [{"id": "eeff2c22-349b-42cf-9290-6efccc7686d6", "address": "fa:16:3e:67:06:2e", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeff2c22-34", "ovs_interfaceid": "eeff2c22-349b-42cf-9290-6efccc7686d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a98cd7-b8d3-4628-abf2-2e97746f76e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:24:38 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b28a6c87-a787-4811-92b0-315c1be00753 req-57960fbf-32c1-4059-9e5c-b44e892a0936 service nova] Releasing lock "refresh_cache-2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquired lock "refresh_cache-2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG nova.network.neutron [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e11353-ca9b-4271-9ddf-e823c490049e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740] added
Dec 01 17:24:38 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8867cdfb-3d5b-4766-a79a-9cfc4d6c4123]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b44e0c-5882-4fd2-9663-9c759809b055]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JrvSuhAq {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JrvSuhAq" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc50abbe-6ee5-426e-9f15-e3c432f89643]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JrvSuhAq'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d0edc6-dd00-403c-8b5c-4fca069e62d4]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92b951e-02ad-4a6e-a93c-dc4a84f02d24]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:24:38 user nova-compute[75745]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:24:38 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:24:38 user nova-compute[75745]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:24:38 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[592e9cd6-d5c8-4166-8734-1b6a20308f44]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740, portal: 172.16.0.220,3260]
Dec 01 17:24:38 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740, portal: 172.16.0.220,3260] successful.
Dec 01 17:24:38 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[96212a98-348f-4192-a206-19bdc8cd3ef1]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c497f7-e67e-4d05-bd68-1c443618a279]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:24:38 user nova-compute[75745]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:24:38 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:24:38 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:24:38 user nova-compute[75745]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:24:38 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:24:38 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4b1387-08ee-4369-9586-5d489ed12038]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JrvSuhAq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG nova.network.neutron [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Updating instance_info_cache with network_info: [{"id": "eeff2c22-349b-42cf-9290-6efccc7686d6", "address": "fa:16:3e:67:06:2e", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeff2c22-34", "ovs_interfaceid": "eeff2c22-349b-42cf-9290-6efccc7686d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Releasing lock "refresh_cache-2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Starting migrate_disk_and_power_off {{(pid=75745) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11481}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG nova.compute.manager [req-38fc3ba6-c87a-4425-b1be-1a4c77e199d3 req-d3f7584b-32b3-4d33-82c8-6f0ebde7fd36 service nova] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Received event network-vif-unplugged-eeff2c22-349b-42cf-9290-6efccc7686d6 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-38fc3ba6-c87a-4425-b1be-1a4c77e199d3 req-d3f7584b-32b3-4d33-82c8-6f0ebde7fd36 service nova] Acquiring lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-38fc3ba6-c87a-4425-b1be-1a4c77e199d3 req-d3f7584b-32b3-4d33-82c8-6f0ebde7fd36 service nova] Lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-38fc3ba6-c87a-4425-b1be-1a4c77e199d3 req-d3f7584b-32b3-4d33-82c8-6f0ebde7fd36 service nova] Lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG nova.compute.manager [req-38fc3ba6-c87a-4425-b1be-1a4c77e199d3 req-d3f7584b-32b3-4d33-82c8-6f0ebde7fd36 service nova] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] No waiting events found dispatching network-vif-unplugged-eeff2c22-349b-42cf-9290-6efccc7686d6 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:24:39 user nova-compute[75745]: WARNING nova.compute.manager [req-38fc3ba6-c87a-4425-b1be-1a4c77e199d3 req-d3f7584b-32b3-4d33-82c8-6f0ebde7fd36 service nova] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Received unexpected event network-vif-unplugged-eeff2c22-349b-42cf-9290-6efccc7686d6 for instance with vm_state active and task_state resize_migrating.
Dec 01 17:24:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26134656336346330', 'path': '/dev/sdc'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134656336346330', 'path': '/dev/sdc'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG nova.objects.instance [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lazy-loading 'flavor' on Instance uuid c358f18c-44c4-45d4-a1eb-4f259c36a0d9 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 17:24:39 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:24:39 user nova-compute[75745]:   <source dev="/dev/sdc"/>
Dec 01 17:24:39 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:24:39 user nova-compute[75745]:   <serial>c1bb7743-921b-4683-97c5-13a2e3832740</serial>
Dec 01 17:24:39 user nova-compute[75745]: </disk>
Dec 01 17:24:39 user nova-compute[75745]:  {{(pid=75745) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 17:24:39 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Instance destroyed successfully.
Dec 01 17:24:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:22:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1848665207',display_name='tempest-ServerActionsTestOtherA-server-1848665207',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1848665207',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEe39hBsqXh7qTHbR/1n4TCThkWTxdl0f3mcj7VutursSM+B5AqiMiKGVg5IqL9MYbDfyNfGcyjgOxxpAU4qczogEswNK8dvSit+JyFqtuJxlzPiy3ZkcIr+yzYcqZB0A==',key_name='tempest-keypair-3711887',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:23:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='409356993ea442c5abdf4269aebe43ab',ramdisk_id='',reservation_id='r-0dzhv7we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1500186869',owner_user_name='tempest-ServerActionsTestOtherA-1500186869-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:24:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5204ecaa9b354d10bac514c27acbccc6',uuid=2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eeff2c22-349b-42cf-9290-6efccc7686d6", "address": "fa:16:3e:67:06:2e", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1884243825-network", "vif_mac": "fa:16:3e:67:06:2e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeff2c22-34", "ovs_interfaceid": "eeff2c22-349b-42cf-9290-6efccc7686d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Converting VIF {"id": "eeff2c22-349b-42cf-9290-6efccc7686d6", "address": "fa:16:3e:67:06:2e", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1884243825-network", "vif_mac": "fa:16:3e:67:06:2e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeff2c22-34", "ovs_interfaceid": "eeff2c22-349b-42cf-9290-6efccc7686d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:06:2e,bridge_name='br-int',has_traffic_filtering=True,id=eeff2c22-349b-42cf-9290-6efccc7686d6,network=Network(f7cefc9d-2279-4601-8a81-a640ad1aea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeff2c22-34') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG os_vif [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:06:2e,bridge_name='br-int',has_traffic_filtering=True,id=eeff2c22-349b-42cf-9290-6efccc7686d6,network=Network(f7cefc9d-2279-4601-8a81-a640ad1aea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeff2c22-34') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeeff2c22-34, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e025641c-be21-4a08-baf7-24651e7faa14) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:24:39 user nova-compute[75745]: INFO os_vif [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:06:2e,bridge_name='br-int',has_traffic_filtering=True,id=eeff2c22-349b-42cf-9290-6efccc7686d6,network=Network(f7cefc9d-2279-4601-8a81-a640ad1aea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeff2c22-34')
Dec 01 17:24:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DeWhlKJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:24:39 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:24:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c52ceae-954d-43df-89c9-d8d9d22cb304]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:24:39 user nova-compute[75745]: No targets found.
Dec 01 17:24:39 user nova-compute[75745]: iSNS:
Dec 01 17:24:39 user nova-compute[75745]: No targets found.
Dec 01 17:24:39 user nova-compute[75745]: STATIC:
Dec 01 17:24:39 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df
Dec 01 17:24:39 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:24:39 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:24:39 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0
Dec 01 17:24:39 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:24:39 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:24:39 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740
Dec 01 17:24:39 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:24:39 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:24:39 user nova-compute[75745]: FIRMWARE:
Dec 01 17:24:39 user nova-compute[75745]: No targets found.
Dec 01 17:24:39 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:24:39 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:24:39 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a344c7-7c2b-47cb-bd7d-9df39eb64e18]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb96163-14da-44bf-8d43-b2d076e28deb]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:24:39 user nova-compute[75745]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:24:39 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:24:39 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:24:39 user nova-compute[75745]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:24:39 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:24:39 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f249870cc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df'): ({'sdd'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Removing single pathed devices sdd {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4382d97b-66da-4f3f-9fda-2ba500f1c543]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eff109d-d3e0-49ef-9b00-7cdd1f083f17]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Flushing IO for device /dev/sdd {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d54fce-9419-47cc-8235-1fcf42dad68a]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f262b2-a781-4317-a210-4b718ad42837]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] SCSI volumes sdd have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_d1d440ca', '/dev/disk/by-id/scsi-26365393231383963', '/dev/disk/by-id/scsi-1SCST_BIOd1d440ca-ce92189cd70e48d2') {{(pid=86714) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 01 17:24:39 user nova-compute[75745]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_d1d440ca
Dec 01 17:24:39 user nova-compute[75745]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26365393231383963
Dec 01 17:24:39 user nova-compute[75745]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOd1d440ca-ce92189cd70e48d2
Dec 01 17:24:39 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ab0303-3c79-4200-9d95-704024ed0059]: (4, None) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd467e33-511b-4899-b091-3d9d8e844411]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:24:39 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:40 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a731de-86ef-43a3-b984-350d775d0683]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:40 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df, portal: 172.16.0.220,3260]
Dec 01 17:24:40 user nova-compute[75745]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df, portal: 172.16.0.220,3260] successful.
Dec 01 17:24:40 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:24:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --op delete" returned: 0 in 0.050s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:40 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5189a596-02df-4479-83b5-b99b2e4c5bc2]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:40 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:24:40 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:24:40 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] <== disconnect_volume: return (378ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:24:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:24:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:24:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:24:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:24:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] No VIF found with MAC fa:16:3e:f0:97:04, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:24:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-544db421-a5b0-42c0-93fc-6ea278e9aaa6 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.993s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:24:41 user nova-compute[75745]: DEBUG nova.network.neutron [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Port eeff2c22-349b-42cf-9290-6efccc7686d6 binding to destination host user is already ACTIVE {{(pid=75745) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Dec 01 17:24:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:24:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:24:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:24:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "refresh_cache-2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:24:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquired lock "refresh_cache-2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:24:41 user nova-compute[75745]: DEBUG nova.network.neutron [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:24:41 user nova-compute[75745]: DEBUG nova.compute.manager [req-ad5bde04-69fa-4311-90d5-93a2abd6f5e6 req-6b80fe37-ffa5-4101-9db1-b96d71d70a1d service nova] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Received event network-vif-plugged-eeff2c22-349b-42cf-9290-6efccc7686d6 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:24:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ad5bde04-69fa-4311-90d5-93a2abd6f5e6 req-6b80fe37-ffa5-4101-9db1-b96d71d70a1d service nova] Acquiring lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:24:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ad5bde04-69fa-4311-90d5-93a2abd6f5e6 req-6b80fe37-ffa5-4101-9db1-b96d71d70a1d service nova] Lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:24:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ad5bde04-69fa-4311-90d5-93a2abd6f5e6 req-6b80fe37-ffa5-4101-9db1-b96d71d70a1d service nova] Lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:24:41 user nova-compute[75745]: DEBUG nova.compute.manager [req-ad5bde04-69fa-4311-90d5-93a2abd6f5e6 req-6b80fe37-ffa5-4101-9db1-b96d71d70a1d service nova] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] No waiting events found dispatching network-vif-plugged-eeff2c22-349b-42cf-9290-6efccc7686d6 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:24:41 user nova-compute[75745]: WARNING nova.compute.manager [req-ad5bde04-69fa-4311-90d5-93a2abd6f5e6 req-6b80fe37-ffa5-4101-9db1-b96d71d70a1d service nova] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Received unexpected event network-vif-plugged-eeff2c22-349b-42cf-9290-6efccc7686d6 for instance with vm_state active and task_state resize_migrated.
Dec 01 17:24:41 user nova-compute[75745]: INFO nova.compute.manager [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Rescuing
Dec 01 17:24:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "refresh_cache-c358f18c-44c4-45d4-a1eb-4f259c36a0d9" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:24:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquired lock "refresh_cache-c358f18c-44c4-45d4-a1eb-4f259c36a0d9" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:24:41 user nova-compute[75745]: DEBUG nova.network.neutron [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:24:41 user nova-compute[75745]: DEBUG nova.network.neutron [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Updating instance_info_cache with network_info: [{"id": "eeff2c22-349b-42cf-9290-6efccc7686d6", "address": "fa:16:3e:67:06:2e", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeff2c22-34", "ovs_interfaceid": "eeff2c22-349b-42cf-9290-6efccc7686d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:24:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Releasing lock "refresh_cache-2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:24:41 user nova-compute[75745]: DEBUG os_brick.utils [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:24:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:41 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a34992-4a9b-4376-a3d8-2c54b7577eae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:41 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:42 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7dc321-f662-4441-95f4-131f20ecd995]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:42 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7646ae2-8e39-4a8f-a39f-7e39debb5125]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:42 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f6fc28-539c-4fbc-9594-7b3893c281a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:24:42 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:24:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:24:42 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:24:42 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[600e7d7f-3d7f-4a42-986d-89561ef481ad]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:42 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:24:42 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:24:42 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:24:42 user nova-compute[75745]: DEBUG os_brick.utils [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:24:42 user nova-compute[75745]: DEBUG nova.network.neutron [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Updating instance_info_cache with network_info: [{"id": "d4c74908-1bd2-4891-b4d7-932d73d78217", "address": "fa:16:3e:f0:97:04", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c74908-1b", "ovs_interfaceid": "d4c74908-1bd2-4891-b4d7-932d73d78217", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:24:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Releasing lock "refresh_cache-c358f18c-44c4-45d4-a1eb-4f259c36a0d9" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:24:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:43 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Instance destroyed successfully.
Dec 01 17:24:43 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Attempting rescue
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75745) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Instance directory exists: not creating {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Dec 01 17:24:43 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Creating image(s)
Dec 01 17:24:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "/opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "/opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "/opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.objects.instance [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lazy-loading 'trusted_certs' on Instance uuid c358f18c-44c4-45d4-a1eb-4f259c36a0d9 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.181s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk.rescue {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk.rescue" returned: 0 in 0.056s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.objects.instance [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lazy-loading 'migration_context' on Instance uuid c358f18c-44c4-45d4-a1eb-4f259c36a0d9 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.objects.base [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Object Instance<c358f18c-44c4-45d4-a1eb-4f259c36a0d9> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Start _get_guest_xml network_info=[{"id": "d4c74908-1bd2-4891-b4d7-932d73d78217", "address": "fa:16:3e:f0:97:04", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "vif_mac": "fa:16:3e:f0:97:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c74908-1b", "ovs_interfaceid": "d4c74908-1bd2-4891-b4d7-932d73d78217", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.objects.instance [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lazy-loading 'resources' on Instance uuid c358f18c-44c4-45d4-a1eb-4f259c36a0d9 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.objects.base [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Object Instance<c358f18c-44c4-45d4-a1eb-4f259c36a0d9> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.objects.instance [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lazy-loading 'numa_topology' on Instance uuid c358f18c-44c4-45d4-a1eb-4f259c36a0d9 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.objects.base [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Object Instance<c358f18c-44c4-45d4-a1eb-4f259c36a0d9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:24:43 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:24:43 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.objects.instance [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lazy-loading 'vcpu_model' on Instance uuid c358f18c-44c4-45d4-a1eb-4f259c36a0d9 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.objects.base [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Object Instance<c358f18c-44c4-45d4-a1eb-4f259c36a0d9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:22:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1788989126',display_name='tempest-ServerRescueNegativeTestJSON-server-1788989126',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1788989126',id=33,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8Ny/kflSsA/c+tWkGK85ReUuke09ZnT0oGtBWkatJTKiv30mPJKfLxH/UO+SRW8uuaOsr7cRtGJRij8ZM2s2C3b2cN6ruVTZIIna3IJLwAR8q4wG9dKDCFKwRXopbBew==',key_name='tempest-keypair-1045907146',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:22:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4542114c14774241bb138dfafe3441ad',ramdisk_id='',reservation_id='r-3z4xnddl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1719994145',owner_user_name='tempest-ServerRescueNegativeTestJSON-1719994145-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:22:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bd90117cc3c433d953b7e0de3718f0d',uuid=c358f18c-44c4-45d4-a1eb-4f259c36a0d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4c74908-1bd2-4891-b4d7-932d73d78217", "address": "fa:16:3e:f0:97:04", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "vif_mac": "fa:16:3e:f0:97:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c74908-1b", "ovs_interfaceid": "d4c74908-1bd2-4891-b4d7-932d73d78217", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Converting VIF {"id": "d4c74908-1bd2-4891-b4d7-932d73d78217", "address": "fa:16:3e:f0:97:04", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "vif_mac": "fa:16:3e:f0:97:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c74908-1b", "ovs_interfaceid": "d4c74908-1bd2-4891-b4d7-932d73d78217", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:97:04,bridge_name='br-int',has_traffic_filtering=True,id=d4c74908-1bd2-4891-b4d7-932d73d78217,network=Network(fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4c74908-1b') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.objects.instance [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lazy-loading 'pci_devices' on Instance uuid c358f18c-44c4-45d4-a1eb-4f259c36a0d9 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.objects.base [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Object Instance<c358f18c-44c4-45d4-a1eb-4f259c36a0d9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:24:43 user nova-compute[75745]:   <uuid>c358f18c-44c4-45d4-a1eb-4f259c36a0d9</uuid>
Dec 01 17:24:43 user nova-compute[75745]:   <name>instance-00000021</name>
Dec 01 17:24:43 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:24:43 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:24:43 user nova-compute[75745]:   <metadata>
Dec 01 17:24:43 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:24:43 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:24:43 user nova-compute[75745]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1788989126</nova:name>
Dec 01 17:24:43 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:24:43</nova:creationTime>
Dec 01 17:24:43 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:24:43 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:24:43 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:24:43 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:24:43 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:24:43 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:24:43 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:24:43 user nova-compute[75745]:       <nova:owner>
Dec 01 17:24:43 user nova-compute[75745]:         <nova:user uuid="7bd90117cc3c433d953b7e0de3718f0d">tempest-ServerRescueNegativeTestJSON-1719994145-project-member</nova:user>
Dec 01 17:24:43 user nova-compute[75745]:         <nova:project uuid="4542114c14774241bb138dfafe3441ad">tempest-ServerRescueNegativeTestJSON-1719994145</nova:project>
Dec 01 17:24:43 user nova-compute[75745]:       </nova:owner>
Dec 01 17:24:43 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:24:43 user nova-compute[75745]:       <nova:ports>
Dec 01 17:24:43 user nova-compute[75745]:         <nova:port uuid="d4c74908-1bd2-4891-b4d7-932d73d78217">
Dec 01 17:24:43 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 01 17:24:43 user nova-compute[75745]:         </nova:port>
Dec 01 17:24:43 user nova-compute[75745]:       </nova:ports>
Dec 01 17:24:43 user nova-compute[75745]:     </nova:instance>
Dec 01 17:24:43 user nova-compute[75745]:   </metadata>
Dec 01 17:24:43 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:24:43 user nova-compute[75745]:     <system>
Dec 01 17:24:43 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:24:43 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:24:43 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:24:43 user nova-compute[75745]:       <entry name="serial">c358f18c-44c4-45d4-a1eb-4f259c36a0d9</entry>
Dec 01 17:24:43 user nova-compute[75745]:       <entry name="uuid">c358f18c-44c4-45d4-a1eb-4f259c36a0d9</entry>
Dec 01 17:24:43 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:24:43 user nova-compute[75745]:     </system>
Dec 01 17:24:43 user nova-compute[75745]:   </sysinfo>
Dec 01 17:24:43 user nova-compute[75745]:   <os>
Dec 01 17:24:43 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:24:43 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:24:43 user nova-compute[75745]:   </os>
Dec 01 17:24:43 user nova-compute[75745]:   <features>
Dec 01 17:24:43 user nova-compute[75745]:     <acpi/>
Dec 01 17:24:43 user nova-compute[75745]:     <apic/>
Dec 01 17:24:43 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:24:43 user nova-compute[75745]:   </features>
Dec 01 17:24:43 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:24:43 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:24:43 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:24:43 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:24:43 user nova-compute[75745]:   </clock>
Dec 01 17:24:43 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:24:43 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:24:43 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:24:43 user nova-compute[75745]:   </cpu>
Dec 01 17:24:43 user nova-compute[75745]:   <devices>
Dec 01 17:24:43 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:24:43 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:24:43 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk.rescue"/>
Dec 01 17:24:43 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:24:43 user nova-compute[75745]:     </disk>
Dec 01 17:24:43 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:24:43 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:24:43 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk"/>
Dec 01 17:24:43 user nova-compute[75745]:       <target dev="vdb" bus="virtio"/>
Dec 01 17:24:43 user nova-compute[75745]:     </disk>
Dec 01 17:24:43 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:24:43 user nova-compute[75745]:       <mac address="fa:16:3e:f0:97:04"/>
Dec 01 17:24:43 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:24:43 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:24:43 user nova-compute[75745]:       <target dev="tapd4c74908-1b"/>
Dec 01 17:24:43 user nova-compute[75745]:     </interface>
Dec 01 17:24:43 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:24:43 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/console.log" append="off"/>
Dec 01 17:24:43 user nova-compute[75745]:     </serial>
Dec 01 17:24:43 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:24:43 user nova-compute[75745]:     <video>
Dec 01 17:24:43 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:24:43 user nova-compute[75745]:     </video>
Dec 01 17:24:43 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:24:43 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:24:43 user nova-compute[75745]:     </rng>
Dec 01 17:24:43 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:24:43 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:24:43 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:24:43 user nova-compute[75745]:     </memballoon>
Dec 01 17:24:43 user nova-compute[75745]:   </devices>
Dec 01 17:24:43 user nova-compute[75745]: </domain>
Dec 01 17:24:43 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:24:43 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Instance destroyed successfully.
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.compute.manager [req-87607b2e-e6b9-49ea-b280-7a2feb252680 req-ba9874f8-7da1-45a0-85f2-87794320692e service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Received event network-vif-unplugged-d4c74908-1bd2-4891-b4d7-932d73d78217 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-87607b2e-e6b9-49ea-b280-7a2feb252680 req-ba9874f8-7da1-45a0-85f2-87794320692e service nova] Acquiring lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-87607b2e-e6b9-49ea-b280-7a2feb252680 req-ba9874f8-7da1-45a0-85f2-87794320692e service nova] Lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-87607b2e-e6b9-49ea-b280-7a2feb252680 req-ba9874f8-7da1-45a0-85f2-87794320692e service nova] Lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.compute.manager [req-87607b2e-e6b9-49ea-b280-7a2feb252680 req-ba9874f8-7da1-45a0-85f2-87794320692e service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] No waiting events found dispatching network-vif-unplugged-d4c74908-1bd2-4891-b4d7-932d73d78217 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:24:43 user nova-compute[75745]: WARNING nova.compute.manager [req-87607b2e-e6b9-49ea-b280-7a2feb252680 req-ba9874f8-7da1-45a0-85f2-87794320692e service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Received unexpected event network-vif-unplugged-d4c74908-1bd2-4891-b4d7-932d73d78217 for instance with vm_state active and task_state rescuing.
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.compute.manager [req-87607b2e-e6b9-49ea-b280-7a2feb252680 req-ba9874f8-7da1-45a0-85f2-87794320692e service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Received event network-vif-plugged-d4c74908-1bd2-4891-b4d7-932d73d78217 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-87607b2e-e6b9-49ea-b280-7a2feb252680 req-ba9874f8-7da1-45a0-85f2-87794320692e service nova] Acquiring lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-87607b2e-e6b9-49ea-b280-7a2feb252680 req-ba9874f8-7da1-45a0-85f2-87794320692e service nova] Lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-87607b2e-e6b9-49ea-b280-7a2feb252680 req-ba9874f8-7da1-45a0-85f2-87794320692e service nova] Lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.compute.manager [req-87607b2e-e6b9-49ea-b280-7a2feb252680 req-ba9874f8-7da1-45a0-85f2-87794320692e service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] No waiting events found dispatching network-vif-plugged-d4c74908-1bd2-4891-b4d7-932d73d78217 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:24:43 user nova-compute[75745]: WARNING nova.compute.manager [req-87607b2e-e6b9-49ea-b280-7a2feb252680 req-ba9874f8-7da1-45a0-85f2-87794320692e service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Received unexpected event network-vif-plugged-d4c74908-1bd2-4891-b4d7-932d73d78217 for instance with vm_state active and task_state rescuing.
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:24:43 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] No VIF found with MAC fa:16:3e:f0:97:04, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:24:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:45 user nova-compute[75745]: DEBUG nova.compute.manager [req-5d5e1d63-57f0-4b75-999a-eee0b4197886 req-5753525b-227e-4b38-8765-6beb3c4a3a63 service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Received event network-vif-plugged-d4c74908-1bd2-4891-b4d7-932d73d78217 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:24:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5d5e1d63-57f0-4b75-999a-eee0b4197886 req-5753525b-227e-4b38-8765-6beb3c4a3a63 service nova] Acquiring lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:24:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5d5e1d63-57f0-4b75-999a-eee0b4197886 req-5753525b-227e-4b38-8765-6beb3c4a3a63 service nova] Lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:24:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5d5e1d63-57f0-4b75-999a-eee0b4197886 req-5753525b-227e-4b38-8765-6beb3c4a3a63 service nova] Lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:24:45 user nova-compute[75745]: DEBUG nova.compute.manager [req-5d5e1d63-57f0-4b75-999a-eee0b4197886 req-5753525b-227e-4b38-8765-6beb3c4a3a63 service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] No waiting events found dispatching network-vif-plugged-d4c74908-1bd2-4891-b4d7-932d73d78217 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:24:45 user nova-compute[75745]: WARNING nova.compute.manager [req-5d5e1d63-57f0-4b75-999a-eee0b4197886 req-5753525b-227e-4b38-8765-6beb3c4a3a63 service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Received unexpected event network-vif-plugged-d4c74908-1bd2-4891-b4d7-932d73d78217 for instance with vm_state active and task_state rescuing.
Dec 01 17:24:47 user nova-compute[75745]: DEBUG nova.compute.manager [None req-fb46bf83-3dd8-4885-b69f-2e30e6d99596 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:24:47 user nova-compute[75745]: DEBUG nova.compute.manager [req-2afe1487-d486-4964-a19c-24032fc2341f req-23d63560-82ac-4127-8658-74588309db5b service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Received event network-vif-plugged-d4c74908-1bd2-4891-b4d7-932d73d78217 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:24:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2afe1487-d486-4964-a19c-24032fc2341f req-23d63560-82ac-4127-8658-74588309db5b service nova] Acquiring lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:24:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2afe1487-d486-4964-a19c-24032fc2341f req-23d63560-82ac-4127-8658-74588309db5b service nova] Lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:24:47 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2afe1487-d486-4964-a19c-24032fc2341f req-23d63560-82ac-4127-8658-74588309db5b service nova] Lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:24:47 user nova-compute[75745]: DEBUG nova.compute.manager [req-2afe1487-d486-4964-a19c-24032fc2341f req-23d63560-82ac-4127-8658-74588309db5b service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] No waiting events found dispatching network-vif-plugged-d4c74908-1bd2-4891-b4d7-932d73d78217 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:24:47 user nova-compute[75745]: WARNING nova.compute.manager [req-2afe1487-d486-4964-a19c-24032fc2341f req-23d63560-82ac-4127-8658-74588309db5b service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Received unexpected event network-vif-plugged-d4c74908-1bd2-4891-b4d7-932d73d78217 for instance with vm_state rescued and task_state None.
Dec 01 17:24:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:50 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Starting finish_migration {{(pid=75745) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11668}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Instance directory exists: not creating {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Dec 01 17:24:52 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Creating image(s)
Dec 01 17:24:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Did not create local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Ensure instance console log exists: /opt/stack/data/nova/instances/2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Start _get_guest_xml network_info=[{"id": "eeff2c22-349b-42cf-9290-6efccc7686d6", "address": "fa:16:3e:67:06:2e", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1884243825-network", "vif_mac": "fa:16:3e:67:06:2e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeff2c22-34", "ovs_interfaceid": "eeff2c22-349b-42cf-9290-6efccc7686d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': '6eec7007-e17f-4242-9942-09ce7b290529', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DeWhlKJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13', 'attached_at': '2023-12-01T17:24:52.000000', 'detached_at': '', 'volume_id': '0457077a-1184-47fe-a03d-ceedda41d0df', 'serial': '0457077a-1184-47fe-a03d-ceedda41d0df'}, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:24:52 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:24:52 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:24:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DeWhlKJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:24:52 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:24:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:24:52 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:24:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:24:52 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ac1631-88b7-4d9e-88d4-2f19d9d0968f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:24:52 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d831bb7-f6d3-4b8a-a349-c340e0f5fdce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df] added
Dec 01 17:24:52 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[28255e46-8ee5-44f8-b905-48f0c6631830]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1f01a0-8521-45f6-aea3-f05ceecc1639]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DeWhlKJB {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DeWhlKJB" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[47458dbd-adf7-44eb-abfe-cccc82ae2479]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DeWhlKJB'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bed7223-fd68-469c-a5ad-4fc4e87af49b]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1159afb-76ae-4834-8fd0-8cb9361a8dd7]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:24:52 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:24:52 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:24:52 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:24:52 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bd2429-4ff7-4afe-a94a-ce0fe88bdb74]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df, portal: 172.16.0.220,3260]
Dec 01 17:24:52 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df, portal: 172.16.0.220,3260] successful.
Dec 01 17:24:52 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80b8a99-1e9c-4dcd-9da3-96deb782fb9e]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ec6722-c768-4199-81f0-6246e5eb6914]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:24:52 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:24:52 user nova-compute[75745]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:24:52 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:24:52 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:24:52 user nova-compute[75745]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:24:52 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77e062e-6597-44af-a18c-9c95da5e6732]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: None {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:24:52 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:24:53 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:24:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DeWhlKJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:24:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:24:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26365393231383963', 'path': '/dev/sdd'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:24:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365393231383963', 'path': '/dev/sdd'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:24:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:22:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1848665207',display_name='tempest-ServerActionsTestOtherA-server-1848665207',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1848665207',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEe39hBsqXh7qTHbR/1n4TCThkWTxdl0f3mcj7VutursSM+B5AqiMiKGVg5IqL9MYbDfyNfGcyjgOxxpAU4qczogEswNK8dvSit+JyFqtuJxlzPiy3ZkcIr+yzYcqZB0A==',key_name='tempest-keypair-3711887',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:23:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='409356993ea442c5abdf4269aebe43ab',ramdisk_id='',reservation_id='r-0dzhv7we',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1500186869',owner_user_name='tempest-ServerActionsTestOtherA-1500186869-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:24:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5204ecaa9b354d10bac514c27acbccc6',uuid=2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eeff2c22-349b-42cf-9290-6efccc7686d6", "address": "fa:16:3e:67:06:2e", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1884243825-network", "vif_mac": "fa:16:3e:67:06:2e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeff2c22-34", "ovs_interfaceid": "eeff2c22-349b-42cf-9290-6efccc7686d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:24:53 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Converting VIF {"id": "eeff2c22-349b-42cf-9290-6efccc7686d6", "address": "fa:16:3e:67:06:2e", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1884243825-network", "vif_mac": "fa:16:3e:67:06:2e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeff2c22-34", "ovs_interfaceid": "eeff2c22-349b-42cf-9290-6efccc7686d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:24:53 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:06:2e,bridge_name='br-int',has_traffic_filtering=True,id=eeff2c22-349b-42cf-9290-6efccc7686d6,network=Network(f7cefc9d-2279-4601-8a81-a640ad1aea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeff2c22-34') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:24:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:24:53 user nova-compute[75745]:   <uuid>2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13</uuid>
Dec 01 17:24:53 user nova-compute[75745]:   <name>instance-00000022</name>
Dec 01 17:24:53 user nova-compute[75745]:   <memory>2097152</memory>
Dec 01 17:24:53 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:24:53 user nova-compute[75745]:   <metadata>
Dec 01 17:24:53 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:24:53 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:24:53 user nova-compute[75745]:       <nova:name>tempest-ServerActionsTestOtherA-server-1848665207</nova:name>
Dec 01 17:24:53 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:24:52</nova:creationTime>
Dec 01 17:24:53 user nova-compute[75745]:       <nova:flavor name="m1.small">
Dec 01 17:24:53 user nova-compute[75745]:         <nova:memory>2048</nova:memory>
Dec 01 17:24:53 user nova-compute[75745]:         <nova:disk>20</nova:disk>
Dec 01 17:24:53 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:24:53 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:24:53 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:24:53 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:24:53 user nova-compute[75745]:       <nova:owner>
Dec 01 17:24:53 user nova-compute[75745]:         <nova:user uuid="5204ecaa9b354d10bac514c27acbccc6">tempest-ServerActionsTestOtherA-1500186869-project-member</nova:user>
Dec 01 17:24:53 user nova-compute[75745]:         <nova:project uuid="409356993ea442c5abdf4269aebe43ab">tempest-ServerActionsTestOtherA-1500186869</nova:project>
Dec 01 17:24:53 user nova-compute[75745]:       </nova:owner>
Dec 01 17:24:53 user nova-compute[75745]:       <nova:ports>
Dec 01 17:24:53 user nova-compute[75745]:         <nova:port uuid="eeff2c22-349b-42cf-9290-6efccc7686d6">
Dec 01 17:24:53 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 01 17:24:53 user nova-compute[75745]:         </nova:port>
Dec 01 17:24:53 user nova-compute[75745]:       </nova:ports>
Dec 01 17:24:53 user nova-compute[75745]:     </nova:instance>
Dec 01 17:24:53 user nova-compute[75745]:   </metadata>
Dec 01 17:24:53 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:24:53 user nova-compute[75745]:     <system>
Dec 01 17:24:53 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:24:53 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:24:53 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:24:53 user nova-compute[75745]:       <entry name="serial">2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13</entry>
Dec 01 17:24:53 user nova-compute[75745]:       <entry name="uuid">2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13</entry>
Dec 01 17:24:53 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:24:53 user nova-compute[75745]:     </system>
Dec 01 17:24:53 user nova-compute[75745]:   </sysinfo>
Dec 01 17:24:53 user nova-compute[75745]:   <os>
Dec 01 17:24:53 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:24:53 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:24:53 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:24:53 user nova-compute[75745]:   </os>
Dec 01 17:24:53 user nova-compute[75745]:   <features>
Dec 01 17:24:53 user nova-compute[75745]:     <acpi/>
Dec 01 17:24:53 user nova-compute[75745]:     <apic/>
Dec 01 17:24:53 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:24:53 user nova-compute[75745]:   </features>
Dec 01 17:24:53 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:24:53 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:24:53 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:24:53 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:24:53 user nova-compute[75745]:   </clock>
Dec 01 17:24:53 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:24:53 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:24:53 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:24:53 user nova-compute[75745]:   </cpu>
Dec 01 17:24:53 user nova-compute[75745]:   <devices>
Dec 01 17:24:53 user nova-compute[75745]:     <disk type="block" device="disk">
Dec 01 17:24:53 user nova-compute[75745]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:24:53 user nova-compute[75745]:       <source dev="/dev/sdd"/>
Dec 01 17:24:53 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:24:53 user nova-compute[75745]:       <serial>0457077a-1184-47fe-a03d-ceedda41d0df</serial>
Dec 01 17:24:53 user nova-compute[75745]:     </disk>
Dec 01 17:24:53 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:24:53 user nova-compute[75745]:       <mac address="fa:16:3e:67:06:2e"/>
Dec 01 17:24:53 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:24:53 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:24:53 user nova-compute[75745]:       <target dev="tapeeff2c22-34"/>
Dec 01 17:24:53 user nova-compute[75745]:     </interface>
Dec 01 17:24:53 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:24:53 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13/console.log" append="off"/>
Dec 01 17:24:53 user nova-compute[75745]:     </serial>
Dec 01 17:24:53 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:24:53 user nova-compute[75745]:     <video>
Dec 01 17:24:53 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:24:53 user nova-compute[75745]:     </video>
Dec 01 17:24:53 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:24:53 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:24:53 user nova-compute[75745]:     </rng>
Dec 01 17:24:53 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:24:53 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:24:53 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:24:53 user nova-compute[75745]:     </memballoon>
Dec 01 17:24:53 user nova-compute[75745]:   </devices>
Dec 01 17:24:53 user nova-compute[75745]: </domain>
Dec 01 17:24:53 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:24:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:22:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1848665207',display_name='tempest-ServerActionsTestOtherA-server-1848665207',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1848665207',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEe39hBsqXh7qTHbR/1n4TCThkWTxdl0f3mcj7VutursSM+B5AqiMiKGVg5IqL9MYbDfyNfGcyjgOxxpAU4qczogEswNK8dvSit+JyFqtuJxlzPiy3ZkcIr+yzYcqZB0A==',key_name='tempest-keypair-3711887',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:23:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='409356993ea442c5abdf4269aebe43ab',ramdisk_id='',reservation_id='r-0dzhv7we',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1500186869',owner_user_name='tempest-ServerActionsTestOtherA-1500186869-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:24:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5204ecaa9b354d10bac514c27acbccc6',uuid=2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eeff2c22-349b-42cf-9290-6efccc7686d6", "address": "fa:16:3e:67:06:2e", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1884243825-network", "vif_mac": "fa:16:3e:67:06:2e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeff2c22-34", "ovs_interfaceid": "eeff2c22-349b-42cf-9290-6efccc7686d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:24:53 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Converting VIF {"id": "eeff2c22-349b-42cf-9290-6efccc7686d6", "address": "fa:16:3e:67:06:2e", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1884243825-network", "vif_mac": "fa:16:3e:67:06:2e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeff2c22-34", "ovs_interfaceid": "eeff2c22-349b-42cf-9290-6efccc7686d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:24:53 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:06:2e,bridge_name='br-int',has_traffic_filtering=True,id=eeff2c22-349b-42cf-9290-6efccc7686d6,network=Network(f7cefc9d-2279-4601-8a81-a640ad1aea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeff2c22-34') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:24:53 user nova-compute[75745]: DEBUG os_vif [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:06:2e,bridge_name='br-int',has_traffic_filtering=True,id=eeff2c22-349b-42cf-9290-6efccc7686d6,network=Network(f7cefc9d-2279-4601-8a81-a640ad1aea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeff2c22-34') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:24:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:24:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:24:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '851172fb-a582-520d-9dde-7fa5759092f4', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:24:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:24:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeeff2c22-34, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:24:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeeff2c22-34, col_values=(('qos', UUID('4d207d5c-1f48-4ff9-8081-aa7fa472a38d')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:24:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeeff2c22-34, col_values=(('external_ids', {'iface-id': 'eeff2c22-349b-42cf-9290-6efccc7686d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:06:2e', 'vm-uuid': '2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:24:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:24:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:53 user nova-compute[75745]: INFO os_vif [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:06:2e,bridge_name='br-int',has_traffic_filtering=True,id=eeff2c22-349b-42cf-9290-6efccc7686d6,network=Network(f7cefc9d-2279-4601-8a81-a640ad1aea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeff2c22-34')
Dec 01 17:24:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:24:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] No VIF found with MAC fa:16:3e:67:06:2e, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:24:53 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:24:53 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:24:53 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:24:53 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:24:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:24:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:24:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:24:53 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:24:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:55 user nova-compute[75745]: DEBUG nova.compute.manager [req-946f1f1c-0fc8-4264-9056-cdacc5d399b4 req-e2def228-c922-4b79-8d61-8a93230586d0 service nova] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Received event network-vif-plugged-eeff2c22-349b-42cf-9290-6efccc7686d6 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:24:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-946f1f1c-0fc8-4264-9056-cdacc5d399b4 req-e2def228-c922-4b79-8d61-8a93230586d0 service nova] Acquiring lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:24:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-946f1f1c-0fc8-4264-9056-cdacc5d399b4 req-e2def228-c922-4b79-8d61-8a93230586d0 service nova] Lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:24:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-946f1f1c-0fc8-4264-9056-cdacc5d399b4 req-e2def228-c922-4b79-8d61-8a93230586d0 service nova] Lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:24:55 user nova-compute[75745]: DEBUG nova.compute.manager [req-946f1f1c-0fc8-4264-9056-cdacc5d399b4 req-e2def228-c922-4b79-8d61-8a93230586d0 service nova] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] No waiting events found dispatching network-vif-plugged-eeff2c22-349b-42cf-9290-6efccc7686d6 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:24:55 user nova-compute[75745]: WARNING nova.compute.manager [req-946f1f1c-0fc8-4264-9056-cdacc5d399b4 req-e2def228-c922-4b79-8d61-8a93230586d0 service nova] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Received unexpected event network-vif-plugged-eeff2c22-349b-42cf-9290-6efccc7686d6 for instance with vm_state active and task_state resize_finish.
Dec 01 17:24:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk.rescue --force-share --output=json" returned: 0 in 0.299s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:24:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:57 user nova-compute[75745]: DEBUG nova.compute.manager [req-04c13221-ed78-4ffc-a57a-6f342361a288 req-f7548880-d16f-4de9-8c80-07d628388492 service nova] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Received event network-vif-plugged-eeff2c22-349b-42cf-9290-6efccc7686d6 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:24:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-04c13221-ed78-4ffc-a57a-6f342361a288 req-f7548880-d16f-4de9-8c80-07d628388492 service nova] Acquiring lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:24:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-04c13221-ed78-4ffc-a57a-6f342361a288 req-f7548880-d16f-4de9-8c80-07d628388492 service nova] Lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:24:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-04c13221-ed78-4ffc-a57a-6f342361a288 req-f7548880-d16f-4de9-8c80-07d628388492 service nova] Lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:24:57 user nova-compute[75745]: DEBUG nova.compute.manager [req-04c13221-ed78-4ffc-a57a-6f342361a288 req-f7548880-d16f-4de9-8c80-07d628388492 service nova] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] No waiting events found dispatching network-vif-plugged-eeff2c22-349b-42cf-9290-6efccc7686d6 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:24:57 user nova-compute[75745]: WARNING nova.compute.manager [req-04c13221-ed78-4ffc-a57a-6f342361a288 req-f7548880-d16f-4de9-8c80-07d628388492 service nova] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Received unexpected event network-vif-plugged-eeff2c22-349b-42cf-9290-6efccc7686d6 for instance with vm_state active and task_state resize_finish.
Dec 01 17:24:57 user nova-compute[75745]: DEBUG nova.compute.manager [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:24:57 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Instance running successfully.
Dec 01 17:24:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Failed to set time: agent not configured {{(pid=75745) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Dec 01 17:24:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a9c753c2-cac8-4828-bd5e-7529680c5b1b tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] finish_migration finished successfully. {{(pid=75745) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11763}}
Dec 01 17:24:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:24:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f614f2-6b6c-4841-8a67-6231a33bd98e/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f614f2-6b6c-4841-8a67-6231a33bd98e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f614f2-6b6c-4841-8a67-6231a33bd98e/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f614f2-6b6c-4841-8a67-6231a33bd98e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:58 user nova-compute[75745]: INFO nova.compute.manager [None req-50b9a3f2-86ca-4864-8a9c-79fdce531381 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Unrescuing
Dec 01 17:24:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-50b9a3f2-86ca-4864-8a9c-79fdce531381 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "refresh_cache-5aee52eb-78e3-4f60-a920-7ade912735e8" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:24:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-50b9a3f2-86ca-4864-8a9c-79fdce531381 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquired lock "refresh_cache-5aee52eb-78e3-4f60-a920-7ade912735e8" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:24:58 user nova-compute[75745]: DEBUG nova.network.neutron [None req-50b9a3f2-86ca-4864-8a9c-79fdce531381 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:24:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:24:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aee52eb-78e3-4f60-a920-7ade912735e8/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aee52eb-78e3-4f60-a920-7ade912735e8/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aee52eb-78e3-4f60-a920-7ade912735e8/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:24:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aee52eb-78e3-4f60-a920-7ade912735e8/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:24:59 user nova-compute[75745]: DEBUG nova.network.neutron [None req-50b9a3f2-86ca-4864-8a9c-79fdce531381 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Updating instance_info_cache with network_info: [{"id": "7c69901c-a94e-47f8-8a4a-1654ed728b83", "address": "fa:16:3e:2e:86:ec", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c69901c-a9", "ovs_interfaceid": "7c69901c-a94e-47f8-8a4a-1654ed728b83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:24:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-50b9a3f2-86ca-4864-8a9c-79fdce531381 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Releasing lock "refresh_cache-5aee52eb-78e3-4f60-a920-7ade912735e8" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:24:59 user nova-compute[75745]: DEBUG nova.objects.instance [None req-50b9a3f2-86ca-4864-8a9c-79fdce531381 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lazy-loading 'flavor' on Instance uuid 5aee52eb-78e3-4f60-a920-7ade912735e8 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:24:59 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:24:59 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:24:59 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=7860MB free_disk=25.11353302001953GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:24:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:24:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:24:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:59 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Applying migration context for instance 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13 as it has an incoming, in-progress migration 320e3003-0dff-4f3d-9818-43eea6fdff82. Migration status is finished {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Dec 01 17:24:59 user nova-compute[75745]: INFO nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Updating resource usage from migration 320e3003-0dff-4f3d-9818-43eea6fdff82
Dec 01 17:24:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:24:59 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance d997cdd6-67c6-4263-814a-17cf9e27bbeb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:24:59 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance e4ffb96e-456c-4fb9-9850-9e98310d63e5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:24:59 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 80962f79-dbb2-4380-b2c8-791642cfa86b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:24:59 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 5e631ac3-8122-46a3-a54f-2395c0f7cf7c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:24:59 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 5aee52eb-78e3-4f60-a920-7ade912735e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:24:59 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance c358f18c-44c4-45d4-a1eb-4f259c36a0d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:24:59 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance b26b6ef1-7a8b-4628-8cc1-d27cc27efcac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:24:59 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance a4f614f2-6b6c-4841-8a67-6231a33bd98e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:24:59 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Migration 320e3003-0dff-4f3d-9818-43eea6fdff82 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Dec 01 17:24:59 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:24:59 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:24:59 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:25:00 user nova-compute[75745]: DEBUG nova.compute.manager [req-50aa2f8f-427b-41f6-a859-c382d25d67d0 req-0836b15e-2a52-4112-99ab-276ddaadf933 service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Received event network-vif-unplugged-7c69901c-a94e-47f8-8a4a-1654ed728b83 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:25:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-50aa2f8f-427b-41f6-a859-c382d25d67d0 req-0836b15e-2a52-4112-99ab-276ddaadf933 service nova] Acquiring lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:25:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-50aa2f8f-427b-41f6-a859-c382d25d67d0 req-0836b15e-2a52-4112-99ab-276ddaadf933 service nova] Lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:25:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-50aa2f8f-427b-41f6-a859-c382d25d67d0 req-0836b15e-2a52-4112-99ab-276ddaadf933 service nova] Lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:25:00 user nova-compute[75745]: DEBUG nova.compute.manager [req-50aa2f8f-427b-41f6-a859-c382d25d67d0 req-0836b15e-2a52-4112-99ab-276ddaadf933 service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] No waiting events found dispatching network-vif-unplugged-7c69901c-a94e-47f8-8a4a-1654ed728b83 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:25:00 user nova-compute[75745]: WARNING nova.compute.manager [req-50aa2f8f-427b-41f6-a859-c382d25d67d0 req-0836b15e-2a52-4112-99ab-276ddaadf933 service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Received unexpected event network-vif-unplugged-7c69901c-a94e-47f8-8a4a-1654ed728b83 for instance with vm_state rescued and task_state unrescuing.
Dec 01 17:25:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:25:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:25:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:25:00 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:25:00 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:25:00 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:25:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.661s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:25:00 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Instance destroyed successfully.
Dec 01 17:25:01 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:25:01 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:25:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:25:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:25:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:25:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:25:02 user nova-compute[75745]: DEBUG nova.compute.manager [req-e4f9cbec-b6f3-4bcd-a338-4641e885dd55 req-b16dcf70-c2cc-43bb-acc1-0ba5ae87f19c service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Received event network-vif-plugged-7c69901c-a94e-47f8-8a4a-1654ed728b83 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:25:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e4f9cbec-b6f3-4bcd-a338-4641e885dd55 req-b16dcf70-c2cc-43bb-acc1-0ba5ae87f19c service nova] Acquiring lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:25:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e4f9cbec-b6f3-4bcd-a338-4641e885dd55 req-b16dcf70-c2cc-43bb-acc1-0ba5ae87f19c service nova] Lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:25:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e4f9cbec-b6f3-4bcd-a338-4641e885dd55 req-b16dcf70-c2cc-43bb-acc1-0ba5ae87f19c service nova] Lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:25:02 user nova-compute[75745]: DEBUG nova.compute.manager [req-e4f9cbec-b6f3-4bcd-a338-4641e885dd55 req-b16dcf70-c2cc-43bb-acc1-0ba5ae87f19c service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] No waiting events found dispatching network-vif-plugged-7c69901c-a94e-47f8-8a4a-1654ed728b83 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:25:02 user nova-compute[75745]: WARNING nova.compute.manager [req-e4f9cbec-b6f3-4bcd-a338-4641e885dd55 req-b16dcf70-c2cc-43bb-acc1-0ba5ae87f19c service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Received unexpected event network-vif-plugged-7c69901c-a94e-47f8-8a4a-1654ed728b83 for instance with vm_state rescued and task_state unrescuing.
Dec 01 17:25:02 user nova-compute[75745]: DEBUG nova.compute.manager [req-e4f9cbec-b6f3-4bcd-a338-4641e885dd55 req-b16dcf70-c2cc-43bb-acc1-0ba5ae87f19c service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Received event network-vif-plugged-7c69901c-a94e-47f8-8a4a-1654ed728b83 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:25:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e4f9cbec-b6f3-4bcd-a338-4641e885dd55 req-b16dcf70-c2cc-43bb-acc1-0ba5ae87f19c service nova] Acquiring lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:25:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e4f9cbec-b6f3-4bcd-a338-4641e885dd55 req-b16dcf70-c2cc-43bb-acc1-0ba5ae87f19c service nova] Lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:25:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e4f9cbec-b6f3-4bcd-a338-4641e885dd55 req-b16dcf70-c2cc-43bb-acc1-0ba5ae87f19c service nova] Lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:25:02 user nova-compute[75745]: DEBUG nova.compute.manager [req-e4f9cbec-b6f3-4bcd-a338-4641e885dd55 req-b16dcf70-c2cc-43bb-acc1-0ba5ae87f19c service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] No waiting events found dispatching network-vif-plugged-7c69901c-a94e-47f8-8a4a-1654ed728b83 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:25:02 user nova-compute[75745]: WARNING nova.compute.manager [req-e4f9cbec-b6f3-4bcd-a338-4641e885dd55 req-b16dcf70-c2cc-43bb-acc1-0ba5ae87f19c service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Received unexpected event network-vif-plugged-7c69901c-a94e-47f8-8a4a-1654ed728b83 for instance with vm_state rescued and task_state unrescuing.
Dec 01 17:25:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:25:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:25:03 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:25:03 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:25:03 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:25:03 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Rebuilding the list of instances to heal {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 17:25:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-d997cdd6-67c6-4263-814a-17cf9e27bbeb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:25:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-d997cdd6-67c6-4263-814a-17cf9e27bbeb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:25:03 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:25:03 user nova-compute[75745]: DEBUG nova.objects.instance [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lazy-loading 'info_cache' on Instance uuid d997cdd6-67c6-4263-814a-17cf9e27bbeb {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:25:04 user nova-compute[75745]: DEBUG nova.compute.manager [None req-50b9a3f2-86ca-4864-8a9c-79fdce531381 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:25:04 user nova-compute[75745]: DEBUG nova.compute.manager [req-00207c69-2551-4636-afaf-1ffbd6977106 req-0a707f9b-9417-4c68-accf-ea36a9c24352 service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Received event network-vif-plugged-7c69901c-a94e-47f8-8a4a-1654ed728b83 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:25:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-00207c69-2551-4636-afaf-1ffbd6977106 req-0a707f9b-9417-4c68-accf-ea36a9c24352 service nova] Acquiring lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:25:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-00207c69-2551-4636-afaf-1ffbd6977106 req-0a707f9b-9417-4c68-accf-ea36a9c24352 service nova] Lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:25:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-00207c69-2551-4636-afaf-1ffbd6977106 req-0a707f9b-9417-4c68-accf-ea36a9c24352 service nova] Lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:25:04 user nova-compute[75745]: DEBUG nova.compute.manager [req-00207c69-2551-4636-afaf-1ffbd6977106 req-0a707f9b-9417-4c68-accf-ea36a9c24352 service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] No waiting events found dispatching network-vif-plugged-7c69901c-a94e-47f8-8a4a-1654ed728b83 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:25:04 user nova-compute[75745]: WARNING nova.compute.manager [req-00207c69-2551-4636-afaf-1ffbd6977106 req-0a707f9b-9417-4c68-accf-ea36a9c24352 service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Received unexpected event network-vif-plugged-7c69901c-a94e-47f8-8a4a-1654ed728b83 for instance with vm_state active and task_state None.
Dec 01 17:25:04 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Updating instance_info_cache with network_info: [{"id": "9d64a643-0dca-4fe1-8734-9778689292bc", "address": "fa:16:3e:e2:0c:90", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d64a643-0d", "ovs_interfaceid": "9d64a643-0dca-4fe1-8734-9778689292bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:25:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-d997cdd6-67c6-4263-814a-17cf9e27bbeb" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:25:04 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:25:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:25:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:25:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:25:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:25:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:25:18 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:25:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:25:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:25:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:25:28 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:25:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:25:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:25:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:25:41 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:25:43 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:25:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:25:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:25:44 user nova-compute[75745]: DEBUG nova.objects.instance [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lazy-loading 'flavor' on Instance uuid b26b6ef1-7a8b-4628-8cc1-d27cc27efcac {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:25:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:25:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:25:45 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:25:45 user nova-compute[75745]: INFO nova.compute.manager [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Attaching volume 0034af46-f9e8-4df6-a432-b9409f910476 to /dev/vdb
Dec 01 17:25:45 user nova-compute[75745]: DEBUG os_brick.utils [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:25:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:25:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:25:45 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5028604-06d7-41af-b50f-01a90c4bd452]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:25:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:25:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:25:45 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9e9ca7-5c47-4186-ba34-8c945379a273]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:25:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:25:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:25:45 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3fc163-0cb1-4bf9-bfbd-f5378f7b6168]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:25:45 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0d0b96-6f1a-4df2-9975-262a53b169a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:25:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:25:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:25:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:25:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:25:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:25:45 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:25:45 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff0a700-f6da-4211-89cc-a61f0351a25a]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:25:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:25:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:25:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:25:45 user nova-compute[75745]: DEBUG os_brick.utils [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:25:45 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Updating existing volume attachment record: 870c6c90-fb88-4f7b-8732-db92cd7f0278 {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:25:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:25:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:25:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:25:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:25:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:25:52 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:25:52 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:25:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:25:53 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:25:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:25:54 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNALjSUi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:25:55 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:25:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:25:55 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:25:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:25:55 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce93777-0330-474a-b09f-1f50e5287c57]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:25:55 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b4acb1-3c87-44aa-85e7-39fb38229888]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476] added
Dec 01 17:25:55 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca72c68e-8912-4c14-bcef-825ff97e3a90]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e337a84e-5c4b-4dba-ad5f-2bf7f4664d93]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hNALjSUi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hNALjSUi" returned: 0 in 0.026s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3a2ab8-82cb-4f83-9abd-d5a44ce912f2]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hNALjSUi'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8f0b17-657a-490b-9a3c-3a4b6d3ef257]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8c0bc6-8883-43c6-9c2a-a7bd9eacccd2]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:25:55 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:25:55 user nova-compute[75745]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:25:55 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:25:55 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:25:55 user nova-compute[75745]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:25:55 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a0d841-efe3-41b9-b45a-dd02399e154c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476, portal: 172.16.0.220,3260]
Dec 01 17:25:55 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476, portal: 172.16.0.220,3260] successful.
Dec 01 17:25:55 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6977dd59-def0-410f-9857-63f9c378dcfd]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb7286c-a5df-462e-99b8-bf257e64d331]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:25:55 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:25:55 user nova-compute[75745]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:25:55 user nova-compute[75745]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 (non-flash)
Dec 01 17:25:55 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:25:55 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:25:55 user nova-compute[75745]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:25:55 user nova-compute[75745]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 (non-flash)
Dec 01 17:25:55 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a0a075-d8e6-4e2d-b9d5-26f13f057282]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNALjSUi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:25:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:25:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:25:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:25:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:25:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:25:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:25:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:25:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '26664316464326365', 'path': '/dev/sde'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:25:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664316464326365', 'path': '/dev/sde'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:25:56 user nova-compute[75745]: DEBUG nova.objects.instance [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lazy-loading 'flavor' on Instance uuid b26b6ef1-7a8b-4628-8cc1-d27cc27efcac {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:25:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 17:25:56 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:25:56 user nova-compute[75745]:   <source dev="/dev/sde"/>
Dec 01 17:25:56 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:25:56 user nova-compute[75745]:   <serial>0034af46-f9e8-4df6-a432-b9409f910476</serial>
Dec 01 17:25:56 user nova-compute[75745]: </disk>
Dec 01 17:25:56 user nova-compute[75745]:  {{(pid=75745) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 17:25:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:25:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:25:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:25:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:25:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:25:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:25:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] No VIF found with MAC fa:16:3e:71:7f:4a, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:25:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:25:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:25:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e938f835-ddd3-406c-9c2b-6392defe8379 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.030s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:25:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:25:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:25:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:25:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:25:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:25:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:25:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:25:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:25:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:25:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:25:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:25:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:25:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:25:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Acquiring lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:25:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:25:58 user nova-compute[75745]: DEBUG nova.compute.manager [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:25:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:25:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:25:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:25:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:25:58 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:25:58 user nova-compute[75745]: INFO nova.compute.claims [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Claim successful on node user
Dec 01 17:25:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:25:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f614f2-6b6c-4841-8a67-6231a33bd98e/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:25:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:25:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f614f2-6b6c-4841-8a67-6231a33bd98e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:25:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f614f2-6b6c-4841-8a67-6231a33bd98e/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:25:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4f614f2-6b6c-4841-8a67-6231a33bd98e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:25:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:25:59 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:25:59 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:25:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.818s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:25:59 user nova-compute[75745]: DEBUG nova.compute.manager [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:25:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:25:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:25:59 user nova-compute[75745]: DEBUG nova.compute.manager [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:25:59 user nova-compute[75745]: DEBUG nova.network.neutron [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:25:59 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:25:59 user nova-compute[75745]: DEBUG nova.compute.manager [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:25:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:25:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:25:59 user nova-compute[75745]: DEBUG nova.compute.manager [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:25:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:25:59 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Creating image(s)
Dec 01 17:25:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ff5eaad-45ab-4a21-bc9b-9ecef436cab0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:25:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "/opt/stack/data/nova/instances/9ff5eaad-45ab-4a21-bc9b-9ecef436cab0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:25:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "/opt/stack/data/nova/instances/9ff5eaad-45ab-4a21-bc9b-9ecef436cab0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:25:59 user nova-compute[75745]: DEBUG nova.policy [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9787e4d7695a4187812090fcaf302a98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3244f1ca511a4c28809d26a694c45ee1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:25:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:25:59 user nova-compute[75745]: DEBUG nova.compute.manager [req-92d72df1-cb22-4649-a801-c9a9c5ad2066 req-85b0606b-2792-4cd8-b66f-0fcb2d8dd3d4 service nova] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Received event network-changed-b0b6e35c-be93-4ac7-a7ca-2bf50af82eff {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:25:59 user nova-compute[75745]: DEBUG nova.compute.manager [req-92d72df1-cb22-4649-a801-c9a9c5ad2066 req-85b0606b-2792-4cd8-b66f-0fcb2d8dd3d4 service nova] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Refreshing instance network info cache due to event network-changed-b0b6e35c-be93-4ac7-a7ca-2bf50af82eff. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:25:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-92d72df1-cb22-4649-a801-c9a9c5ad2066 req-85b0606b-2792-4cd8-b66f-0fcb2d8dd3d4 service nova] Acquiring lock "refresh_cache-a4f614f2-6b6c-4841-8a67-6231a33bd98e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:25:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-92d72df1-cb22-4649-a801-c9a9c5ad2066 req-85b0606b-2792-4cd8-b66f-0fcb2d8dd3d4 service nova] Acquired lock "refresh_cache-a4f614f2-6b6c-4841-8a67-6231a33bd98e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:25:59 user nova-compute[75745]: DEBUG nova.network.neutron [req-92d72df1-cb22-4649-a801-c9a9c5ad2066 req-85b0606b-2792-4cd8-b66f-0fcb2d8dd3d4 service nova] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Refreshing network info cache for port b0b6e35c-be93-4ac7-a7ca-2bf50af82eff {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:25:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Acquiring lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:25:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:25:59 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:25:59 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:25:59 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=7907MB free_disk=25.102741241455078GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:25:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:25:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:25:59 user nova-compute[75745]: DEBUG nova.objects.instance [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lazy-loading 'flavor' on Instance uuid a4f614f2-6b6c-4841-8a67-6231a33bd98e {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:26:00 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Ignoring supplied device name: /dev/vdb
Dec 01 17:26:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.210s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Applying migration context for instance 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13 as it has an incoming, in-progress migration 320e3003-0dff-4f3d-9818-43eea6fdff82. Migration status is finished {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Dec 01 17:26:00 user nova-compute[75745]: INFO nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Updating resource usage from migration 320e3003-0dff-4f3d-9818-43eea6fdff82
Dec 01 17:26:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Acquiring lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:26:00 user nova-compute[75745]: INFO nova.compute.manager [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Attaching volume 61972f11-f33b-4d82-a4fc-308e6daab4af to /dev/vdb
Dec 01 17:26:00 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance d997cdd6-67c6-4263-814a-17cf9e27bbeb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance e4ffb96e-456c-4fb9-9850-9e98310d63e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 80962f79-dbb2-4380-b2c8-791642cfa86b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 5e631ac3-8122-46a3-a54f-2395c0f7cf7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 5aee52eb-78e3-4f60-a920-7ade912735e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance c358f18c-44c4-45d4-a1eb-4f259c36a0d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance b26b6ef1-7a8b-4628-8cc1-d27cc27efcac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance a4f614f2-6b6c-4841-8a67-6231a33bd98e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Migration 320e3003-0dff-4f3d-9818-43eea6fdff82 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG os_brick.utils [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.197s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/9ff5eaad-45ab-4a21-bc9b-9ecef436cab0/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acf953a-d21c-4515-b045-de34d9308c26]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/9ff5eaad-45ab-4a21-bc9b-9ecef436cab0/disk 1073741824" returned: 0 in 0.056s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e00f581-1ccf-45eb-a360-771e02ab7a34]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac684f85-209a-4d9f-a75f-0f7e7747ba2c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[962ae000-8399-442a-9249-1fe9249fd33b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:26:00 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:26:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1a7fc4-ce1f-4f38-b1d4-2fe2c5151b11]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG os_brick.utils [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] <== get_connector_properties: return (208ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Updating existing volume attachment record: 0baa2333-bfd3-49de-a810-22acae4d43a6 {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.190s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ff5eaad-45ab-4a21-bc9b-9ecef436cab0/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff5eaad-45ab-4a21-bc9b-9ecef436cab0/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG nova.network.neutron [req-92d72df1-cb22-4649-a801-c9a9c5ad2066 req-85b0606b-2792-4cd8-b66f-0fcb2d8dd3d4 service nova] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Updated VIF entry in instance network info cache for port b0b6e35c-be93-4ac7-a7ca-2bf50af82eff. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG nova.network.neutron [req-92d72df1-cb22-4649-a801-c9a9c5ad2066 req-85b0606b-2792-4cd8-b66f-0fcb2d8dd3d4 service nova] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Updating instance_info_cache with network_info: [{"id": "b0b6e35c-be93-4ac7-a7ca-2bf50af82eff", "address": "fa:16:3e:b8:34:57", "network": {"id": "ccf83dac-fecd-4f65-baf8-740ff63f51a0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-804694060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5ee303033640e7adebbc0c949be9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0b6e35c-be", "ovs_interfaceid": "b0b6e35c-be93-4ac7-a7ca-2bf50af82eff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-92d72df1-cb22-4649-a801-c9a9c5ad2066 req-85b0606b-2792-4cd8-b66f-0fcb2d8dd3d4 service nova] Releasing lock "refresh_cache-a4f614f2-6b6c-4841-8a67-6231a33bd98e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.778s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff5eaad-45ab-4a21-bc9b-9ecef436cab0/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Cannot resize image /opt/stack/data/nova/instances/9ff5eaad-45ab-4a21-bc9b-9ecef436cab0/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Ensure instance console log exists: /opt/stack/data/nova/instances/9ff5eaad-45ab-4a21-bc9b-9ecef436cab0/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:26:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:01 user nova-compute[75745]: DEBUG nova.network.neutron [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Successfully created port: 66185694-ac7f-4baa-9c61-6d19fd57ac5a {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:26:01 user nova-compute[75745]: DEBUG nova.network.neutron [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Successfully updated port: 66185694-ac7f-4baa-9c61-6d19fd57ac5a {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:26:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Acquiring lock "refresh_cache-9ff5eaad-45ab-4a21-bc9b-9ecef436cab0" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:26:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Acquired lock "refresh_cache-9ff5eaad-45ab-4a21-bc9b-9ecef436cab0" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:26:01 user nova-compute[75745]: DEBUG nova.network.neutron [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:26:01 user nova-compute[75745]: DEBUG nova.network.neutron [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:26:01 user nova-compute[75745]: DEBUG nova.compute.manager [req-36f5ac30-3dbd-4507-9c9c-d9f25c014db0 req-53e4ba4b-6835-4efb-bec3-31cc33796fd9 service nova] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Received event network-changed-66185694-ac7f-4baa-9c61-6d19fd57ac5a {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:26:01 user nova-compute[75745]: DEBUG nova.compute.manager [req-36f5ac30-3dbd-4507-9c9c-d9f25c014db0 req-53e4ba4b-6835-4efb-bec3-31cc33796fd9 service nova] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Refreshing instance network info cache due to event network-changed-66185694-ac7f-4baa-9c61-6d19fd57ac5a. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:26:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-36f5ac30-3dbd-4507-9c9c-d9f25c014db0 req-53e4ba4b-6835-4efb-bec3-31cc33796fd9 service nova] Acquiring lock "refresh_cache-9ff5eaad-45ab-4a21-bc9b-9ecef436cab0" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:26:01 user nova-compute[75745]: DEBUG nova.network.neutron [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Updating instance_info_cache with network_info: [{"id": "66185694-ac7f-4baa-9c61-6d19fd57ac5a", "address": "fa:16:3e:14:45:fc", "network": {"id": "a4801184-db1f-4acf-8cb8-5e26d3c01c33", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2001575939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3244f1ca511a4c28809d26a694c45ee1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66185694-ac", "ovs_interfaceid": "66185694-ac7f-4baa-9c61-6d19fd57ac5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Releasing lock "refresh_cache-9ff5eaad-45ab-4a21-bc9b-9ecef436cab0" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG nova.compute.manager [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Instance network_info: |[{"id": "66185694-ac7f-4baa-9c61-6d19fd57ac5a", "address": "fa:16:3e:14:45:fc", "network": {"id": "a4801184-db1f-4acf-8cb8-5e26d3c01c33", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2001575939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3244f1ca511a4c28809d26a694c45ee1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66185694-ac", "ovs_interfaceid": "66185694-ac7f-4baa-9c61-6d19fd57ac5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-36f5ac30-3dbd-4507-9c9c-d9f25c014db0 req-53e4ba4b-6835-4efb-bec3-31cc33796fd9 service nova] Acquired lock "refresh_cache-9ff5eaad-45ab-4a21-bc9b-9ecef436cab0" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG nova.network.neutron [req-36f5ac30-3dbd-4507-9c9c-d9f25c014db0 req-53e4ba4b-6835-4efb-bec3-31cc33796fd9 service nova] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Refreshing network info cache for port 66185694-ac7f-4baa-9c61-6d19fd57ac5a {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Start _get_guest_xml network_info=[{"id": "66185694-ac7f-4baa-9c61-6d19fd57ac5a", "address": "fa:16:3e:14:45:fc", "network": {"id": "a4801184-db1f-4acf-8cb8-5e26d3c01c33", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2001575939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3244f1ca511a4c28809d26a694c45ee1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66185694-ac", "ovs_interfaceid": "66185694-ac7f-4baa-9c61-6d19fd57ac5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:26:02 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:26:02 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:26:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:25:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1334314493',display_name='tempest-TestServerVolumeAttachmentScenario-server-1334314493',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1334314493',id=37,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqYlk8vqz6QWZawAqdvjDnEe0YBEViA8IxogPlvCutaB8WK59gKlA+x/zY+CS5CS5s21moQ/dR8n3LHuLfRELOPrzgnR7VMAZI8rTtpvQkMdhnC+s/fEhC9TyJaIczwIg==',key_name='tempest-keypair-426900645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3244f1ca511a4c28809d26a694c45ee1',ramdisk_id='',reservation_id='r-55nns4dp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1906576828',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1906576828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:25:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9787e4d7695a4187812090fcaf302a98',uuid=9ff5eaad-45ab-4a21-bc9b-9ecef436cab0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66185694-ac7f-4baa-9c61-6d19fd57ac5a", "address": "fa:16:3e:14:45:fc", "network": {"id": "a4801184-db1f-4acf-8cb8-5e26d3c01c33", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2001575939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3244f1ca511a4c28809d26a694c45ee1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66185694-ac", "ovs_interfaceid": "66185694-ac7f-4baa-9c61-6d19fd57ac5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Converting VIF {"id": "66185694-ac7f-4baa-9c61-6d19fd57ac5a", "address": "fa:16:3e:14:45:fc", "network": {"id": "a4801184-db1f-4acf-8cb8-5e26d3c01c33", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2001575939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3244f1ca511a4c28809d26a694c45ee1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66185694-ac", "ovs_interfaceid": "66185694-ac7f-4baa-9c61-6d19fd57ac5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:45:fc,bridge_name='br-int',has_traffic_filtering=True,id=66185694-ac7f-4baa-9c61-6d19fd57ac5a,network=Network(a4801184-db1f-4acf-8cb8-5e26d3c01c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66185694-ac') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG nova.objects.instance [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:26:02 user nova-compute[75745]:   <uuid>9ff5eaad-45ab-4a21-bc9b-9ecef436cab0</uuid>
Dec 01 17:26:02 user nova-compute[75745]:   <name>instance-00000025</name>
Dec 01 17:26:02 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:26:02 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:26:02 user nova-compute[75745]:   <metadata>
Dec 01 17:26:02 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:26:02 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:26:02 user nova-compute[75745]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1334314493</nova:name>
Dec 01 17:26:02 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:26:02</nova:creationTime>
Dec 01 17:26:02 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:26:02 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:26:02 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:26:02 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:26:02 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:26:02 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:26:02 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:26:02 user nova-compute[75745]:       <nova:owner>
Dec 01 17:26:02 user nova-compute[75745]:         <nova:user uuid="9787e4d7695a4187812090fcaf302a98">tempest-TestServerVolumeAttachmentScenario-1906576828-project-member</nova:user>
Dec 01 17:26:02 user nova-compute[75745]:         <nova:project uuid="3244f1ca511a4c28809d26a694c45ee1">tempest-TestServerVolumeAttachmentScenario-1906576828</nova:project>
Dec 01 17:26:02 user nova-compute[75745]:       </nova:owner>
Dec 01 17:26:02 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:26:02 user nova-compute[75745]:       <nova:ports>
Dec 01 17:26:02 user nova-compute[75745]:         <nova:port uuid="66185694-ac7f-4baa-9c61-6d19fd57ac5a">
Dec 01 17:26:02 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 01 17:26:02 user nova-compute[75745]:         </nova:port>
Dec 01 17:26:02 user nova-compute[75745]:       </nova:ports>
Dec 01 17:26:02 user nova-compute[75745]:     </nova:instance>
Dec 01 17:26:02 user nova-compute[75745]:   </metadata>
Dec 01 17:26:02 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:26:02 user nova-compute[75745]:     <system>
Dec 01 17:26:02 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:26:02 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:26:02 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:26:02 user nova-compute[75745]:       <entry name="serial">9ff5eaad-45ab-4a21-bc9b-9ecef436cab0</entry>
Dec 01 17:26:02 user nova-compute[75745]:       <entry name="uuid">9ff5eaad-45ab-4a21-bc9b-9ecef436cab0</entry>
Dec 01 17:26:02 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:26:02 user nova-compute[75745]:     </system>
Dec 01 17:26:02 user nova-compute[75745]:   </sysinfo>
Dec 01 17:26:02 user nova-compute[75745]:   <os>
Dec 01 17:26:02 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:26:02 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:26:02 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:26:02 user nova-compute[75745]:   </os>
Dec 01 17:26:02 user nova-compute[75745]:   <features>
Dec 01 17:26:02 user nova-compute[75745]:     <acpi/>
Dec 01 17:26:02 user nova-compute[75745]:     <apic/>
Dec 01 17:26:02 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:26:02 user nova-compute[75745]:   </features>
Dec 01 17:26:02 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:26:02 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:26:02 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:26:02 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:26:02 user nova-compute[75745]:   </clock>
Dec 01 17:26:02 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:26:02 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:26:02 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:26:02 user nova-compute[75745]:   </cpu>
Dec 01 17:26:02 user nova-compute[75745]:   <devices>
Dec 01 17:26:02 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:26:02 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:26:02 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/9ff5eaad-45ab-4a21-bc9b-9ecef436cab0/disk"/>
Dec 01 17:26:02 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:26:02 user nova-compute[75745]:     </disk>
Dec 01 17:26:02 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:26:02 user nova-compute[75745]:       <mac address="fa:16:3e:14:45:fc"/>
Dec 01 17:26:02 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:26:02 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:26:02 user nova-compute[75745]:       <target dev="tap66185694-ac"/>
Dec 01 17:26:02 user nova-compute[75745]:     </interface>
Dec 01 17:26:02 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:26:02 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/9ff5eaad-45ab-4a21-bc9b-9ecef436cab0/console.log" append="off"/>
Dec 01 17:26:02 user nova-compute[75745]:     </serial>
Dec 01 17:26:02 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:26:02 user nova-compute[75745]:     <video>
Dec 01 17:26:02 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:26:02 user nova-compute[75745]:     </video>
Dec 01 17:26:02 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:26:02 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:26:02 user nova-compute[75745]:     </rng>
Dec 01 17:26:02 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:26:02 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:26:02 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:26:02 user nova-compute[75745]:     </memballoon>
Dec 01 17:26:02 user nova-compute[75745]:   </devices>
Dec 01 17:26:02 user nova-compute[75745]: </domain>
Dec 01 17:26:02 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:25:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1334314493',display_name='tempest-TestServerVolumeAttachmentScenario-server-1334314493',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1334314493',id=37,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqYlk8vqz6QWZawAqdvjDnEe0YBEViA8IxogPlvCutaB8WK59gKlA+x/zY+CS5CS5s21moQ/dR8n3LHuLfRELOPrzgnR7VMAZI8rTtpvQkMdhnC+s/fEhC9TyJaIczwIg==',key_name='tempest-keypair-426900645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3244f1ca511a4c28809d26a694c45ee1',ramdisk_id='',reservation_id='r-55nns4dp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1906576828',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1906576828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:25:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9787e4d7695a4187812090fcaf302a98',uuid=9ff5eaad-45ab-4a21-bc9b-9ecef436cab0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66185694-ac7f-4baa-9c61-6d19fd57ac5a", "address": "fa:16:3e:14:45:fc", "network": {"id": "a4801184-db1f-4acf-8cb8-5e26d3c01c33", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2001575939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3244f1ca511a4c28809d26a694c45ee1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66185694-ac", "ovs_interfaceid": "66185694-ac7f-4baa-9c61-6d19fd57ac5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Converting VIF {"id": "66185694-ac7f-4baa-9c61-6d19fd57ac5a", "address": "fa:16:3e:14:45:fc", "network": {"id": "a4801184-db1f-4acf-8cb8-5e26d3c01c33", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2001575939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3244f1ca511a4c28809d26a694c45ee1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66185694-ac", "ovs_interfaceid": "66185694-ac7f-4baa-9c61-6d19fd57ac5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:45:fc,bridge_name='br-int',has_traffic_filtering=True,id=66185694-ac7f-4baa-9c61-6d19fd57ac5a,network=Network(a4801184-db1f-4acf-8cb8-5e26d3c01c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66185694-ac') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG os_vif [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:45:fc,bridge_name='br-int',has_traffic_filtering=True,id=66185694-ac7f-4baa-9c61-6d19fd57ac5a,network=Network(a4801184-db1f-4acf-8cb8-5e26d3c01c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66185694-ac') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eee54def-9d7d-5930-84ef-11e82b0b1b79', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66185694-ac, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap66185694-ac, col_values=(('qos', UUID('a2a68111-a4bf-447c-9864-43b895b3b81e')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap66185694-ac, col_values=(('external_ids', {'iface-id': '66185694-ac7f-4baa-9c61-6d19fd57ac5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:45:fc', 'vm-uuid': '9ff5eaad-45ab-4a21-bc9b-9ecef436cab0'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:02 user nova-compute[75745]: INFO os_vif [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:45:fc,bridge_name='br-int',has_traffic_filtering=True,id=66185694-ac7f-4baa-9c61-6d19fd57ac5a,network=Network(a4801184-db1f-4acf-8cb8-5e26d3c01c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66185694-ac')
Dec 01 17:26:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] No VIF found with MAC fa:16:3e:14:45:fc, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG nova.network.neutron [req-36f5ac30-3dbd-4507-9c9c-d9f25c014db0 req-53e4ba4b-6835-4efb-bec3-31cc33796fd9 service nova] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Updated VIF entry in instance network info cache for port 66185694-ac7f-4baa-9c61-6d19fd57ac5a. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG nova.network.neutron [req-36f5ac30-3dbd-4507-9c9c-d9f25c014db0 req-53e4ba4b-6835-4efb-bec3-31cc33796fd9 service nova] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Updating instance_info_cache with network_info: [{"id": "66185694-ac7f-4baa-9c61-6d19fd57ac5a", "address": "fa:16:3e:14:45:fc", "network": {"id": "a4801184-db1f-4acf-8cb8-5e26d3c01c33", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2001575939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3244f1ca511a4c28809d26a694c45ee1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66185694-ac", "ovs_interfaceid": "66185694-ac7f-4baa-9c61-6d19fd57ac5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-36f5ac30-3dbd-4507-9c9c-d9f25c014db0 req-53e4ba4b-6835-4efb-bec3-31cc33796fd9 service nova] Releasing lock "refresh_cache-9ff5eaad-45ab-4a21-bc9b-9ecef436cab0" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:26:02 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:26:03 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:03 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:03 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:03 user nova-compute[75745]: DEBUG nova.compute.manager [req-c42cfae5-a90d-43e2-96b0-95b445c7a62b req-2e36e7f4-bbfd-45f9-b886-a08d7ce921d1 service nova] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Received event network-vif-plugged-66185694-ac7f-4baa-9c61-6d19fd57ac5a {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:26:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c42cfae5-a90d-43e2-96b0-95b445c7a62b req-2e36e7f4-bbfd-45f9-b886-a08d7ce921d1 service nova] Acquiring lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:26:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c42cfae5-a90d-43e2-96b0-95b445c7a62b req-2e36e7f4-bbfd-45f9-b886-a08d7ce921d1 service nova] Lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:26:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c42cfae5-a90d-43e2-96b0-95b445c7a62b req-2e36e7f4-bbfd-45f9-b886-a08d7ce921d1 service nova] Lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:03 user nova-compute[75745]: DEBUG nova.compute.manager [req-c42cfae5-a90d-43e2-96b0-95b445c7a62b req-2e36e7f4-bbfd-45f9-b886-a08d7ce921d1 service nova] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] No waiting events found dispatching network-vif-plugged-66185694-ac7f-4baa-9c61-6d19fd57ac5a {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:26:03 user nova-compute[75745]: WARNING nova.compute.manager [req-c42cfae5-a90d-43e2-96b0-95b445c7a62b req-2e36e7f4-bbfd-45f9-b886-a08d7ce921d1 service nova] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Received unexpected event network-vif-plugged-66185694-ac7f-4baa-9c61-6d19fd57ac5a for instance with vm_state building and task_state spawning.
Dec 01 17:26:03 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:26:03 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:26:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-e4ffb96e-456c-4fb9-9850-9e98310d63e5" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:26:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-e4ffb96e-456c-4fb9-9850-9e98310d63e5" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:26:03 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:26:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:04 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Updating instance_info_cache with network_info: [{"id": "ebf45b7a-1ee5-43d6-9940-0ca049c95d71", "address": "fa:16:3e:39:c0:e3", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf45b7a-1e", "ovs_interfaceid": "ebf45b7a-1ee5-43d6-9940-0ca049c95d71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:26:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-e4ffb96e-456c-4fb9-9850-9e98310d63e5" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:26:04 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:26:04 user nova-compute[75745]: DEBUG nova.compute.manager [req-5b8d4efc-2f4a-4941-97e8-4f75d130fa0e req-f733c99e-d515-4969-83d5-e81d8adee523 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Received event network-changed-fff6dabe-5df3-4db0-85cb-6dce98f4b953 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:26:04 user nova-compute[75745]: DEBUG nova.compute.manager [req-5b8d4efc-2f4a-4941-97e8-4f75d130fa0e req-f733c99e-d515-4969-83d5-e81d8adee523 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Refreshing instance network info cache due to event network-changed-fff6dabe-5df3-4db0-85cb-6dce98f4b953. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:26:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5b8d4efc-2f4a-4941-97e8-4f75d130fa0e req-f733c99e-d515-4969-83d5-e81d8adee523 service nova] Acquiring lock "refresh_cache-b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:26:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5b8d4efc-2f4a-4941-97e8-4f75d130fa0e req-f733c99e-d515-4969-83d5-e81d8adee523 service nova] Acquired lock "refresh_cache-b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:26:04 user nova-compute[75745]: DEBUG nova.network.neutron [req-5b8d4efc-2f4a-4941-97e8-4f75d130fa0e req-f733c99e-d515-4969-83d5-e81d8adee523 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Refreshing network info cache for port fff6dabe-5df3-4db0-85cb-6dce98f4b953 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:26:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:05 user nova-compute[75745]: DEBUG nova.network.neutron [req-5b8d4efc-2f4a-4941-97e8-4f75d130fa0e req-f733c99e-d515-4969-83d5-e81d8adee523 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Updated VIF entry in instance network info cache for port fff6dabe-5df3-4db0-85cb-6dce98f4b953. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:26:05 user nova-compute[75745]: DEBUG nova.network.neutron [req-5b8d4efc-2f4a-4941-97e8-4f75d130fa0e req-f733c99e-d515-4969-83d5-e81d8adee523 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Updating instance_info_cache with network_info: [{"id": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "address": "fa:16:3e:71:7f:4a", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff6dabe-5d", "ovs_interfaceid": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:26:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5b8d4efc-2f4a-4941-97e8-4f75d130fa0e req-f733c99e-d515-4969-83d5-e81d8adee523 service nova] Releasing lock "refresh_cache-b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:26:05 user nova-compute[75745]: DEBUG nova.compute.manager [req-22e5635c-7db7-42d1-8c95-fd9b74157cda req-1dcb7d19-eb8f-4868-b336-2be4c9687169 service nova] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Received event network-vif-plugged-66185694-ac7f-4baa-9c61-6d19fd57ac5a {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:26:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-22e5635c-7db7-42d1-8c95-fd9b74157cda req-1dcb7d19-eb8f-4868-b336-2be4c9687169 service nova] Acquiring lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:26:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-22e5635c-7db7-42d1-8c95-fd9b74157cda req-1dcb7d19-eb8f-4868-b336-2be4c9687169 service nova] Lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:26:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-22e5635c-7db7-42d1-8c95-fd9b74157cda req-1dcb7d19-eb8f-4868-b336-2be4c9687169 service nova] Lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:05 user nova-compute[75745]: DEBUG nova.compute.manager [req-22e5635c-7db7-42d1-8c95-fd9b74157cda req-1dcb7d19-eb8f-4868-b336-2be4c9687169 service nova] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] No waiting events found dispatching network-vif-plugged-66185694-ac7f-4baa-9c61-6d19fd57ac5a {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:26:05 user nova-compute[75745]: WARNING nova.compute.manager [req-22e5635c-7db7-42d1-8c95-fd9b74157cda req-1dcb7d19-eb8f-4868-b336-2be4c9687169 service nova] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Received unexpected event network-vif-plugged-66185694-ac7f-4baa-9c61-6d19fd57ac5a for instance with vm_state building and task_state spawning.
Dec 01 17:26:05 user nova-compute[75745]: DEBUG nova.compute.manager [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:26:05 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:26:05 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Instance spawned successfully.
Dec 01 17:26:05 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:26:05 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:26:05 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:26:05 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:26:05 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:26:05 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:26:05 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:26:06 user nova-compute[75745]: INFO nova.compute.manager [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Took 6.54 seconds to spawn the instance on the hypervisor.
Dec 01 17:26:06 user nova-compute[75745]: DEBUG nova.compute.manager [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:26:06 user nova-compute[75745]: INFO nova.compute.manager [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Took 7.74 seconds to build instance.
Dec 01 17:26:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6db2faa3-c580-4a1c-85ba-1f13b3771da1 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.851s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:07 user nova-compute[75745]: DEBUG nova.compute.manager [req-39dffdec-d07f-41d8-9624-9ff5829454fc req-8d87d2e2-eb8e-40bf-9261-8b09180e68e9 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Received event network-changed-fff6dabe-5df3-4db0-85cb-6dce98f4b953 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:26:07 user nova-compute[75745]: DEBUG nova.compute.manager [req-39dffdec-d07f-41d8-9624-9ff5829454fc req-8d87d2e2-eb8e-40bf-9261-8b09180e68e9 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Refreshing instance network info cache due to event network-changed-fff6dabe-5df3-4db0-85cb-6dce98f4b953. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:26:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-39dffdec-d07f-41d8-9624-9ff5829454fc req-8d87d2e2-eb8e-40bf-9261-8b09180e68e9 service nova] Acquiring lock "refresh_cache-b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:26:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-39dffdec-d07f-41d8-9624-9ff5829454fc req-8d87d2e2-eb8e-40bf-9261-8b09180e68e9 service nova] Acquired lock "refresh_cache-b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:26:07 user nova-compute[75745]: DEBUG nova.network.neutron [req-39dffdec-d07f-41d8-9624-9ff5829454fc req-8d87d2e2-eb8e-40bf-9261-8b09180e68e9 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Refreshing network info cache for port fff6dabe-5df3-4db0-85cb-6dce98f4b953 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:26:07 user nova-compute[75745]: DEBUG nova.network.neutron [req-39dffdec-d07f-41d8-9624-9ff5829454fc req-8d87d2e2-eb8e-40bf-9261-8b09180e68e9 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Updated VIF entry in instance network info cache for port fff6dabe-5df3-4db0-85cb-6dce98f4b953. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:26:07 user nova-compute[75745]: DEBUG nova.network.neutron [req-39dffdec-d07f-41d8-9624-9ff5829454fc req-8d87d2e2-eb8e-40bf-9261-8b09180e68e9 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Updating instance_info_cache with network_info: [{"id": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "address": "fa:16:3e:71:7f:4a", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff6dabe-5d", "ovs_interfaceid": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:26:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-39dffdec-d07f-41d8-9624-9ff5829454fc req-8d87d2e2-eb8e-40bf-9261-8b09180e68e9 service nova] Releasing lock "refresh_cache-b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GwfuklmJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:26:10 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:26:10 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:26:10 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:26:10 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:26:10 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:26:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a11b07d-fc6f-4738-9983-2b82e93ebdc2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:26:10 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcee15d1-4984-491e-abea-3761f3c09585]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af] added
Dec 01 17:26:10 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e6425d-977c-4571-8d3f-e7faf3833967]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[67eb14a8-8633-4aab-9bcf-f8826dc448fb]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GwfuklmJ {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GwfuklmJ" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aea8ffa-749e-40df-8ad1-55a35c50915e]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GwfuklmJ'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade85fbf-7ec0-476e-af8b-63799de4ea3c]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d00fe83-3409-44eb-8652-122bad423a9a]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:26:10 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:26:10 user nova-compute[75745]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:26:10 user nova-compute[75745]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 (non-flash)
Dec 01 17:26:10 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:26:10 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:26:10 user nova-compute[75745]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:26:10 user nova-compute[75745]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 (non-flash)
Dec 01 17:26:10 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f9c52d-2117-436d-af22-4bc217245ddd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af, portal: 172.16.0.220,3260]
Dec 01 17:26:10 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af, portal: 172.16.0.220,3260] successful.
Dec 01 17:26:10 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6140e04-8204-41b4-8b45-27d78ee1ef42]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3db238-6d5d-42d8-a4c2-3c7c003da942]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:26:10 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:26:10 user nova-compute[75745]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:26:10 user nova-compute[75745]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 (non-flash)
Dec 01 17:26:10 user nova-compute[75745]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af (non-flash)
Dec 01 17:26:10 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:26:10 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:26:10 user nova-compute[75745]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:26:10 user nova-compute[75745]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 (non-flash)
Dec 01 17:26:10 user nova-compute[75745]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af (non-flash)
Dec 01 17:26:10 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] HCTL ('37', '-', '-', 0) found on session 41 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cabb6c2-90a6-4395-bdfc-faac238a6c93]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Searching for a device in session 41 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:26:10 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GwfuklmJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:26:11 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:26:11 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23331313366323337', 'path': '/dev/sdf'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:26:11 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331313366323337', 'path': '/dev/sdf'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:26:11 user nova-compute[75745]: DEBUG nova.objects.instance [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lazy-loading 'flavor' on Instance uuid a4f614f2-6b6c-4841-8a67-6231a33bd98e {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:26:11 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 17:26:11 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:26:11 user nova-compute[75745]:   <source dev="/dev/sdf"/>
Dec 01 17:26:11 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:26:11 user nova-compute[75745]:   <serial>61972f11-f33b-4d82-a4fc-308e6daab4af</serial>
Dec 01 17:26:11 user nova-compute[75745]: </disk>
Dec 01 17:26:11 user nova-compute[75745]:  {{(pid=75745) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 17:26:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:26:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:26:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] No VIF found with MAC fa:16:3e:b8:34:57, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:26:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c7985dc6-0a83-4fbf-9e23-5f85786cee52 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.139s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:26:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:26:12 user nova-compute[75745]: INFO nova.compute.manager [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Rebooting instance
Dec 01 17:26:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "refresh_cache-b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:26:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquired lock "refresh_cache-b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:26:12 user nova-compute[75745]: DEBUG nova.network.neutron [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:26:12 user nova-compute[75745]: DEBUG nova.network.neutron [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Updating instance_info_cache with network_info: [{"id": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "address": "fa:16:3e:71:7f:4a", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff6dabe-5d", "ovs_interfaceid": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:26:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Releasing lock "refresh_cache-b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:26:12 user nova-compute[75745]: DEBUG nova.compute.manager [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG nova.compute.manager [req-1732e2a7-ce8e-4531-b8a4-664cbd5553e8 req-bfc1f042-f2e0-4755-8f52-ade960d0e0b9 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Received event network-vif-unplugged-fff6dabe-5df3-4db0-85cb-6dce98f4b953 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1732e2a7-ce8e-4531-b8a4-664cbd5553e8 req-bfc1f042-f2e0-4755-8f52-ade960d0e0b9 service nova] Acquiring lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1732e2a7-ce8e-4531-b8a4-664cbd5553e8 req-bfc1f042-f2e0-4755-8f52-ade960d0e0b9 service nova] Lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1732e2a7-ce8e-4531-b8a4-664cbd5553e8 req-bfc1f042-f2e0-4755-8f52-ade960d0e0b9 service nova] Lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG nova.compute.manager [req-1732e2a7-ce8e-4531-b8a4-664cbd5553e8 req-bfc1f042-f2e0-4755-8f52-ade960d0e0b9 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] No waiting events found dispatching network-vif-unplugged-fff6dabe-5df3-4db0-85cb-6dce98f4b953 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:26:13 user nova-compute[75745]: WARNING nova.compute.manager [req-1732e2a7-ce8e-4531-b8a4-664cbd5553e8 req-bfc1f042-f2e0-4755-8f52-ade960d0e0b9 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Received unexpected event network-vif-unplugged-fff6dabe-5df3-4db0-85cb-6dce98f4b953 for instance with vm_state active and task_state reboot_started_hard.
Dec 01 17:26:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:13 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Instance destroyed successfully.
Dec 01 17:26:13 user nova-compute[75745]: DEBUG nova.objects.instance [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lazy-loading 'resources' on Instance uuid b26b6ef1-7a8b-4628-8cc1-d27cc27efcac {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:23:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2051733239',display_name='tempest-TestMinimumBasicScenario-server-2051733239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2051733239',id=35,image_ref='cb76920d-b7bf-4216-9c1a-8314539397bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnn9DbZ1Jp2KhqktMIfJFAy2AJFm/hYRjxHHwLjF9RbFVRyd8+/P6NS2CW73jwkJj6uEU3/IytWVgpFqd2zzTrgAhNQ0E7yUV0tGqXiGTIYZBRqkb4sHdY6cQgszpx+1g==',key_name='tempest-TestMinimumBasicScenario-1212427382',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:23:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c3088641ea74a31a80ade2623f85d91',ramdisk_id='',reservation_id='r-i38vr9t0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cb76920d-b7bf-4216-9c1a-8314539397bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-865236074',owner_user_name='tempest-TestMinimumBasicScenario-865236074-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:26:13Z,user_data=None,user_id='f75082346bbd4b2ebfc585a25a897f81',uuid=b26b6ef1-7a8b-4628-8cc1-d27cc27efcac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "address": "fa:16:3e:71:7f:4a", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff6dabe-5d", "ovs_interfaceid": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Converting VIF {"id": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "address": "fa:16:3e:71:7f:4a", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff6dabe-5d", "ovs_interfaceid": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:7f:4a,bridge_name='br-int',has_traffic_filtering=True,id=fff6dabe-5df3-4db0-85cb-6dce98f4b953,network=Network(bfcf7108-b710-4459-bcd7-fbfd464ee6a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfff6dabe-5d') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG os_vif [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:7f:4a,bridge_name='br-int',has_traffic_filtering=True,id=fff6dabe-5df3-4db0-85cb-6dce98f4b953,network=Network(bfcf7108-b710-4459-bcd7-fbfd464ee6a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfff6dabe-5d') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfff6dabe-5d, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=841a5d7d-6a6f-40e2-8f1b-16f217918923) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:13 user nova-compute[75745]: INFO os_vif [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:7f:4a,bridge_name='br-int',has_traffic_filtering=True,id=fff6dabe-5df3-4db0-85cb-6dce98f4b953,network=Network(bfcf7108-b710-4459-bcd7-fbfd464ee6a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfff6dabe-5d')
Dec 01 17:26:13 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNALjSUi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:26:13 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:26:13 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9938f21a-e51c-48f6-8366-0cbf735dbd29]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:26:13 user nova-compute[75745]: No targets found.
Dec 01 17:26:13 user nova-compute[75745]: iSNS:
Dec 01 17:26:13 user nova-compute[75745]: No targets found.
Dec 01 17:26:13 user nova-compute[75745]: STATIC:
Dec 01 17:26:13 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df
Dec 01 17:26:13 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:26:13 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:26:13 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0
Dec 01 17:26:13 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:26:13 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:26:13 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740
Dec 01 17:26:13 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:26:13 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:26:13 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af
Dec 01 17:26:13 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:26:13 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:26:13 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476
Dec 01 17:26:13 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:26:13 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:26:13 user nova-compute[75745]: FIRMWARE:
Dec 01 17:26:13 user nova-compute[75745]: No targets found.
Dec 01 17:26:13 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:26:13 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:26:13 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5333e8b-b63a-47ac-9354-3689f6185160]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37d313a-6920-48e5-a228-b5ef4dc033f5]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:26:13 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:26:13 user nova-compute[75745]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:26:13 user nova-compute[75745]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 (non-flash)
Dec 01 17:26:13 user nova-compute[75745]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af (non-flash)
Dec 01 17:26:13 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:26:13 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:26:13 user nova-compute[75745]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:26:13 user nova-compute[75745]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 (non-flash)
Dec 01 17:26:13 user nova-compute[75745]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af (non-flash)
Dec 01 17:26:13 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24985beb00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476'): ({'sde'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Removing single pathed devices sde {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2711e140-63ad-4dfb-9e50-157ed73d5cce]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[06eee4c7-8384-4179-a655-fb0bcaf2ec51]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Flushing IO for device /dev/sde {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[533abf5b-bc8f-4877-aecb-9b162c9e315a]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c528f0f5-a213-4d44-aede-70c0e6f1a9e0]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] SCSI volumes sde have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[68055e69-6a83-4380-a336-9d9f6a65d942]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[985fbae1-b438-4a11-9b81-2e3f54893e9b]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476, portal: 172.16.0.220,3260]
Dec 01 17:26:14 user nova-compute[75745]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476, portal: 172.16.0.220,3260] successful.
Dec 01 17:26:14 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[18de5f87-473b-408b-ab94-5beb6171a6fb]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] <== disconnect_volume: return (347ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Start _get_guest_xml network_info=[{"id": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "address": "fa:16:3e:71:7f:4a", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff6dabe-5d", "ovs_interfaceid": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=cb76920d-b7bf-4216-9c1a-8314539397bc,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'cb76920d-b7bf-4216-9c1a-8314539397bc'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': '870c6c90-fb88-4f7b-8732-db92cd7f0278', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNALjSUi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'b26b6ef1-7a8b-4628-8cc1-d27cc27efcac', 'attached_at': '', 'detached_at': '', 'volume_id': '0034af46-f9e8-4df6-a432-b9409f910476', 'serial': '0034af46-f9e8-4df6-a432-b9409f910476'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:26:14 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:26:14 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:26:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=cb76920d-b7bf-4216-9c1a-8314539397bc,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG nova.objects.instance [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lazy-loading 'vcpu_model' on Instance uuid b26b6ef1-7a8b-4628-8cc1-d27cc27efcac {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG nova.objects.base [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Object Instance<b26b6ef1-7a8b-4628-8cc1-d27cc27efcac> lazy-loaded attributes: resources,vcpu_model {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNALjSUi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:26:14 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:26:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:26:14 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:26:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:26:14 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cd54ca-08a0-4b6d-8bc2-4a8b8c6a3564]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:26:14 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cca5eb8-ff8e-4796-932b-dd5e4de83c58]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476] added
Dec 01 17:26:14 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f08343-9dc1-4d7d-8921-2116c1d38616]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[717255f6-c151-4ad7-b1e2-e5f5e9a56576]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hNALjSUi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hNALjSUi" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f461887b-fe09-4803-a697-6f395c86ecb4]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hNALjSUi'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[64db28de-5adb-446e-a70d-ea93bed06dbf]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb246fed-2fd6-4094-9abe-bec8decac79d]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:26:14 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:26:14 user nova-compute[75745]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:26:14 user nova-compute[75745]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af (non-flash)
Dec 01 17:26:14 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:26:14 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:26:14 user nova-compute[75745]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:26:14 user nova-compute[75745]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af (non-flash)
Dec 01 17:26:14 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e310b20-c769-4271-8ed9-8894c70098b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476, portal: 172.16.0.220,3260]
Dec 01 17:26:14 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476, portal: 172.16.0.220,3260] successful.
Dec 01 17:26:14 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f2d74b-a4f1-4d51-a4e8-409e13e4888e]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b657d86-a64a-4533-9f17-0a648ef88ad7]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:26:14 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:26:14 user nova-compute[75745]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:26:14 user nova-compute[75745]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af (non-flash)
Dec 01 17:26:14 user nova-compute[75745]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 (non-flash)
Dec 01 17:26:14 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:26:14 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:26:14 user nova-compute[75745]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:26:14 user nova-compute[75745]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af (non-flash)
Dec 01 17:26:14 user nova-compute[75745]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 (non-flash)
Dec 01 17:26:14 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] HCTL ('36', '-', '-', 0) found on session 42 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d65ef52-5051-45c4-aeb1-15d662cffcd1]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:26:14 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNALjSUi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:26:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:15 user nova-compute[75745]: DEBUG nova.compute.manager [req-ba467d59-c84a-42b0-93be-588ae7583dda req-e89221e2-7a90-41a0-87aa-ed6e55ca6f5d service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Received event network-vif-plugged-fff6dabe-5df3-4db0-85cb-6dce98f4b953 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:26:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ba467d59-c84a-42b0-93be-588ae7583dda req-e89221e2-7a90-41a0-87aa-ed6e55ca6f5d service nova] Acquiring lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:26:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ba467d59-c84a-42b0-93be-588ae7583dda req-e89221e2-7a90-41a0-87aa-ed6e55ca6f5d service nova] Lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:26:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ba467d59-c84a-42b0-93be-588ae7583dda req-e89221e2-7a90-41a0-87aa-ed6e55ca6f5d service nova] Lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:15 user nova-compute[75745]: DEBUG nova.compute.manager [req-ba467d59-c84a-42b0-93be-588ae7583dda req-e89221e2-7a90-41a0-87aa-ed6e55ca6f5d service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] No waiting events found dispatching network-vif-plugged-fff6dabe-5df3-4db0-85cb-6dce98f4b953 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:26:15 user nova-compute[75745]: WARNING nova.compute.manager [req-ba467d59-c84a-42b0-93be-588ae7583dda req-e89221e2-7a90-41a0-87aa-ed6e55ca6f5d service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Received unexpected event network-vif-plugged-fff6dabe-5df3-4db0-85cb-6dce98f4b953 for instance with vm_state active and task_state reboot_started_hard.
Dec 01 17:26:15 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:26:15 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] <== connect_volume: return (1413ms) {'type': 'block', 'scsi_wwn': '26664316464326365', 'path': '/dev/sde'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:26:15 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664316464326365', 'path': '/dev/sde'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:26:15 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:23:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2051733239',display_name='tempest-TestMinimumBasicScenario-server-2051733239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2051733239',id=35,image_ref='cb76920d-b7bf-4216-9c1a-8314539397bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnn9DbZ1Jp2KhqktMIfJFAy2AJFm/hYRjxHHwLjF9RbFVRyd8+/P6NS2CW73jwkJj6uEU3/IytWVgpFqd2zzTrgAhNQ0E7yUV0tGqXiGTIYZBRqkb4sHdY6cQgszpx+1g==',key_name='tempest-TestMinimumBasicScenario-1212427382',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:23:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c3088641ea74a31a80ade2623f85d91',ramdisk_id='',reservation_id='r-i38vr9t0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cb76920d-b7bf-4216-9c1a-8314539397bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-865236074',owner_user_name='tempest-TestMinimumBasicScenario-865236074-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:26:13Z,user_data=None,user_id='f75082346bbd4b2ebfc585a25a897f81',uuid=b26b6ef1-7a8b-4628-8cc1-d27cc27efcac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "address": "fa:16:3e:71:7f:4a", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff6dabe-5d", "ovs_interfaceid": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:26:15 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Converting VIF {"id": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "address": "fa:16:3e:71:7f:4a", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff6dabe-5d", "ovs_interfaceid": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:26:15 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:7f:4a,bridge_name='br-int',has_traffic_filtering=True,id=fff6dabe-5df3-4db0-85cb-6dce98f4b953,network=Network(bfcf7108-b710-4459-bcd7-fbfd464ee6a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfff6dabe-5d') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:26:15 user nova-compute[75745]: DEBUG nova.objects.instance [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lazy-loading 'pci_devices' on Instance uuid b26b6ef1-7a8b-4628-8cc1-d27cc27efcac {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:26:15 user nova-compute[75745]: DEBUG nova.objects.base [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Object Instance<b26b6ef1-7a8b-4628-8cc1-d27cc27efcac> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:26:15 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:26:15 user nova-compute[75745]:   <uuid>b26b6ef1-7a8b-4628-8cc1-d27cc27efcac</uuid>
Dec 01 17:26:15 user nova-compute[75745]:   <name>instance-00000023</name>
Dec 01 17:26:15 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:26:15 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:26:15 user nova-compute[75745]:   <metadata>
Dec 01 17:26:15 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:26:15 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:26:15 user nova-compute[75745]:       <nova:name>tempest-TestMinimumBasicScenario-server-2051733239</nova:name>
Dec 01 17:26:15 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:26:14</nova:creationTime>
Dec 01 17:26:15 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:26:15 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:26:15 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:26:15 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:26:15 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:26:15 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:26:15 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:26:15 user nova-compute[75745]:       <nova:owner>
Dec 01 17:26:15 user nova-compute[75745]:         <nova:user uuid="f75082346bbd4b2ebfc585a25a897f81">tempest-TestMinimumBasicScenario-865236074-project-member</nova:user>
Dec 01 17:26:15 user nova-compute[75745]:         <nova:project uuid="0c3088641ea74a31a80ade2623f85d91">tempest-TestMinimumBasicScenario-865236074</nova:project>
Dec 01 17:26:15 user nova-compute[75745]:       </nova:owner>
Dec 01 17:26:15 user nova-compute[75745]:       <nova:root type="image" uuid="cb76920d-b7bf-4216-9c1a-8314539397bc"/>
Dec 01 17:26:15 user nova-compute[75745]:       <nova:ports>
Dec 01 17:26:15 user nova-compute[75745]:         <nova:port uuid="fff6dabe-5df3-4db0-85cb-6dce98f4b953">
Dec 01 17:26:15 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 01 17:26:15 user nova-compute[75745]:         </nova:port>
Dec 01 17:26:15 user nova-compute[75745]:       </nova:ports>
Dec 01 17:26:15 user nova-compute[75745]:     </nova:instance>
Dec 01 17:26:15 user nova-compute[75745]:   </metadata>
Dec 01 17:26:15 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:26:15 user nova-compute[75745]:     <system>
Dec 01 17:26:15 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:26:15 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:26:15 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:26:15 user nova-compute[75745]:       <entry name="serial">b26b6ef1-7a8b-4628-8cc1-d27cc27efcac</entry>
Dec 01 17:26:15 user nova-compute[75745]:       <entry name="uuid">b26b6ef1-7a8b-4628-8cc1-d27cc27efcac</entry>
Dec 01 17:26:15 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:26:15 user nova-compute[75745]:     </system>
Dec 01 17:26:15 user nova-compute[75745]:   </sysinfo>
Dec 01 17:26:15 user nova-compute[75745]:   <os>
Dec 01 17:26:15 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:26:15 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:26:15 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:26:15 user nova-compute[75745]:   </os>
Dec 01 17:26:15 user nova-compute[75745]:   <features>
Dec 01 17:26:15 user nova-compute[75745]:     <acpi/>
Dec 01 17:26:15 user nova-compute[75745]:     <apic/>
Dec 01 17:26:15 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:26:15 user nova-compute[75745]:   </features>
Dec 01 17:26:15 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:26:15 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:26:15 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:26:15 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:26:15 user nova-compute[75745]:   </clock>
Dec 01 17:26:15 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:26:15 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:26:15 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:26:15 user nova-compute[75745]:   </cpu>
Dec 01 17:26:15 user nova-compute[75745]:   <devices>
Dec 01 17:26:15 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:26:15 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:26:15 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk"/>
Dec 01 17:26:15 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:26:15 user nova-compute[75745]:     </disk>
Dec 01 17:26:15 user nova-compute[75745]:     <disk type="block" device="disk">
Dec 01 17:26:15 user nova-compute[75745]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:26:15 user nova-compute[75745]:       <source dev="/dev/sde"/>
Dec 01 17:26:15 user nova-compute[75745]:       <target dev="vdb" bus="virtio"/>
Dec 01 17:26:15 user nova-compute[75745]:       <serial>0034af46-f9e8-4df6-a432-b9409f910476</serial>
Dec 01 17:26:15 user nova-compute[75745]:     </disk>
Dec 01 17:26:15 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:26:15 user nova-compute[75745]:       <mac address="fa:16:3e:71:7f:4a"/>
Dec 01 17:26:15 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:26:15 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:26:15 user nova-compute[75745]:       <target dev="tapfff6dabe-5d"/>
Dec 01 17:26:15 user nova-compute[75745]:     </interface>
Dec 01 17:26:15 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:26:15 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/console.log" append="off"/>
Dec 01 17:26:15 user nova-compute[75745]:     </serial>
Dec 01 17:26:15 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:26:15 user nova-compute[75745]:     <video>
Dec 01 17:26:15 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:26:15 user nova-compute[75745]:     </video>
Dec 01 17:26:15 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:26:15 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:26:15 user nova-compute[75745]:     </rng>
Dec 01 17:26:15 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:26:15 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:26:15 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:26:15 user nova-compute[75745]:     </memballoon>
Dec 01 17:26:15 user nova-compute[75745]:   </devices>
Dec 01 17:26:15 user nova-compute[75745]: </domain>
Dec 01 17:26:15 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:26:15 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:15 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:15 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:26:16 user nova-compute[75745]: DEBUG nova.objects.instance [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lazy-loading 'trusted_certs' on Instance uuid b26b6ef1-7a8b-4628-8cc1-d27cc27efcac {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:26:16 user nova-compute[75745]: DEBUG nova.objects.base [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Object Instance<b26b6ef1-7a8b-4628-8cc1-d27cc27efcac> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:26:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9baa52f0563aa01ef86ccc990e0971563d7e1530 --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9baa52f0563aa01ef86ccc990e0971563d7e1530 --force-share --output=json" returned: 0 in 0.173s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:16 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:26:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:16 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Cannot resize image /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:26:16 user nova-compute[75745]: DEBUG nova.objects.instance [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lazy-loading 'migration_context' on Instance uuid b26b6ef1-7a8b-4628-8cc1-d27cc27efcac {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:26:16 user nova-compute[75745]: DEBUG nova.objects.base [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Object Instance<b26b6ef1-7a8b-4628-8cc1-d27cc27efcac> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:26:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:23:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2051733239',display_name='tempest-TestMinimumBasicScenario-server-2051733239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2051733239',id=35,image_ref='cb76920d-b7bf-4216-9c1a-8314539397bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnn9DbZ1Jp2KhqktMIfJFAy2AJFm/hYRjxHHwLjF9RbFVRyd8+/P6NS2CW73jwkJj6uEU3/IytWVgpFqd2zzTrgAhNQ0E7yUV0tGqXiGTIYZBRqkb4sHdY6cQgszpx+1g==',key_name='tempest-TestMinimumBasicScenario-1212427382',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:23:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='0c3088641ea74a31a80ade2623f85d91',ramdisk_id='',reservation_id='r-i38vr9t0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cb76920d-b7bf-4216-9c1a-8314539397bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-865236074',owner_user_name='tempest-TestMinimumBasicScenario-865236074-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:26:13Z,user_data=None,user_id='f75082346bbd4b2ebfc585a25a897f81',uuid=b26b6ef1-7a8b-4628-8cc1-d27cc27efcac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "address": "fa:16:3e:71:7f:4a", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff6dabe-5d", "ovs_interfaceid": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:26:16 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Converting VIF {"id": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "address": "fa:16:3e:71:7f:4a", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff6dabe-5d", "ovs_interfaceid": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:26:16 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:7f:4a,bridge_name='br-int',has_traffic_filtering=True,id=fff6dabe-5df3-4db0-85cb-6dce98f4b953,network=Network(bfcf7108-b710-4459-bcd7-fbfd464ee6a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfff6dabe-5d') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:26:16 user nova-compute[75745]: DEBUG os_vif [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:7f:4a,bridge_name='br-int',has_traffic_filtering=True,id=fff6dabe-5df3-4db0-85cb-6dce98f4b953,network=Network(bfcf7108-b710-4459-bcd7-fbfd464ee6a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfff6dabe-5d') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:26:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:26:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:26:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7303f011-b204-569d-8eb1-3e4aaed8bfdb', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:26:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:26:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfff6dabe-5d, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:26:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfff6dabe-5d, col_values=(('qos', UUID('ecd99c0a-9b9b-43bb-a456-66d7e6540b2e')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:26:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfff6dabe-5d, col_values=(('external_ids', {'iface-id': 'fff6dabe-5df3-4db0-85cb-6dce98f4b953', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:7f:4a', 'vm-uuid': 'b26b6ef1-7a8b-4628-8cc1-d27cc27efcac'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:26:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:26:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:16 user nova-compute[75745]: INFO os_vif [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:7f:4a,bridge_name='br-int',has_traffic_filtering=True,id=fff6dabe-5df3-4db0-85cb-6dce98f4b953,network=Network(bfcf7108-b710-4459-bcd7-fbfd464ee6a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfff6dabe-5d')
Dec 01 17:26:17 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:17 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:17 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:18 user nova-compute[75745]: DEBUG nova.compute.manager [req-4e1fa035-db57-4c0a-9e0c-5c38203403de req-f305607c-2b40-429c-bda7-6355f252876f service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Received event network-vif-plugged-fff6dabe-5df3-4db0-85cb-6dce98f4b953 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:26:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-4e1fa035-db57-4c0a-9e0c-5c38203403de req-f305607c-2b40-429c-bda7-6355f252876f service nova] Acquiring lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:26:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-4e1fa035-db57-4c0a-9e0c-5c38203403de req-f305607c-2b40-429c-bda7-6355f252876f service nova] Lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:26:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-4e1fa035-db57-4c0a-9e0c-5c38203403de req-f305607c-2b40-429c-bda7-6355f252876f service nova] Lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:18 user nova-compute[75745]: DEBUG nova.compute.manager [req-4e1fa035-db57-4c0a-9e0c-5c38203403de req-f305607c-2b40-429c-bda7-6355f252876f service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] No waiting events found dispatching network-vif-plugged-fff6dabe-5df3-4db0-85cb-6dce98f4b953 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:26:18 user nova-compute[75745]: WARNING nova.compute.manager [req-4e1fa035-db57-4c0a-9e0c-5c38203403de req-f305607c-2b40-429c-bda7-6355f252876f service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Received unexpected event network-vif-plugged-fff6dabe-5df3-4db0-85cb-6dce98f4b953 for instance with vm_state active and task_state reboot_started_hard.
Dec 01 17:26:18 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:18 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:18 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:18 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:20 user nova-compute[75745]: DEBUG nova.compute.manager [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:26:20 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Instance rebooted successfully.
Dec 01 17:26:20 user nova-compute[75745]: DEBUG nova.compute.manager [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:26:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-702ba440-25f6-47bd-b9f3-2e6be8bf213d tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.825s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:20 user nova-compute[75745]: DEBUG nova.compute.manager [req-176eaf07-e5b2-4feb-98c8-d5e7683b48e2 req-4c635415-6105-4f5e-99dc-e2686eb82b44 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Received event network-vif-plugged-fff6dabe-5df3-4db0-85cb-6dce98f4b953 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:26:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-176eaf07-e5b2-4feb-98c8-d5e7683b48e2 req-4c635415-6105-4f5e-99dc-e2686eb82b44 service nova] Acquiring lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:26:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-176eaf07-e5b2-4feb-98c8-d5e7683b48e2 req-4c635415-6105-4f5e-99dc-e2686eb82b44 service nova] Lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:26:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-176eaf07-e5b2-4feb-98c8-d5e7683b48e2 req-4c635415-6105-4f5e-99dc-e2686eb82b44 service nova] Lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:20 user nova-compute[75745]: DEBUG nova.compute.manager [req-176eaf07-e5b2-4feb-98c8-d5e7683b48e2 req-4c635415-6105-4f5e-99dc-e2686eb82b44 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] No waiting events found dispatching network-vif-plugged-fff6dabe-5df3-4db0-85cb-6dce98f4b953 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:26:20 user nova-compute[75745]: WARNING nova.compute.manager [req-176eaf07-e5b2-4feb-98c8-d5e7683b48e2 req-4c635415-6105-4f5e-99dc-e2686eb82b44 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Received unexpected event network-vif-plugged-fff6dabe-5df3-4db0-85cb-6dce98f4b953 for instance with vm_state active and task_state None.
Dec 01 17:26:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-21b54dfa-d63d-4d8c-b2f5-76ce112cb6c9 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:26:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-21b54dfa-d63d-4d8c-b2f5-76ce112cb6c9 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:26:26 user nova-compute[75745]: DEBUG nova.compute.manager [None req-21b54dfa-d63d-4d8c-b2f5-76ce112cb6c9 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Going to confirm migration 2 {{(pid=75745) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Dec 01 17:26:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-21b54dfa-d63d-4d8c-b2f5-76ce112cb6c9 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "refresh_cache-2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:26:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-21b54dfa-d63d-4d8c-b2f5-76ce112cb6c9 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquired lock "refresh_cache-2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:26:27 user nova-compute[75745]: DEBUG nova.network.neutron [None req-21b54dfa-d63d-4d8c-b2f5-76ce112cb6c9 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:26:27 user nova-compute[75745]: DEBUG nova.objects.instance [None req-21b54dfa-d63d-4d8c-b2f5-76ce112cb6c9 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lazy-loading 'info_cache' on Instance uuid 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:26:27 user nova-compute[75745]: DEBUG nova.network.neutron [None req-21b54dfa-d63d-4d8c-b2f5-76ce112cb6c9 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Updating instance_info_cache with network_info: [{"id": "eeff2c22-349b-42cf-9290-6efccc7686d6", "address": "fa:16:3e:67:06:2e", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeff2c22-34", "ovs_interfaceid": "eeff2c22-349b-42cf-9290-6efccc7686d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:26:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-21b54dfa-d63d-4d8c-b2f5-76ce112cb6c9 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Releasing lock "refresh_cache-2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:26:27 user nova-compute[75745]: DEBUG nova.objects.instance [None req-21b54dfa-d63d-4d8c-b2f5-76ce112cb6c9 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lazy-loading 'migration_context' on Instance uuid 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:26:27 user nova-compute[75745]: DEBUG nova.objects.base [None req-21b54dfa-d63d-4d8c-b2f5-76ce112cb6c9 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Object Instance<2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13> lazy-loaded attributes: info_cache,migration_context {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:26:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-21b54dfa-d63d-4d8c-b2f5-76ce112cb6c9 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:26:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-21b54dfa-d63d-4d8c-b2f5-76ce112cb6c9 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:26:27 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-21b54dfa-d63d-4d8c-b2f5-76ce112cb6c9 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:26:28 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-21b54dfa-d63d-4d8c-b2f5-76ce112cb6c9 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:26:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-21b54dfa-d63d-4d8c-b2f5-76ce112cb6c9 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.439s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:28 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-21b54dfa-d63d-4d8c-b2f5-76ce112cb6c9 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Deleted allocation for migration 320e3003-0dff-4f3d-9818-43eea6fdff82
Dec 01 17:26:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-21b54dfa-d63d-4d8c-b2f5-76ce112cb6c9 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.386s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:32 user nova-compute[75745]: INFO nova.compute.manager [None req-638f06a6-9907-4ffa-80a1-6826f2687268 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Unrescuing
Dec 01 17:26:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-638f06a6-9907-4ffa-80a1-6826f2687268 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "refresh_cache-c358f18c-44c4-45d4-a1eb-4f259c36a0d9" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:26:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-638f06a6-9907-4ffa-80a1-6826f2687268 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquired lock "refresh_cache-c358f18c-44c4-45d4-a1eb-4f259c36a0d9" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:26:32 user nova-compute[75745]: DEBUG nova.network.neutron [None req-638f06a6-9907-4ffa-80a1-6826f2687268 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:26:33 user nova-compute[75745]: DEBUG nova.network.neutron [None req-638f06a6-9907-4ffa-80a1-6826f2687268 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Updating instance_info_cache with network_info: [{"id": "d4c74908-1bd2-4891-b4d7-932d73d78217", "address": "fa:16:3e:f0:97:04", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c74908-1b", "ovs_interfaceid": "d4c74908-1bd2-4891-b4d7-932d73d78217", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:26:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-638f06a6-9907-4ffa-80a1-6826f2687268 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Releasing lock "refresh_cache-c358f18c-44c4-45d4-a1eb-4f259c36a0d9" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:26:33 user nova-compute[75745]: DEBUG nova.objects.instance [None req-638f06a6-9907-4ffa-80a1-6826f2687268 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lazy-loading 'flavor' on Instance uuid c358f18c-44c4-45d4-a1eb-4f259c36a0d9 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:26:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:33 user nova-compute[75745]: DEBUG nova.compute.manager [req-c36273f7-52ae-4a35-bbb9-d8ebd3ff51b7 req-017e0843-7e61-4258-b38c-303b1d7b1acf service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Received event network-vif-unplugged-d4c74908-1bd2-4891-b4d7-932d73d78217 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:26:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c36273f7-52ae-4a35-bbb9-d8ebd3ff51b7 req-017e0843-7e61-4258-b38c-303b1d7b1acf service nova] Acquiring lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:26:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c36273f7-52ae-4a35-bbb9-d8ebd3ff51b7 req-017e0843-7e61-4258-b38c-303b1d7b1acf service nova] Lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:26:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c36273f7-52ae-4a35-bbb9-d8ebd3ff51b7 req-017e0843-7e61-4258-b38c-303b1d7b1acf service nova] Lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:33 user nova-compute[75745]: DEBUG nova.compute.manager [req-c36273f7-52ae-4a35-bbb9-d8ebd3ff51b7 req-017e0843-7e61-4258-b38c-303b1d7b1acf service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] No waiting events found dispatching network-vif-unplugged-d4c74908-1bd2-4891-b4d7-932d73d78217 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:26:33 user nova-compute[75745]: WARNING nova.compute.manager [req-c36273f7-52ae-4a35-bbb9-d8ebd3ff51b7 req-017e0843-7e61-4258-b38c-303b1d7b1acf service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Received unexpected event network-vif-unplugged-d4c74908-1bd2-4891-b4d7-932d73d78217 for instance with vm_state rescued and task_state unrescuing.
Dec 01 17:26:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:33 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Instance destroyed successfully.
Dec 01 17:26:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Acquiring lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:26:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:26:34 user nova-compute[75745]: INFO nova.compute.manager [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Detaching volume 61972f11-f33b-4d82-a4fc-308e6daab4af
Dec 01 17:26:34 user nova-compute[75745]: INFO nova.virt.block_device [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Attempting to driver detach volume 61972f11-f33b-4d82-a4fc-308e6daab4af from mountpoint /dev/vdb
Dec 01 17:26:34 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Attempting to detach device vdb from instance a4f614f2-6b6c-4841-8a67-6231a33bd98e from the persistent domain config. {{(pid=75745) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 17:26:34 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:26:34 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:26:34 user nova-compute[75745]:   <source dev="/dev/sdf"/>
Dec 01 17:26:34 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:26:34 user nova-compute[75745]:   <serial>61972f11-f33b-4d82-a4fc-308e6daab4af</serial>
Dec 01 17:26:34 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 17:26:34 user nova-compute[75745]: </disk>
Dec 01 17:26:34 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:26:34 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Successfully detached device vdb from instance a4f614f2-6b6c-4841-8a67-6231a33bd98e from the persistent domain config.
Dec 01 17:26:34 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a4f614f2-6b6c-4841-8a67-6231a33bd98e from the live domain config. {{(pid=75745) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 17:26:34 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:26:34 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:26:34 user nova-compute[75745]:   <source dev="/dev/sdf"/>
Dec 01 17:26:34 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:26:34 user nova-compute[75745]:   <serial>61972f11-f33b-4d82-a4fc-308e6daab4af</serial>
Dec 01 17:26:34 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 17:26:34 user nova-compute[75745]: </disk>
Dec 01 17:26:34 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:26:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Acquiring lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:26:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:35 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a4f614f2-6b6c-4841-8a67-6231a33bd98e {{(pid=75745) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 17:26:35 user nova-compute[75745]: DEBUG nova.compute.manager [req-54f3c088-a586-4826-8e68-3d3157c1c949 req-c8d2a2d8-31e4-48f0-b346-777613693767 service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Received event network-vif-plugged-d4c74908-1bd2-4891-b4d7-932d73d78217 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:26:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-54f3c088-a586-4826-8e68-3d3157c1c949 req-c8d2a2d8-31e4-48f0-b346-777613693767 service nova] Acquiring lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:26:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-54f3c088-a586-4826-8e68-3d3157c1c949 req-c8d2a2d8-31e4-48f0-b346-777613693767 service nova] Lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:26:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-54f3c088-a586-4826-8e68-3d3157c1c949 req-c8d2a2d8-31e4-48f0-b346-777613693767 service nova] Lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:35 user nova-compute[75745]: DEBUG nova.compute.manager [req-54f3c088-a586-4826-8e68-3d3157c1c949 req-c8d2a2d8-31e4-48f0-b346-777613693767 service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] No waiting events found dispatching network-vif-plugged-d4c74908-1bd2-4891-b4d7-932d73d78217 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:26:35 user nova-compute[75745]: WARNING nova.compute.manager [req-54f3c088-a586-4826-8e68-3d3157c1c949 req-c8d2a2d8-31e4-48f0-b346-777613693767 service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Received unexpected event network-vif-plugged-d4c74908-1bd2-4891-b4d7-932d73d78217 for instance with vm_state rescued and task_state unrescuing.
Dec 01 17:26:35 user nova-compute[75745]: DEBUG nova.compute.manager [req-54f3c088-a586-4826-8e68-3d3157c1c949 req-c8d2a2d8-31e4-48f0-b346-777613693767 service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Received event network-vif-plugged-d4c74908-1bd2-4891-b4d7-932d73d78217 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:26:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-54f3c088-a586-4826-8e68-3d3157c1c949 req-c8d2a2d8-31e4-48f0-b346-777613693767 service nova] Acquiring lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:26:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-54f3c088-a586-4826-8e68-3d3157c1c949 req-c8d2a2d8-31e4-48f0-b346-777613693767 service nova] Lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:26:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-54f3c088-a586-4826-8e68-3d3157c1c949 req-c8d2a2d8-31e4-48f0-b346-777613693767 service nova] Lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:35 user nova-compute[75745]: DEBUG nova.compute.manager [req-54f3c088-a586-4826-8e68-3d3157c1c949 req-c8d2a2d8-31e4-48f0-b346-777613693767 service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] No waiting events found dispatching network-vif-plugged-d4c74908-1bd2-4891-b4d7-932d73d78217 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:26:35 user nova-compute[75745]: WARNING nova.compute.manager [req-54f3c088-a586-4826-8e68-3d3157c1c949 req-c8d2a2d8-31e4-48f0-b346-777613693767 service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Received unexpected event network-vif-plugged-d4c74908-1bd2-4891-b4d7-932d73d78217 for instance with vm_state rescued and task_state unrescuing.
Dec 01 17:26:35 user nova-compute[75745]: DEBUG nova.compute.manager [req-54f3c088-a586-4826-8e68-3d3157c1c949 req-c8d2a2d8-31e4-48f0-b346-777613693767 service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Received event network-vif-plugged-d4c74908-1bd2-4891-b4d7-932d73d78217 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:26:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-54f3c088-a586-4826-8e68-3d3157c1c949 req-c8d2a2d8-31e4-48f0-b346-777613693767 service nova] Acquiring lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:26:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-54f3c088-a586-4826-8e68-3d3157c1c949 req-c8d2a2d8-31e4-48f0-b346-777613693767 service nova] Lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:26:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-54f3c088-a586-4826-8e68-3d3157c1c949 req-c8d2a2d8-31e4-48f0-b346-777613693767 service nova] Lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:35 user nova-compute[75745]: DEBUG nova.compute.manager [req-54f3c088-a586-4826-8e68-3d3157c1c949 req-c8d2a2d8-31e4-48f0-b346-777613693767 service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] No waiting events found dispatching network-vif-plugged-d4c74908-1bd2-4891-b4d7-932d73d78217 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:26:35 user nova-compute[75745]: WARNING nova.compute.manager [req-54f3c088-a586-4826-8e68-3d3157c1c949 req-c8d2a2d8-31e4-48f0-b346-777613693767 service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Received unexpected event network-vif-plugged-d4c74908-1bd2-4891-b4d7-932d73d78217 for instance with vm_state rescued and task_state unrescuing.
Dec 01 17:26:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:37 user nova-compute[75745]: DEBUG nova.compute.manager [None req-638f06a6-9907-4ffa-80a1-6826f2687268 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:26:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:41 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:42 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:26:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "61e0e19b-f926-4524-82c8-833f804c9b72" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:26:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "61e0e19b-f926-4524-82c8-833f804c9b72" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:26:51 user nova-compute[75745]: DEBUG nova.compute.manager [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:26:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:26:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:26:51 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:26:51 user nova-compute[75745]: INFO nova.compute.claims [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Claim successful on node user
Dec 01 17:26:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:51 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:26:51 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:26:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:51 user nova-compute[75745]: DEBUG nova.compute.manager [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:26:51 user nova-compute[75745]: DEBUG nova.compute.manager [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:26:51 user nova-compute[75745]: DEBUG nova.network.neutron [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:26:51 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:26:51 user nova-compute[75745]: DEBUG nova.compute.manager [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:26:51 user nova-compute[75745]: DEBUG nova.policy [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b319a47b86c04affa1858e1c2359876b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb3ba16695543cab6f10932fd6b2d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:26:51 user nova-compute[75745]: DEBUG nova.compute.manager [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:26:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:26:51 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Creating image(s)
Dec 01 17:26:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "/opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:26:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "/opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:26:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "/opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:51 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:26:51 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Cleaning up deleted instances {{(pid=75745) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 01 17:26:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:51 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] There are 0 instances to clean {{(pid=75745) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 01 17:26:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.176s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:26:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:26:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.191s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk 1073741824" returned: 0 in 0.056s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:52 user nova-compute[75745]: DEBUG nova.network.neutron [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Successfully created port: 7f4c7ce3-3915-4ee1-acea-7a584c6c61b4 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:26:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.184s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:52 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Checking if we can resize image /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:26:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:52 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Cannot resize image /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:26:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:26:52 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Ensure instance console log exists: /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:26:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:26:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:26:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:52 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:26:52 user nova-compute[75745]: DEBUG nova.network.neutron [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Successfully updated port: 7f4c7ce3-3915-4ee1-acea-7a584c6c61b4 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:26:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "refresh_cache-61e0e19b-f926-4524-82c8-833f804c9b72" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:26:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquired lock "refresh_cache-61e0e19b-f926-4524-82c8-833f804c9b72" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:26:52 user nova-compute[75745]: DEBUG nova.network.neutron [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:26:52 user nova-compute[75745]: DEBUG nova.compute.manager [req-d7eea6eb-cf66-415e-bf53-ea4b5517299a req-38f98790-024e-4a9b-b0ae-54dfd1d1f8fc service nova] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Received event network-changed-7f4c7ce3-3915-4ee1-acea-7a584c6c61b4 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:26:52 user nova-compute[75745]: DEBUG nova.compute.manager [req-d7eea6eb-cf66-415e-bf53-ea4b5517299a req-38f98790-024e-4a9b-b0ae-54dfd1d1f8fc service nova] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Refreshing instance network info cache due to event network-changed-7f4c7ce3-3915-4ee1-acea-7a584c6c61b4. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:26:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d7eea6eb-cf66-415e-bf53-ea4b5517299a req-38f98790-024e-4a9b-b0ae-54dfd1d1f8fc service nova] Acquiring lock "refresh_cache-61e0e19b-f926-4524-82c8-833f804c9b72" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG nova.network.neutron [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG nova.network.neutron [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Updating instance_info_cache with network_info: [{"id": "7f4c7ce3-3915-4ee1-acea-7a584c6c61b4", "address": "fa:16:3e:7d:a1:da", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4c7ce3-39", "ovs_interfaceid": "7f4c7ce3-3915-4ee1-acea-7a584c6c61b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Releasing lock "refresh_cache-61e0e19b-f926-4524-82c8-833f804c9b72" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG nova.compute.manager [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Instance network_info: |[{"id": "7f4c7ce3-3915-4ee1-acea-7a584c6c61b4", "address": "fa:16:3e:7d:a1:da", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4c7ce3-39", "ovs_interfaceid": "7f4c7ce3-3915-4ee1-acea-7a584c6c61b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d7eea6eb-cf66-415e-bf53-ea4b5517299a req-38f98790-024e-4a9b-b0ae-54dfd1d1f8fc service nova] Acquired lock "refresh_cache-61e0e19b-f926-4524-82c8-833f804c9b72" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG nova.network.neutron [req-d7eea6eb-cf66-415e-bf53-ea4b5517299a req-38f98790-024e-4a9b-b0ae-54dfd1d1f8fc service nova] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Refreshing network info cache for port 7f4c7ce3-3915-4ee1-acea-7a584c6c61b4 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Start _get_guest_xml network_info=[{"id": "7f4c7ce3-3915-4ee1-acea-7a584c6c61b4", "address": "fa:16:3e:7d:a1:da", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4c7ce3-39", "ovs_interfaceid": "7f4c7ce3-3915-4ee1-acea-7a584c6c61b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:26:53 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:26:53 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:26:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:26:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1553169510',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1553169510',id=38,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='adb3ba16695543cab6f10932fd6b2d2d',ramdisk_id='',reservation_id='r-z0gpr54l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-90723689',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:26:52Z,user_data=None,user_id='b319a47b86c04affa1858e1c2359876b',uuid=61e0e19b-f926-4524-82c8-833f804c9b72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f4c7ce3-3915-4ee1-acea-7a584c6c61b4", "address": "fa:16:3e:7d:a1:da", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4c7ce3-39", "ovs_interfaceid": "7f4c7ce3-3915-4ee1-acea-7a584c6c61b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Converting VIF {"id": "7f4c7ce3-3915-4ee1-acea-7a584c6c61b4", "address": "fa:16:3e:7d:a1:da", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4c7ce3-39", "ovs_interfaceid": "7f4c7ce3-3915-4ee1-acea-7a584c6c61b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:a1:da,bridge_name='br-int',has_traffic_filtering=True,id=7f4c7ce3-3915-4ee1-acea-7a584c6c61b4,network=Network(bf1db63d-d427-41c2-ac82-6fab9483a423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f4c7ce3-39') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG nova.objects.instance [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lazy-loading 'pci_devices' on Instance uuid 61e0e19b-f926-4524-82c8-833f804c9b72 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:26:53 user nova-compute[75745]:   <uuid>61e0e19b-f926-4524-82c8-833f804c9b72</uuid>
Dec 01 17:26:53 user nova-compute[75745]:   <name>instance-00000026</name>
Dec 01 17:26:53 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:26:53 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:26:53 user nova-compute[75745]:   <metadata>
Dec 01 17:26:53 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:26:53 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:26:53 user nova-compute[75745]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1553169510</nova:name>
Dec 01 17:26:53 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:26:53</nova:creationTime>
Dec 01 17:26:53 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:26:53 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:26:53 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:26:53 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:26:53 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:26:53 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:26:53 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:26:53 user nova-compute[75745]:       <nova:owner>
Dec 01 17:26:53 user nova-compute[75745]:         <nova:user uuid="b319a47b86c04affa1858e1c2359876b">tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member</nova:user>
Dec 01 17:26:53 user nova-compute[75745]:         <nova:project uuid="adb3ba16695543cab6f10932fd6b2d2d">tempest-ServerBootFromVolumeStableRescueTest-90723689</nova:project>
Dec 01 17:26:53 user nova-compute[75745]:       </nova:owner>
Dec 01 17:26:53 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:26:53 user nova-compute[75745]:       <nova:ports>
Dec 01 17:26:53 user nova-compute[75745]:         <nova:port uuid="7f4c7ce3-3915-4ee1-acea-7a584c6c61b4">
Dec 01 17:26:53 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 01 17:26:53 user nova-compute[75745]:         </nova:port>
Dec 01 17:26:53 user nova-compute[75745]:       </nova:ports>
Dec 01 17:26:53 user nova-compute[75745]:     </nova:instance>
Dec 01 17:26:53 user nova-compute[75745]:   </metadata>
Dec 01 17:26:53 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:26:53 user nova-compute[75745]:     <system>
Dec 01 17:26:53 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:26:53 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:26:53 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:26:53 user nova-compute[75745]:       <entry name="serial">61e0e19b-f926-4524-82c8-833f804c9b72</entry>
Dec 01 17:26:53 user nova-compute[75745]:       <entry name="uuid">61e0e19b-f926-4524-82c8-833f804c9b72</entry>
Dec 01 17:26:53 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:26:53 user nova-compute[75745]:     </system>
Dec 01 17:26:53 user nova-compute[75745]:   </sysinfo>
Dec 01 17:26:53 user nova-compute[75745]:   <os>
Dec 01 17:26:53 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:26:53 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:26:53 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:26:53 user nova-compute[75745]:   </os>
Dec 01 17:26:53 user nova-compute[75745]:   <features>
Dec 01 17:26:53 user nova-compute[75745]:     <acpi/>
Dec 01 17:26:53 user nova-compute[75745]:     <apic/>
Dec 01 17:26:53 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:26:53 user nova-compute[75745]:   </features>
Dec 01 17:26:53 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:26:53 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:26:53 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:26:53 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:26:53 user nova-compute[75745]:   </clock>
Dec 01 17:26:53 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:26:53 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:26:53 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:26:53 user nova-compute[75745]:   </cpu>
Dec 01 17:26:53 user nova-compute[75745]:   <devices>
Dec 01 17:26:53 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:26:53 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:26:53 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk"/>
Dec 01 17:26:53 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:26:53 user nova-compute[75745]:     </disk>
Dec 01 17:26:53 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:26:53 user nova-compute[75745]:       <mac address="fa:16:3e:7d:a1:da"/>
Dec 01 17:26:53 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:26:53 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:26:53 user nova-compute[75745]:       <target dev="tap7f4c7ce3-39"/>
Dec 01 17:26:53 user nova-compute[75745]:     </interface>
Dec 01 17:26:53 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:26:53 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/console.log" append="off"/>
Dec 01 17:26:53 user nova-compute[75745]:     </serial>
Dec 01 17:26:53 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:26:53 user nova-compute[75745]:     <video>
Dec 01 17:26:53 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:26:53 user nova-compute[75745]:     </video>
Dec 01 17:26:53 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:26:53 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:26:53 user nova-compute[75745]:     </rng>
Dec 01 17:26:53 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:26:53 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:26:53 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:26:53 user nova-compute[75745]:     </memballoon>
Dec 01 17:26:53 user nova-compute[75745]:   </devices>
Dec 01 17:26:53 user nova-compute[75745]: </domain>
Dec 01 17:26:53 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:26:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1553169510',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1553169510',id=38,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='adb3ba16695543cab6f10932fd6b2d2d',ramdisk_id='',reservation_id='r-z0gpr54l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-90723689',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:26:52Z,user_data=None,user_id='b319a47b86c04affa1858e1c2359876b',uuid=61e0e19b-f926-4524-82c8-833f804c9b72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f4c7ce3-3915-4ee1-acea-7a584c6c61b4", "address": "fa:16:3e:7d:a1:da", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4c7ce3-39", "ovs_interfaceid": "7f4c7ce3-3915-4ee1-acea-7a584c6c61b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Converting VIF {"id": "7f4c7ce3-3915-4ee1-acea-7a584c6c61b4", "address": "fa:16:3e:7d:a1:da", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4c7ce3-39", "ovs_interfaceid": "7f4c7ce3-3915-4ee1-acea-7a584c6c61b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:a1:da,bridge_name='br-int',has_traffic_filtering=True,id=7f4c7ce3-3915-4ee1-acea-7a584c6c61b4,network=Network(bf1db63d-d427-41c2-ac82-6fab9483a423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f4c7ce3-39') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG os_vif [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:a1:da,bridge_name='br-int',has_traffic_filtering=True,id=7f4c7ce3-3915-4ee1-acea-7a584c6c61b4,network=Network(bf1db63d-d427-41c2-ac82-6fab9483a423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f4c7ce3-39') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '551698ad-c58f-5ae5-be81-3cba37da9e52', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f4c7ce3-39, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7f4c7ce3-39, col_values=(('qos', UUID('6090922f-8b04-4c43-bfc0-4a34b2442e9d')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7f4c7ce3-39, col_values=(('external_ids', {'iface-id': '7f4c7ce3-3915-4ee1-acea-7a584c6c61b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:a1:da', 'vm-uuid': '61e0e19b-f926-4524-82c8-833f804c9b72'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:53 user nova-compute[75745]: INFO os_vif [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:a1:da,bridge_name='br-int',has_traffic_filtering=True,id=7f4c7ce3-3915-4ee1-acea-7a584c6c61b4,network=Network(bf1db63d-d427-41c2-ac82-6fab9483a423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f4c7ce3-39')
Dec 01 17:26:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] No VIF found with MAC fa:16:3e:7d:a1:da, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG nova.network.neutron [req-d7eea6eb-cf66-415e-bf53-ea4b5517299a req-38f98790-024e-4a9b-b0ae-54dfd1d1f8fc service nova] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Updated VIF entry in instance network info cache for port 7f4c7ce3-3915-4ee1-acea-7a584c6c61b4. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG nova.network.neutron [req-d7eea6eb-cf66-415e-bf53-ea4b5517299a req-38f98790-024e-4a9b-b0ae-54dfd1d1f8fc service nova] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Updating instance_info_cache with network_info: [{"id": "7f4c7ce3-3915-4ee1-acea-7a584c6c61b4", "address": "fa:16:3e:7d:a1:da", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4c7ce3-39", "ovs_interfaceid": "7f4c7ce3-3915-4ee1-acea-7a584c6c61b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d7eea6eb-cf66-415e-bf53-ea4b5517299a req-38f98790-024e-4a9b-b0ae-54dfd1d1f8fc service nova] Releasing lock "refresh_cache-61e0e19b-f926-4524-82c8-833f804c9b72" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:26:53 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75745) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 01 17:26:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:54 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:26:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG nova.compute.manager [req-78ec7eda-7069-4388-92e7-4c01399e0a5d req-306770e4-35a8-46d3-93e9-aed57e758eb5 service nova] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Received event network-vif-plugged-7f4c7ce3-3915-4ee1-acea-7a584c6c61b4 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-78ec7eda-7069-4388-92e7-4c01399e0a5d req-306770e4-35a8-46d3-93e9-aed57e758eb5 service nova] Acquiring lock "61e0e19b-f926-4524-82c8-833f804c9b72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-78ec7eda-7069-4388-92e7-4c01399e0a5d req-306770e4-35a8-46d3-93e9-aed57e758eb5 service nova] Lock "61e0e19b-f926-4524-82c8-833f804c9b72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-78ec7eda-7069-4388-92e7-4c01399e0a5d req-306770e4-35a8-46d3-93e9-aed57e758eb5 service nova] Lock "61e0e19b-f926-4524-82c8-833f804c9b72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG nova.compute.manager [req-78ec7eda-7069-4388-92e7-4c01399e0a5d req-306770e4-35a8-46d3-93e9-aed57e758eb5 service nova] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] No waiting events found dispatching network-vif-plugged-7f4c7ce3-3915-4ee1-acea-7a584c6c61b4 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:26:55 user nova-compute[75745]: WARNING nova.compute.manager [req-78ec7eda-7069-4388-92e7-4c01399e0a5d req-306770e4-35a8-46d3-93e9-aed57e758eb5 service nova] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Received unexpected event network-vif-plugged-7f4c7ce3-3915-4ee1-acea-7a584c6c61b4 for instance with vm_state building and task_state spawning.
Dec 01 17:26:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:55 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a4f614f2-6b6c-4841-8a67-6231a33bd98e is timed out.
Dec 01 17:26:55 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Successfully detached device vdb from instance a4f614f2-6b6c-4841-8a67-6231a33bd98e from the live domain config.
Dec 01 17:26:55 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GwfuklmJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:26:55 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:26:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c619289f-5aa6-4600-8a13-ed856b9ab6cc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:26:55 user nova-compute[75745]: No targets found.
Dec 01 17:26:55 user nova-compute[75745]: iSNS:
Dec 01 17:26:55 user nova-compute[75745]: No targets found.
Dec 01 17:26:55 user nova-compute[75745]: STATIC:
Dec 01 17:26:55 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df
Dec 01 17:26:55 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:26:55 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:26:55 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0
Dec 01 17:26:55 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:26:55 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:26:55 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740
Dec 01 17:26:55 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:26:55 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:26:55 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af
Dec 01 17:26:55 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:26:55 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:26:55 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476
Dec 01 17:26:55 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:26:55 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:26:55 user nova-compute[75745]: FIRMWARE:
Dec 01 17:26:55 user nova-compute[75745]: No targets found.
Dec 01 17:26:55 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:26:55 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:26:55 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[76de8d48-f18d-4a25-bd33-707c142e7bd9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dd15cc-63c5-4f32-bed3-f69d2f01fc9c]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:26:55 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:26:55 user nova-compute[75745]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:26:55 user nova-compute[75745]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af (non-flash)
Dec 01 17:26:55 user nova-compute[75745]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 (non-flash)
Dec 01 17:26:55 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:26:55 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:26:55 user nova-compute[75745]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:26:55 user nova-compute[75745]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af (non-flash)
Dec 01 17:26:55 user nova-compute[75745]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 (non-flash)
Dec 01 17:26:55 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b85b3880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af'): ({'sdf'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Removing single pathed devices sdf {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f8e50f-d239-413f-8194-16a64a65d45d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6608b46-ae2b-4d0a-9a0b-2aeb27534f3c]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Flushing IO for device /dev/sdf {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbacc3a-2087-4f59-9ba7-12f0dcf2a26c]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[243001be-e90d-43ff-870c-a9a35bed91ed]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] SCSI volumes sdf have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2f8cdd-2fdc-4274-9429-7cc4e0084d77]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed560b94-de55-4335-b690-2192082d39f8]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af, portal: 172.16.0.220,3260]
Dec 01 17:26:55 user nova-compute[75745]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af, portal: 172.16.0.220,3260] successful.
Dec 01 17:26:55 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ec77cb-8cbc-467c-98ae-2812bea25614]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] <== disconnect_volume: return (300ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:55 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:26:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:56 user nova-compute[75745]: DEBUG nova.objects.instance [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lazy-loading 'flavor' on Instance uuid a4f614f2-6b6c-4841-8a67-6231a33bd98e {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:26:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-29a0e9bb-d1d5-4110-8620-8c139cd15d44 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.950s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.705s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:26:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Acquiring lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:26:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:26:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:56 user nova-compute[75745]: INFO nova.compute.manager [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Terminating instance
Dec 01 17:26:56 user nova-compute[75745]: DEBUG nova.compute.manager [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:26:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-b87459c8-c527-47a4-8243-663d779d76c6 req-77f2b383-ea1e-469e-bda0-65f0d45ca6b2 service nova] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Received event network-vif-unplugged-b0b6e35c-be93-4ac7-a7ca-2bf50af82eff {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:26:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b87459c8-c527-47a4-8243-663d779d76c6 req-77f2b383-ea1e-469e-bda0-65f0d45ca6b2 service nova] Acquiring lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:26:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b87459c8-c527-47a4-8243-663d779d76c6 req-77f2b383-ea1e-469e-bda0-65f0d45ca6b2 service nova] Lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:26:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b87459c8-c527-47a4-8243-663d779d76c6 req-77f2b383-ea1e-469e-bda0-65f0d45ca6b2 service nova] Lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-b87459c8-c527-47a4-8243-663d779d76c6 req-77f2b383-ea1e-469e-bda0-65f0d45ca6b2 service nova] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] No waiting events found dispatching network-vif-unplugged-b0b6e35c-be93-4ac7-a7ca-2bf50af82eff {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:26:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-b87459c8-c527-47a4-8243-663d779d76c6 req-77f2b383-ea1e-469e-bda0-65f0d45ca6b2 service nova] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Received event network-vif-unplugged-b0b6e35c-be93-4ac7-a7ca-2bf50af82eff for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:26:56 user nova-compute[75745]: DEBUG nova.compute.manager [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:26:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:26:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:56 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Instance spawned successfully.
Dec 01 17:26:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:26:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:26:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:26:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:26:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:26:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:26:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:26:57 user nova-compute[75745]: INFO nova.compute.manager [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Took 5.19 seconds to spawn the instance on the hypervisor.
Dec 01 17:26:57 user nova-compute[75745]: DEBUG nova.compute.manager [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG nova.compute.manager [req-9312fb4f-0375-4598-9ee7-2d257dc84f36 req-eed5498f-09a8-42d1-b612-dccece9c93bd service nova] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Received event network-vif-plugged-7f4c7ce3-3915-4ee1-acea-7a584c6c61b4 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-9312fb4f-0375-4598-9ee7-2d257dc84f36 req-eed5498f-09a8-42d1-b612-dccece9c93bd service nova] Acquiring lock "61e0e19b-f926-4524-82c8-833f804c9b72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-9312fb4f-0375-4598-9ee7-2d257dc84f36 req-eed5498f-09a8-42d1-b612-dccece9c93bd service nova] Lock "61e0e19b-f926-4524-82c8-833f804c9b72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-9312fb4f-0375-4598-9ee7-2d257dc84f36 req-eed5498f-09a8-42d1-b612-dccece9c93bd service nova] Lock "61e0e19b-f926-4524-82c8-833f804c9b72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG nova.compute.manager [req-9312fb4f-0375-4598-9ee7-2d257dc84f36 req-eed5498f-09a8-42d1-b612-dccece9c93bd service nova] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] No waiting events found dispatching network-vif-plugged-7f4c7ce3-3915-4ee1-acea-7a584c6c61b4 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:26:57 user nova-compute[75745]: WARNING nova.compute.manager [req-9312fb4f-0375-4598-9ee7-2d257dc84f36 req-eed5498f-09a8-42d1-b612-dccece9c93bd service nova] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Received unexpected event network-vif-plugged-7f4c7ce3-3915-4ee1-acea-7a584c6c61b4 for instance with vm_state building and task_state spawning.
Dec 01 17:26:57 user nova-compute[75745]: INFO nova.compute.manager [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Took 5.96 seconds to build instance.
Dec 01 17:26:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-32825c0f-f190-4503-82e7-8663bad5da37 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "61e0e19b-f926-4524-82c8-833f804c9b72" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.050s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:57 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Instance destroyed successfully.
Dec 01 17:26:57 user nova-compute[75745]: DEBUG nova.objects.instance [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lazy-loading 'resources' on Instance uuid a4f614f2-6b6c-4841-8a67-6231a33bd98e {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:24:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-72091441',display_name='tempest-VolumesSnapshotTestJSON-instance-72091441',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-72091441',id=36,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAecSa1/islivxWF7qyrCG39h0nLmAQt2eJT2zFllbykcmefSwqHFIQrhZblqDSEW34R/tMVBvv/Xi60f7bRkR+IgMeD9PRZDHleASo8SRr74pqD85hTWDnm9avOWnmvA==',key_name='tempest-keypair-1821204491',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:24:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c5ee303033640e7adebbc0c949be9cc',ramdisk_id='',reservation_id='r-o00okoy3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1764036907',owner_user_name='tempest-VolumesSnapshotTestJSON-1764036907-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:24:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc207653aa7c407f92a01ba7cfe89572',uuid=a4f614f2-6b6c-4841-8a67-6231a33bd98e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0b6e35c-be93-4ac7-a7ca-2bf50af82eff", "address": "fa:16:3e:b8:34:57", "network": {"id": "ccf83dac-fecd-4f65-baf8-740ff63f51a0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-804694060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5ee303033640e7adebbc0c949be9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0b6e35c-be", "ovs_interfaceid": "b0b6e35c-be93-4ac7-a7ca-2bf50af82eff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Converting VIF {"id": "b0b6e35c-be93-4ac7-a7ca-2bf50af82eff", "address": "fa:16:3e:b8:34:57", "network": {"id": "ccf83dac-fecd-4f65-baf8-740ff63f51a0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-804694060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c5ee303033640e7adebbc0c949be9cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0b6e35c-be", "ovs_interfaceid": "b0b6e35c-be93-4ac7-a7ca-2bf50af82eff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:34:57,bridge_name='br-int',has_traffic_filtering=True,id=b0b6e35c-be93-4ac7-a7ca-2bf50af82eff,network=Network(ccf83dac-fecd-4f65-baf8-740ff63f51a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0b6e35c-be') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG os_vif [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:34:57,bridge_name='br-int',has_traffic_filtering=True,id=b0b6e35c-be93-4ac7-a7ca-2bf50af82eff,network=Network(ccf83dac-fecd-4f65-baf8-740ff63f51a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0b6e35c-be') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0b6e35c-be, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f54aa19-0675-4f0e-82e7-b0ada095c604) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:57 user nova-compute[75745]: INFO os_vif [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:34:57,bridge_name='br-int',has_traffic_filtering=True,id=b0b6e35c-be93-4ac7-a7ca-2bf50af82eff,network=Network(ccf83dac-fecd-4f65-baf8-740ff63f51a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0b6e35c-be')
Dec 01 17:26:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GwfuklmJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:26:57 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:26:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[892c9db2-2acb-4250-b34f-79ae60121cbe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:26:57 user nova-compute[75745]: No targets found.
Dec 01 17:26:57 user nova-compute[75745]: iSNS:
Dec 01 17:26:57 user nova-compute[75745]: No targets found.
Dec 01 17:26:57 user nova-compute[75745]: STATIC:
Dec 01 17:26:57 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df
Dec 01 17:26:57 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:26:57 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:26:57 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0
Dec 01 17:26:57 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:26:57 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:26:57 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740
Dec 01 17:26:57 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:26:57 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:26:57 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476
Dec 01 17:26:57 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:26:57 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:26:57 user nova-compute[75745]: FIRMWARE:
Dec 01 17:26:57 user nova-compute[75745]: No targets found.
Dec 01 17:26:57 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:26:57 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:26:57 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61972f11-f33b-4d82-a4fc-308e6daab4af', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[680b5029-f6d6-4b6a-a699-ac94851cb929]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[edab6ace-93bc-4dcb-b01c-2be497bcb381]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:26:57 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:26:57 user nova-compute[75745]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:26:57 user nova-compute[75745]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 (non-flash)
Dec 01 17:26:57 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:26:57 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:26:57 user nova-compute[75745]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:26:57 user nova-compute[75745]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 (non-flash)
Dec 01 17:26:57 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f249871d360>, {}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Disconnecting from: [] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.132s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] <== disconnect_volume: return (134ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:26:57 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Deleting instance files /opt/stack/data/nova/instances/a4f614f2-6b6c-4841-8a67-6231a33bd98e_del
Dec 01 17:26:57 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Deletion of /opt/stack/data/nova/instances/a4f614f2-6b6c-4841-8a67-6231a33bd98e_del complete
Dec 01 17:26:57 user nova-compute[75745]: INFO nova.compute.manager [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Took 1.13 seconds to destroy the instance on the hypervisor.
Dec 01 17:26:57 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:58 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Error from libvirt while getting description of instance-00000024: [Error Code 42] Domain not found: no domain with matching uuid 'a4f614f2-6b6c-4841-8a67-6231a33bd98e' (instance-00000024): libvirt.libvirtError: Domain not found: no domain with matching uuid 'a4f614f2-6b6c-4841-8a67-6231a33bd98e' (instance-00000024)
Dec 01 17:26:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-fb5e3bf1-818e-4388-a7e6-c55691ec06fa req-19c86b98-a6ff-410a-8045-418f0934fc04 service nova] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Received event network-vif-plugged-b0b6e35c-be93-4ac7-a7ca-2bf50af82eff {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fb5e3bf1-818e-4388-a7e6-c55691ec06fa req-19c86b98-a6ff-410a-8045-418f0934fc04 service nova] Acquiring lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fb5e3bf1-818e-4388-a7e6-c55691ec06fa req-19c86b98-a6ff-410a-8045-418f0934fc04 service nova] Lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fb5e3bf1-818e-4388-a7e6-c55691ec06fa req-19c86b98-a6ff-410a-8045-418f0934fc04 service nova] Lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-fb5e3bf1-818e-4388-a7e6-c55691ec06fa req-19c86b98-a6ff-410a-8045-418f0934fc04 service nova] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] No waiting events found dispatching network-vif-plugged-b0b6e35c-be93-4ac7-a7ca-2bf50af82eff {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:26:58 user nova-compute[75745]: WARNING nova.compute.manager [req-fb5e3bf1-818e-4388-a7e6-c55691ec06fa req-19c86b98-a6ff-410a-8045-418f0934fc04 service nova] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Received unexpected event network-vif-plugged-b0b6e35c-be93-4ac7-a7ca-2bf50af82eff for instance with vm_state active and task_state deleting.
Dec 01 17:26:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-fb5e3bf1-818e-4388-a7e6-c55691ec06fa req-19c86b98-a6ff-410a-8045-418f0934fc04 service nova] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Received event network-vif-plugged-b0b6e35c-be93-4ac7-a7ca-2bf50af82eff {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fb5e3bf1-818e-4388-a7e6-c55691ec06fa req-19c86b98-a6ff-410a-8045-418f0934fc04 service nova] Acquiring lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fb5e3bf1-818e-4388-a7e6-c55691ec06fa req-19c86b98-a6ff-410a-8045-418f0934fc04 service nova] Lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fb5e3bf1-818e-4388-a7e6-c55691ec06fa req-19c86b98-a6ff-410a-8045-418f0934fc04 service nova] Lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-fb5e3bf1-818e-4388-a7e6-c55691ec06fa req-19c86b98-a6ff-410a-8045-418f0934fc04 service nova] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] No waiting events found dispatching network-vif-plugged-b0b6e35c-be93-4ac7-a7ca-2bf50af82eff {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:26:58 user nova-compute[75745]: WARNING nova.compute.manager [req-fb5e3bf1-818e-4388-a7e6-c55691ec06fa req-19c86b98-a6ff-410a-8045-418f0934fc04 service nova] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Received unexpected event network-vif-plugged-b0b6e35c-be93-4ac7-a7ca-2bf50af82eff for instance with vm_state active and task_state deleting.
Dec 01 17:26:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-fb5e3bf1-818e-4388-a7e6-c55691ec06fa req-19c86b98-a6ff-410a-8045-418f0934fc04 service nova] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Received event network-vif-plugged-b0b6e35c-be93-4ac7-a7ca-2bf50af82eff {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fb5e3bf1-818e-4388-a7e6-c55691ec06fa req-19c86b98-a6ff-410a-8045-418f0934fc04 service nova] Acquiring lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fb5e3bf1-818e-4388-a7e6-c55691ec06fa req-19c86b98-a6ff-410a-8045-418f0934fc04 service nova] Lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fb5e3bf1-818e-4388-a7e6-c55691ec06fa req-19c86b98-a6ff-410a-8045-418f0934fc04 service nova] Lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-fb5e3bf1-818e-4388-a7e6-c55691ec06fa req-19c86b98-a6ff-410a-8045-418f0934fc04 service nova] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] No waiting events found dispatching network-vif-plugged-b0b6e35c-be93-4ac7-a7ca-2bf50af82eff {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:26:58 user nova-compute[75745]: WARNING nova.compute.manager [req-fb5e3bf1-818e-4388-a7e6-c55691ec06fa req-19c86b98-a6ff-410a-8045-418f0934fc04 service nova] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Received unexpected event network-vif-plugged-b0b6e35c-be93-4ac7-a7ca-2bf50af82eff for instance with vm_state active and task_state deleting.
Dec 01 17:26:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-fb5e3bf1-818e-4388-a7e6-c55691ec06fa req-19c86b98-a6ff-410a-8045-418f0934fc04 service nova] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Received event network-vif-unplugged-b0b6e35c-be93-4ac7-a7ca-2bf50af82eff {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fb5e3bf1-818e-4388-a7e6-c55691ec06fa req-19c86b98-a6ff-410a-8045-418f0934fc04 service nova] Acquiring lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fb5e3bf1-818e-4388-a7e6-c55691ec06fa req-19c86b98-a6ff-410a-8045-418f0934fc04 service nova] Lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fb5e3bf1-818e-4388-a7e6-c55691ec06fa req-19c86b98-a6ff-410a-8045-418f0934fc04 service nova] Lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-fb5e3bf1-818e-4388-a7e6-c55691ec06fa req-19c86b98-a6ff-410a-8045-418f0934fc04 service nova] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] No waiting events found dispatching network-vif-unplugged-b0b6e35c-be93-4ac7-a7ca-2bf50af82eff {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-fb5e3bf1-818e-4388-a7e6-c55691ec06fa req-19c86b98-a6ff-410a-8045-418f0934fc04 service nova] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Received event network-vif-unplugged-b0b6e35c-be93-4ac7-a7ca-2bf50af82eff for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-fb5e3bf1-818e-4388-a7e6-c55691ec06fa req-19c86b98-a6ff-410a-8045-418f0934fc04 service nova] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Received event network-vif-plugged-b0b6e35c-be93-4ac7-a7ca-2bf50af82eff {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fb5e3bf1-818e-4388-a7e6-c55691ec06fa req-19c86b98-a6ff-410a-8045-418f0934fc04 service nova] Acquiring lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fb5e3bf1-818e-4388-a7e6-c55691ec06fa req-19c86b98-a6ff-410a-8045-418f0934fc04 service nova] Lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fb5e3bf1-818e-4388-a7e6-c55691ec06fa req-19c86b98-a6ff-410a-8045-418f0934fc04 service nova] Lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-fb5e3bf1-818e-4388-a7e6-c55691ec06fa req-19c86b98-a6ff-410a-8045-418f0934fc04 service nova] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] No waiting events found dispatching network-vif-plugged-b0b6e35c-be93-4ac7-a7ca-2bf50af82eff {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:26:58 user nova-compute[75745]: WARNING nova.compute.manager [req-fb5e3bf1-818e-4388-a7e6-c55691ec06fa req-19c86b98-a6ff-410a-8045-418f0934fc04 service nova] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Received unexpected event network-vif-plugged-b0b6e35c-be93-4ac7-a7ca-2bf50af82eff for instance with vm_state active and task_state deleting.
Dec 01 17:26:58 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Took 1.19 seconds to deallocate network for instance.
Dec 01 17:26:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff5eaad-45ab-4a21-bc9b-9ecef436cab0/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:58 user nova-compute[75745]: WARNING nova.volume.cinder [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Attachment 0baa2333-bfd3-49de-a810-22acae4d43a6 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 0baa2333-bfd3-49de-a810-22acae4d43a6. (HTTP 404) (Request-ID: req-4ecf1ee4-8c56-47c3-9f41-c0f266f0a6c1)
Dec 01 17:26:58 user nova-compute[75745]: INFO nova.compute.manager [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Took 0.06 seconds to detach 1 volumes for instance.
Dec 01 17:26:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:26:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:26:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff5eaad-45ab-4a21-bc9b-9ecef436cab0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff5eaad-45ab-4a21-bc9b-9ecef436cab0/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:59 user nova-compute[75745]: DEBUG nova.compute.manager [req-47fd23ed-e140-46a9-aefe-c078f00fcaa1 req-60e8feaf-0e50-4223-a80e-5747ba2e99c3 service nova] [instance: a4f614f2-6b6c-4841-8a67-6231a33bd98e] Received event network-vif-deleted-b0b6e35c-be93-4ac7-a7ca-2bf50af82eff {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:26:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff5eaad-45ab-4a21-bc9b-9ecef436cab0/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:26:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:59 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:26:59 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:26:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:26:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:26:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.526s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:59 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Deleted allocations for instance a4f614f2-6b6c-4841-8a67-6231a33bd98e
Dec 01 17:26:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-77927119-967f-4eb6-b90a-94dd307a67a4 tempest-VolumesSnapshotTestJSON-1764036907 tempest-VolumesSnapshotTestJSON-1764036907-project-member] Lock "a4f614f2-6b6c-4841-8a67-6231a33bd98e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.154s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:26:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:27:00 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:27:00 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:27:00 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=7664MB free_disk=25.06952667236328GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:27:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:27:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:27:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:27:00 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance d997cdd6-67c6-4263-814a-17cf9e27bbeb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:27:00 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance e4ffb96e-456c-4fb9-9850-9e98310d63e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:27:00 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 80962f79-dbb2-4380-b2c8-791642cfa86b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:27:00 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 5e631ac3-8122-46a3-a54f-2395c0f7cf7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:27:00 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 5aee52eb-78e3-4f60-a920-7ade912735e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:27:00 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance c358f18c-44c4-45d4-a1eb-4f259c36a0d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:27:00 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance b26b6ef1-7a8b-4628-8cc1-d27cc27efcac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:27:00 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:27:00 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:27:00 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 61e0e19b-f926-4524-82c8-833f804c9b72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:27:00 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:27:00 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:27:00 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:27:00 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:27:00 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:27:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.454s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:27:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:27:02 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:27:02 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:27:02 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:27:02 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:27:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:27:05 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:27:05 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:27:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-80962f79-dbb2-4380-b2c8-791642cfa86b" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:27:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-80962f79-dbb2-4380-b2c8-791642cfa86b" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:27:05 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:27:06 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Updating instance_info_cache with network_info: [{"id": "68718048-8e77-438b-a7e0-15675cc9e543", "address": "fa:16:3e:bf:09:08", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68718048-8e", "ovs_interfaceid": "68718048-8e77-438b-a7e0-15675cc9e543", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:27:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-80962f79-dbb2-4380-b2c8-791642cfa86b" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:27:06 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:27:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:27:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:27:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:27:17 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:27:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:27:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:27:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:27:27 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:27:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:27:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:27:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:27:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:27:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:27:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:27:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:27:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:27:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:27:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:27:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:27:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:27:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:27:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:27:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:27:50 user nova-compute[75745]: DEBUG nova.compute.manager [req-b8cfd17f-ff80-4d39-9a58-34dbec64b52d req-79195924-de83-458d-9988-91bea0de5559 service nova] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Received event network-changed-66185694-ac7f-4baa-9c61-6d19fd57ac5a {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:27:50 user nova-compute[75745]: DEBUG nova.compute.manager [req-b8cfd17f-ff80-4d39-9a58-34dbec64b52d req-79195924-de83-458d-9988-91bea0de5559 service nova] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Refreshing instance network info cache due to event network-changed-66185694-ac7f-4baa-9c61-6d19fd57ac5a. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:27:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b8cfd17f-ff80-4d39-9a58-34dbec64b52d req-79195924-de83-458d-9988-91bea0de5559 service nova] Acquiring lock "refresh_cache-9ff5eaad-45ab-4a21-bc9b-9ecef436cab0" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:27:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b8cfd17f-ff80-4d39-9a58-34dbec64b52d req-79195924-de83-458d-9988-91bea0de5559 service nova] Acquired lock "refresh_cache-9ff5eaad-45ab-4a21-bc9b-9ecef436cab0" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:27:50 user nova-compute[75745]: DEBUG nova.network.neutron [req-b8cfd17f-ff80-4d39-9a58-34dbec64b52d req-79195924-de83-458d-9988-91bea0de5559 service nova] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Refreshing network info cache for port 66185694-ac7f-4baa-9c61-6d19fd57ac5a {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:27:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:27:50 user nova-compute[75745]: DEBUG nova.network.neutron [req-b8cfd17f-ff80-4d39-9a58-34dbec64b52d req-79195924-de83-458d-9988-91bea0de5559 service nova] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Updated VIF entry in instance network info cache for port 66185694-ac7f-4baa-9c61-6d19fd57ac5a. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:27:50 user nova-compute[75745]: DEBUG nova.network.neutron [req-b8cfd17f-ff80-4d39-9a58-34dbec64b52d req-79195924-de83-458d-9988-91bea0de5559 service nova] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Updating instance_info_cache with network_info: [{"id": "66185694-ac7f-4baa-9c61-6d19fd57ac5a", "address": "fa:16:3e:14:45:fc", "network": {"id": "a4801184-db1f-4acf-8cb8-5e26d3c01c33", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2001575939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3244f1ca511a4c28809d26a694c45ee1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66185694-ac", "ovs_interfaceid": "66185694-ac7f-4baa-9c61-6d19fd57ac5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:27:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b8cfd17f-ff80-4d39-9a58-34dbec64b52d req-79195924-de83-458d-9988-91bea0de5559 service nova] Releasing lock "refresh_cache-9ff5eaad-45ab-4a21-bc9b-9ecef436cab0" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:27:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Acquiring lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:27:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:27:50 user nova-compute[75745]: DEBUG nova.objects.instance [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lazy-loading 'flavor' on Instance uuid 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:27:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:27:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Acquiring lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:27:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:27:51 user nova-compute[75745]: INFO nova.compute.manager [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Attaching volume 4ca052d1-7350-48c8-a723-4e46c2cb7070 to /dev/vdb
Dec 01 17:27:51 user nova-compute[75745]: DEBUG os_brick.utils [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:27:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:27:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:27:51 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[07776622-6185-4263-83fc-a81895732fa8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:27:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:27:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:27:51 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a143bed5-db9a-4fc7-b1c3-52920f950415]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:27:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:27:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:27:51 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7589e146-9d44-459a-8f3f-b182745a69be]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:27:51 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50eb5de-515a-45d2-8018-0ea8b0223160]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:27:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:27:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:27:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:27:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:27:51 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:27:51 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:27:51 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f8385f-29ee-4614-a54b-bbb951431636]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:27:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:27:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:27:51 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:27:51 user nova-compute[75745]: DEBUG os_brick.utils [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:27:51 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Updating existing volume attachment record: 809c0405-5d7c-4b52-8266-61221d6c7464 {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:27:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:27:54 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:27:54 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:27:54 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:27:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:27:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:27:57 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:27:57 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:27:57 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:27:57 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:27:57 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:27:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:27:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:27:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:27:57 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:27:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:27:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:27:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:27:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:27:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:27:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:27:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:27:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:27:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:27:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:27:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:27:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:27:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:27:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:27:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:27:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:27:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:27:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:27:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:27:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QbhajuSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:28:00 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:28:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:28:00 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:28:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:28:00 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c685eec7-3e83-40db-a921-a9f676e9bf9e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:28:00 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace068ba-d4ad-4435-b843-87d0c3ab23c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070] added
Dec 01 17:28:00 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b58543-d597-4fde-85fd-f7efed97b742]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e9bd9d-b799-4e1c-a2fa-1968c9c53fde]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QbhajuSs {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QbhajuSs" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8fb6e2-b3b5-41f6-b0fe-31e09dd4f747]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QbhajuSs'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[477b8b2a-934d-4b98-bc09-a8333fdc1a2c]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd3b625-e0ef-435b-99f0-29fee432e790]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:28:00 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:28:00 user nova-compute[75745]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:28:00 user nova-compute[75745]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 (non-flash)
Dec 01 17:28:00 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:28:00 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:28:00 user nova-compute[75745]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:28:00 user nova-compute[75745]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 (non-flash)
Dec 01 17:28:00 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89608a7-e0a2-45e3-b069-1ff258e1c1fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070, portal: 172.16.0.220,3260]
Dec 01 17:28:00 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070, portal: 172.16.0.220,3260] successful.
Dec 01 17:28:00 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e421e603-33bd-490a-97dd-d2976e9be920]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a39db7-0ba9-4b4f-91a6-c4d249d32e2b]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:28:00 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:28:00 user nova-compute[75745]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:28:00 user nova-compute[75745]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 (non-flash)
Dec 01 17:28:00 user nova-compute[75745]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 (non-flash)
Dec 01 17:28:00 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:28:00 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:28:00 user nova-compute[75745]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:28:00 user nova-compute[75745]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 (non-flash)
Dec 01 17:28:00 user nova-compute[75745]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 (non-flash)
Dec 01 17:28:00 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] HCTL ('37', '-', '-', 0) found on session 43 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c912b3-5ec8-4121-b49a-90c4011f352f]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Searching for a device in session 43 and hctl ['37', '*', '*', 0] yield: None {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff5eaad-45ab-4a21-bc9b-9ecef436cab0/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff5eaad-45ab-4a21-bc9b-9ecef436cab0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff5eaad-45ab-4a21-bc9b-9ecef436cab0/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff5eaad-45ab-4a21-bc9b-9ecef436cab0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:01 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:28:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:01 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Searching for a device in session 43 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:28:01 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QbhajuSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:28:01 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.608s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:28:01 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] <== connect_volume: return (1610ms) {'type': 'block', 'scsi_wwn': '26435643563666131', 'path': '/dev/sdf'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:28:01 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435643563666131', 'path': '/dev/sdf'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:28:01 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:28:01 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:28:01 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=7830MB free_disk=25.06731414794922GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:28:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:28:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:28:01 user nova-compute[75745]: DEBUG nova.objects.instance [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lazy-loading 'flavor' on Instance uuid 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:28:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 17:28:02 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:28:02 user nova-compute[75745]:   <source dev="/dev/sdf"/>
Dec 01 17:28:02 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:28:02 user nova-compute[75745]:   <serial>4ca052d1-7350-48c8-a723-4e46c2cb7070</serial>
Dec 01 17:28:02 user nova-compute[75745]: </disk>
Dec 01 17:28:02 user nova-compute[75745]:  {{(pid=75745) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 17:28:02 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance d997cdd6-67c6-4263-814a-17cf9e27bbeb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:28:02 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance e4ffb96e-456c-4fb9-9850-9e98310d63e5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:28:02 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 80962f79-dbb2-4380-b2c8-791642cfa86b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:28:02 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 5e631ac3-8122-46a3-a54f-2395c0f7cf7c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:28:02 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 5aee52eb-78e3-4f60-a920-7ade912735e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:28:02 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance c358f18c-44c4-45d4-a1eb-4f259c36a0d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:28:02 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance b26b6ef1-7a8b-4628-8cc1-d27cc27efcac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:28:02 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:28:02 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:28:02 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 61e0e19b-f926-4524-82c8-833f804c9b72 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:28:02 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:28:02 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:28:02 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Refreshing inventories for resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 01 17:28:02 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Updating ProviderTree inventory for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 01 17:28:02 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Updating inventory in ProviderTree for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 01 17:28:02 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Refreshing aggregate associations for resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9, aggregates: None {{(pid=75745) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 01 17:28:02 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Refreshing trait associations for resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9, traits: COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=75745) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 01 17:28:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:28:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:28:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] No VIF found with MAC fa:16:3e:14:45:fc, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:28:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-bc920290-c0b5-4209-9880-9841b8340e6b tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.501s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:28:02 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:28:02 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:28:02 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:28:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.726s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:28:04 user nova-compute[75745]: DEBUG nova.compute.manager [req-a2357f83-5c59-485e-925f-6f6adaf996f3 req-37c992ec-3080-4810-b1fe-d213aa43cac4 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Received event network-changed-fff6dabe-5df3-4db0-85cb-6dce98f4b953 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:28:04 user nova-compute[75745]: DEBUG nova.compute.manager [req-a2357f83-5c59-485e-925f-6f6adaf996f3 req-37c992ec-3080-4810-b1fe-d213aa43cac4 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Refreshing instance network info cache due to event network-changed-fff6dabe-5df3-4db0-85cb-6dce98f4b953. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:28:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a2357f83-5c59-485e-925f-6f6adaf996f3 req-37c992ec-3080-4810-b1fe-d213aa43cac4 service nova] Acquiring lock "refresh_cache-b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:28:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a2357f83-5c59-485e-925f-6f6adaf996f3 req-37c992ec-3080-4810-b1fe-d213aa43cac4 service nova] Acquired lock "refresh_cache-b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:28:04 user nova-compute[75745]: DEBUG nova.network.neutron [req-a2357f83-5c59-485e-925f-6f6adaf996f3 req-37c992ec-3080-4810-b1fe-d213aa43cac4 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Refreshing network info cache for port fff6dabe-5df3-4db0-85cb-6dce98f4b953 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:28:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:05 user nova-compute[75745]: DEBUG nova.network.neutron [req-a2357f83-5c59-485e-925f-6f6adaf996f3 req-37c992ec-3080-4810-b1fe-d213aa43cac4 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Updated VIF entry in instance network info cache for port fff6dabe-5df3-4db0-85cb-6dce98f4b953. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:28:05 user nova-compute[75745]: DEBUG nova.network.neutron [req-a2357f83-5c59-485e-925f-6f6adaf996f3 req-37c992ec-3080-4810-b1fe-d213aa43cac4 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Updating instance_info_cache with network_info: [{"id": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "address": "fa:16:3e:71:7f:4a", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff6dabe-5d", "ovs_interfaceid": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:28:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a2357f83-5c59-485e-925f-6f6adaf996f3 req-37c992ec-3080-4810-b1fe-d213aa43cac4 service nova] Releasing lock "refresh_cache-b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:28:05 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:28:05 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:28:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:28:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:28:05 user nova-compute[75745]: INFO nova.compute.manager [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Detaching volume 0034af46-f9e8-4df6-a432-b9409f910476
Dec 01 17:28:05 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:28:05 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:28:05 user nova-compute[75745]: INFO nova.virt.block_device [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Attempting to driver detach volume 0034af46-f9e8-4df6-a432-b9409f910476 from mountpoint /dev/vdb
Dec 01 17:28:05 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Attempting to detach device vdb from instance b26b6ef1-7a8b-4628-8cc1-d27cc27efcac from the persistent domain config. {{(pid=75745) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 17:28:05 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:28:05 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:28:05 user nova-compute[75745]:   <source dev="/dev/sde"/>
Dec 01 17:28:05 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:28:05 user nova-compute[75745]:   <serial>0034af46-f9e8-4df6-a432-b9409f910476</serial>
Dec 01 17:28:05 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 01 17:28:05 user nova-compute[75745]: </disk>
Dec 01 17:28:05 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:28:05 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Successfully detached device vdb from instance b26b6ef1-7a8b-4628-8cc1-d27cc27efcac from the persistent domain config.
Dec 01 17:28:05 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b26b6ef1-7a8b-4628-8cc1-d27cc27efcac from the live domain config. {{(pid=75745) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 17:28:05 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:28:05 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:28:05 user nova-compute[75745]:   <source dev="/dev/sde"/>
Dec 01 17:28:05 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:28:05 user nova-compute[75745]:   <serial>0034af46-f9e8-4df6-a432-b9409f910476</serial>
Dec 01 17:28:05 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 01 17:28:05 user nova-compute[75745]: </disk>
Dec 01 17:28:05 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:28:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-5e631ac3-8122-46a3-a54f-2395c0f7cf7c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:28:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-5e631ac3-8122-46a3-a54f-2395c0f7cf7c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:28:05 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:28:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Acquiring lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:28:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:28:06 user nova-compute[75745]: DEBUG nova.objects.instance [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lazy-loading 'flavor' on Instance uuid 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:28:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:28:06 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b26b6ef1-7a8b-4628-8cc1-d27cc27efcac {{(pid=75745) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 17:28:06 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Updating instance_info_cache with network_info: [{"id": "7239781d-a3ed-42f7-a30b-d8e5410bc622", "address": "fa:16:3e:0a:8d:a9", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7239781d-a3", "ovs_interfaceid": "7239781d-a3ed-42f7-a30b-d8e5410bc622", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:28:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Acquiring lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:28:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:28:06 user nova-compute[75745]: INFO nova.compute.manager [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Attaching volume 16e9f432-84e1-4182-a318-447327c7ce47 to /dev/vdc
Dec 01 17:28:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-5e631ac3-8122-46a3-a54f-2395c0f7cf7c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:28:06 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:28:06 user nova-compute[75745]: DEBUG os_brick.utils [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:28:06 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:06 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:06 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea68fe01-d66d-4f25-9488-e449bb2d4a4b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:06 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:06 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:06 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a841cd-8233-4811-a568-a16c4d506e52]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:06 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:06 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:06 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a44ef9-f7d0-4ab9-a259-33ee7b3d9253]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:06 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d762923-e471-4a21-8f08-57fc0297b823]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:06 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:06 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:28:06 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:28:06 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:06 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:28:06 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:28:06 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9984a6f5-ea45-4ef0-800e-36de3367a4b7]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:06 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:28:06 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:28:06 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:28:06 user nova-compute[75745]: DEBUG os_brick.utils [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:28:06 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Updating existing volume attachment record: dc409280-c014-4573-8e3f-bc9d5ec6d6d4 {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:28:06 user nova-compute[75745]: DEBUG nova.compute.manager [req-1b58254a-d0e1-46f7-8610-2f61b3fe5c1c req-49a3835e-ce9b-4d04-aace-d1e2c63d2bf8 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Received event network-changed-fff6dabe-5df3-4db0-85cb-6dce98f4b953 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:28:06 user nova-compute[75745]: DEBUG nova.compute.manager [req-1b58254a-d0e1-46f7-8610-2f61b3fe5c1c req-49a3835e-ce9b-4d04-aace-d1e2c63d2bf8 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Refreshing instance network info cache due to event network-changed-fff6dabe-5df3-4db0-85cb-6dce98f4b953. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:28:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1b58254a-d0e1-46f7-8610-2f61b3fe5c1c req-49a3835e-ce9b-4d04-aace-d1e2c63d2bf8 service nova] Acquiring lock "refresh_cache-b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:28:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1b58254a-d0e1-46f7-8610-2f61b3fe5c1c req-49a3835e-ce9b-4d04-aace-d1e2c63d2bf8 service nova] Acquired lock "refresh_cache-b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:28:06 user nova-compute[75745]: DEBUG nova.network.neutron [req-1b58254a-d0e1-46f7-8610-2f61b3fe5c1c req-49a3835e-ce9b-4d04-aace-d1e2c63d2bf8 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Refreshing network info cache for port fff6dabe-5df3-4db0-85cb-6dce98f4b953 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:28:07 user nova-compute[75745]: DEBUG nova.network.neutron [req-1b58254a-d0e1-46f7-8610-2f61b3fe5c1c req-49a3835e-ce9b-4d04-aace-d1e2c63d2bf8 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Updated VIF entry in instance network info cache for port fff6dabe-5df3-4db0-85cb-6dce98f4b953. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:28:07 user nova-compute[75745]: DEBUG nova.network.neutron [req-1b58254a-d0e1-46f7-8610-2f61b3fe5c1c req-49a3835e-ce9b-4d04-aace-d1e2c63d2bf8 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Updating instance_info_cache with network_info: [{"id": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "address": "fa:16:3e:71:7f:4a", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff6dabe-5d", "ovs_interfaceid": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:28:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1b58254a-d0e1-46f7-8610-2f61b3fe5c1c req-49a3835e-ce9b-4d04-aace-d1e2c63d2bf8 service nova] Releasing lock "refresh_cache-b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:28:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xdytmZcW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:28:16 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:28:16 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:28:16 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:28:16 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:28:16 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:28:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcc9ff0-c542-4dbd-b0e6-87f65b0847a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:28:16 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbe04bd-b39b-4933-bf08-7c0c08904300]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47] added
Dec 01 17:28:16 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a287034d-46c8-4113-ace8-912155261d7d]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b25eaf4-2386-4f5b-b6fe-d567b305d3e7]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xdytmZcW {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xdytmZcW" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee373c3-a054-4c2e-8df3-4d21e0ab34b6]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xdytmZcW'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5624cb6e-edd2-40d2-8f12-603062334b49]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9623100e-3bd5-4448-850d-6bfc4a00e717]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:28:16 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:28:16 user nova-compute[75745]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:28:16 user nova-compute[75745]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 (non-flash)
Dec 01 17:28:16 user nova-compute[75745]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 (non-flash)
Dec 01 17:28:16 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:28:16 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:28:16 user nova-compute[75745]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:28:16 user nova-compute[75745]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 (non-flash)
Dec 01 17:28:16 user nova-compute[75745]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 (non-flash)
Dec 01 17:28:16 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6039ddec-4fdc-4f68-ae2d-6d15858649a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47, portal: 172.16.0.220,3260]
Dec 01 17:28:16 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47, portal: 172.16.0.220,3260] successful.
Dec 01 17:28:16 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0dc3db-631d-4036-8f0e-0933d007de5d]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b046345-7eeb-4d00-ad98-c054899fcd29]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:28:16 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:28:16 user nova-compute[75745]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:28:16 user nova-compute[75745]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 (non-flash)
Dec 01 17:28:16 user nova-compute[75745]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 (non-flash)
Dec 01 17:28:16 user nova-compute[75745]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47 (non-flash)
Dec 01 17:28:16 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:28:16 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:28:16 user nova-compute[75745]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:28:16 user nova-compute[75745]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 (non-flash)
Dec 01 17:28:16 user nova-compute[75745]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 (non-flash)
Dec 01 17:28:16 user nova-compute[75745]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47 (non-flash)
Dec 01 17:28:16 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] HCTL ('38', '-', '-', 0) found on session 44 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16daec6-9634-4d0b-99e2-3b686a2b82ec]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Searching for a device in session 44 and hctl ['38', '*', '*', 0] yield: None {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:28:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:17 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:17 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:17 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Searching for a device in session 44 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:28:17 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xdytmZcW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:28:17 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:28:17 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23838346330353438', 'path': '/dev/sdg'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:28:17 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838346330353438', 'path': '/dev/sdg'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:28:17 user nova-compute[75745]: DEBUG nova.objects.instance [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lazy-loading 'flavor' on Instance uuid 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:28:17 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 17:28:17 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:28:17 user nova-compute[75745]:   <source dev="/dev/sdg"/>
Dec 01 17:28:17 user nova-compute[75745]:   <target dev="vdc" bus="virtio"/>
Dec 01 17:28:17 user nova-compute[75745]:   <serial>16e9f432-84e1-4182-a318-447327c7ce47</serial>
Dec 01 17:28:17 user nova-compute[75745]: </disk>
Dec 01 17:28:17 user nova-compute[75745]:  {{(pid=75745) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 17:28:18 user nova-compute[75745]: INFO nova.compute.manager [None req-08c34568-095f-41fe-a685-f5fe69587623 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Get console output
Dec 01 17:28:18 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:28:18 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:28:18 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:28:18 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] No VIF found with MAC fa:16:3e:14:45:fc, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:28:18 user nova-compute[75745]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Dec 01 17:28:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-519de5cc-37f1-444c-b915-e50fbe3722d0 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.848s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:28:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Acquiring lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:28:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:28:19 user nova-compute[75745]: INFO nova.compute.manager [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Detaching volume 16e9f432-84e1-4182-a318-447327c7ce47
Dec 01 17:28:19 user nova-compute[75745]: INFO nova.virt.block_device [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Attempting to driver detach volume 16e9f432-84e1-4182-a318-447327c7ce47 from mountpoint /dev/vdc
Dec 01 17:28:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Attempting to detach device vdc from instance 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0 from the persistent domain config. {{(pid=75745) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 17:28:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:28:19 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:28:19 user nova-compute[75745]:   <source dev="/dev/sdg"/>
Dec 01 17:28:19 user nova-compute[75745]:   <target dev="vdc" bus="virtio"/>
Dec 01 17:28:19 user nova-compute[75745]:   <serial>16e9f432-84e1-4182-a318-447327c7ce47</serial>
Dec 01 17:28:19 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 01 17:28:19 user nova-compute[75745]: </disk>
Dec 01 17:28:19 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:28:19 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Successfully detached device vdc from instance 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0 from the persistent domain config.
Dec 01 17:28:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0 from the live domain config. {{(pid=75745) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 17:28:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:28:19 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:28:19 user nova-compute[75745]:   <source dev="/dev/sdg"/>
Dec 01 17:28:19 user nova-compute[75745]:   <target dev="vdc" bus="virtio"/>
Dec 01 17:28:19 user nova-compute[75745]:   <serial>16e9f432-84e1-4182-a318-447327c7ce47</serial>
Dec 01 17:28:19 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 01 17:28:19 user nova-compute[75745]: </disk>
Dec 01 17:28:19 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:28:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0 {{(pid=75745) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 17:28:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:24 user nova-compute[75745]: DEBUG nova.compute.manager [req-a80e33ca-68b8-46db-a177-f11e8bc5c097 req-d00422f9-5334-49b0-b6dc-291656a3bd23 service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Received event network-changed-d4c74908-1bd2-4891-b4d7-932d73d78217 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:28:24 user nova-compute[75745]: DEBUG nova.compute.manager [req-a80e33ca-68b8-46db-a177-f11e8bc5c097 req-d00422f9-5334-49b0-b6dc-291656a3bd23 service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Refreshing instance network info cache due to event network-changed-d4c74908-1bd2-4891-b4d7-932d73d78217. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:28:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a80e33ca-68b8-46db-a177-f11e8bc5c097 req-d00422f9-5334-49b0-b6dc-291656a3bd23 service nova] Acquiring lock "refresh_cache-c358f18c-44c4-45d4-a1eb-4f259c36a0d9" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:28:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a80e33ca-68b8-46db-a177-f11e8bc5c097 req-d00422f9-5334-49b0-b6dc-291656a3bd23 service nova] Acquired lock "refresh_cache-c358f18c-44c4-45d4-a1eb-4f259c36a0d9" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:28:24 user nova-compute[75745]: DEBUG nova.network.neutron [req-a80e33ca-68b8-46db-a177-f11e8bc5c097 req-d00422f9-5334-49b0-b6dc-291656a3bd23 service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Refreshing network info cache for port d4c74908-1bd2-4891-b4d7-932d73d78217 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:28:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:28:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:28:24 user nova-compute[75745]: INFO nova.compute.manager [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Detaching volume c1bb7743-921b-4683-97c5-13a2e3832740
Dec 01 17:28:25 user nova-compute[75745]: INFO nova.virt.block_device [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Attempting to driver detach volume c1bb7743-921b-4683-97c5-13a2e3832740 from mountpoint /dev/vdb
Dec 01 17:28:25 user nova-compute[75745]: DEBUG nova.network.neutron [req-a80e33ca-68b8-46db-a177-f11e8bc5c097 req-d00422f9-5334-49b0-b6dc-291656a3bd23 service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Updated VIF entry in instance network info cache for port d4c74908-1bd2-4891-b4d7-932d73d78217. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:28:25 user nova-compute[75745]: DEBUG nova.network.neutron [req-a80e33ca-68b8-46db-a177-f11e8bc5c097 req-d00422f9-5334-49b0-b6dc-291656a3bd23 service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Updating instance_info_cache with network_info: [{"id": "d4c74908-1bd2-4891-b4d7-932d73d78217", "address": "fa:16:3e:f0:97:04", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c74908-1b", "ovs_interfaceid": "d4c74908-1bd2-4891-b4d7-932d73d78217", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:28:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Attempting to detach device vdb from instance c358f18c-44c4-45d4-a1eb-4f259c36a0d9 from the persistent domain config. {{(pid=75745) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 17:28:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:28:25 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:28:25 user nova-compute[75745]:   <source dev="/dev/sdc"/>
Dec 01 17:28:25 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:28:25 user nova-compute[75745]:   <serial>c1bb7743-921b-4683-97c5-13a2e3832740</serial>
Dec 01 17:28:25 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 17:28:25 user nova-compute[75745]: </disk>
Dec 01 17:28:25 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:28:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a80e33ca-68b8-46db-a177-f11e8bc5c097 req-d00422f9-5334-49b0-b6dc-291656a3bd23 service nova] Releasing lock "refresh_cache-c358f18c-44c4-45d4-a1eb-4f259c36a0d9" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:28:25 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Successfully detached device vdb from instance c358f18c-44c4-45d4-a1eb-4f259c36a0d9 from the persistent domain config.
Dec 01 17:28:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c358f18c-44c4-45d4-a1eb-4f259c36a0d9 from the live domain config. {{(pid=75745) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 17:28:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:28:25 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:28:25 user nova-compute[75745]:   <source dev="/dev/sdc"/>
Dec 01 17:28:25 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:28:25 user nova-compute[75745]:   <serial>c1bb7743-921b-4683-97c5-13a2e3832740</serial>
Dec 01 17:28:25 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 17:28:25 user nova-compute[75745]: </disk>
Dec 01 17:28:25 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:28:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c358f18c-44c4-45d4-a1eb-4f259c36a0d9 {{(pid=75745) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 17:28:26 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b26b6ef1-7a8b-4628-8cc1-d27cc27efcac is timed out.
Dec 01 17:28:26 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Successfully detached device vdb from instance b26b6ef1-7a8b-4628-8cc1-d27cc27efcac from the live domain config.
Dec 01 17:28:26 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNALjSUi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:28:26 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:28:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8344aca6-a795-4045-b4b3-e933fbecf359]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:28:26 user nova-compute[75745]: No targets found.
Dec 01 17:28:26 user nova-compute[75745]: iSNS:
Dec 01 17:28:26 user nova-compute[75745]: No targets found.
Dec 01 17:28:26 user nova-compute[75745]: STATIC:
Dec 01 17:28:26 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47
Dec 01 17:28:26 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:28:26 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:28:26 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df
Dec 01 17:28:26 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:28:26 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:28:26 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0
Dec 01 17:28:26 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:28:26 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:28:26 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740
Dec 01 17:28:26 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:28:26 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:28:26 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476
Dec 01 17:28:26 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:28:26 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:28:26 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070
Dec 01 17:28:26 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:28:26 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:28:26 user nova-compute[75745]: FIRMWARE:
Dec 01 17:28:26 user nova-compute[75745]: No targets found.
Dec 01 17:28:26 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:28:26 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:28:26 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c176222-26b1-4315-8bcc-baed4d6be921]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2917594-98b1-42ba-83f3-8caece5439cd]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:28:26 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:28:26 user nova-compute[75745]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:28:26 user nova-compute[75745]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 (non-flash)
Dec 01 17:28:26 user nova-compute[75745]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 (non-flash)
Dec 01 17:28:26 user nova-compute[75745]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47 (non-flash)
Dec 01 17:28:26 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:28:26 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:28:26 user nova-compute[75745]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:28:26 user nova-compute[75745]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 (non-flash)
Dec 01 17:28:26 user nova-compute[75745]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 (non-flash)
Dec 01 17:28:26 user nova-compute[75745]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47 (non-flash)
Dec 01 17:28:26 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b87de560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476'): ({'sde'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Removing single pathed devices sde {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7632b4f8-eb51-497e-a228-8d7cf6d99fdd]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2880968b-29f6-449f-af31-7549e397e50a]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Flushing IO for device /dev/sde {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[93666c26-acf6-4b8b-8e98-b1dfe608b7e4]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d1c56b-32d2-458d-aaf1-a7c59be78158]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] SCSI volumes sde have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e955910-fd24-49a5-8ed5-b3d6594f9a35]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[12611bb5-81cd-45bf-baac-85f87ccdfcb6]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476, portal: 172.16.0.220,3260]
Dec 01 17:28:26 user nova-compute[75745]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476, portal: 172.16.0.220,3260] successful.
Dec 01 17:28:26 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG nova.compute.manager [req-10a6d327-0f46-4d21-bf66-a7538e99b336 req-190f978b-8f16-41ae-bd60-5191ddbeb7c2 service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Received event network-changed-d4c74908-1bd2-4891-b4d7-932d73d78217 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG nova.compute.manager [req-10a6d327-0f46-4d21-bf66-a7538e99b336 req-190f978b-8f16-41ae-bd60-5191ddbeb7c2 service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Refreshing instance network info cache due to event network-changed-d4c74908-1bd2-4891-b4d7-932d73d78217. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-10a6d327-0f46-4d21-bf66-a7538e99b336 req-190f978b-8f16-41ae-bd60-5191ddbeb7c2 service nova] Acquiring lock "refresh_cache-c358f18c-44c4-45d4-a1eb-4f259c36a0d9" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-10a6d327-0f46-4d21-bf66-a7538e99b336 req-190f978b-8f16-41ae-bd60-5191ddbeb7c2 service nova] Acquired lock "refresh_cache-c358f18c-44c4-45d4-a1eb-4f259c36a0d9" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG nova.network.neutron [req-10a6d327-0f46-4d21-bf66-a7538e99b336 req-190f978b-8f16-41ae-bd60-5191ddbeb7c2 service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Refreshing network info cache for port d4c74908-1bd2-4891-b4d7-932d73d78217 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0034af46-f9e8-4df6-a432-b9409f910476 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8fdeda-80c2-4b63-8b18-b443936fbb81]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] <== disconnect_volume: return (332ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:28:26 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:28:27 user nova-compute[75745]: DEBUG nova.network.neutron [req-10a6d327-0f46-4d21-bf66-a7538e99b336 req-190f978b-8f16-41ae-bd60-5191ddbeb7c2 service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Updated VIF entry in instance network info cache for port d4c74908-1bd2-4891-b4d7-932d73d78217. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:28:27 user nova-compute[75745]: DEBUG nova.network.neutron [req-10a6d327-0f46-4d21-bf66-a7538e99b336 req-190f978b-8f16-41ae-bd60-5191ddbeb7c2 service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Updating instance_info_cache with network_info: [{"id": "d4c74908-1bd2-4891-b4d7-932d73d78217", "address": "fa:16:3e:f0:97:04", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c74908-1b", "ovs_interfaceid": "d4c74908-1bd2-4891-b4d7-932d73d78217", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:28:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-10a6d327-0f46-4d21-bf66-a7538e99b336 req-190f978b-8f16-41ae-bd60-5191ddbeb7c2 service nova] Releasing lock "refresh_cache-c358f18c-44c4-45d4-a1eb-4f259c36a0d9" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:28:27 user nova-compute[75745]: DEBUG nova.objects.instance [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lazy-loading 'flavor' on Instance uuid b26b6ef1-7a8b-4628-8cc1-d27cc27efcac {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:28:27 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-113dbd24-1852-4d30-9a1f-39796d045afc tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.711s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:28:28 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Acquiring lock "31824d74-830c-4feb-ae7c-d68f23cc3a07" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:28:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Lock "31824d74-830c-4feb-ae7c-d68f23cc3a07" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:28:33 user nova-compute[75745]: DEBUG nova.compute.manager [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:28:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:28:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:28:33 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:28:33 user nova-compute[75745]: INFO nova.compute.claims [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Claim successful on node user
Dec 01 17:28:34 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:28:34 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:28:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:28:34 user nova-compute[75745]: DEBUG nova.compute.manager [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:28:34 user nova-compute[75745]: DEBUG nova.compute.manager [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:28:34 user nova-compute[75745]: DEBUG nova.network.neutron [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:28:34 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:28:34 user nova-compute[75745]: DEBUG nova.compute.manager [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:28:34 user nova-compute[75745]: DEBUG nova.policy [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0d492075e3d4171a9af5087c8eb8d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461ab72f35b4ebb995e9b602935c5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:28:34 user nova-compute[75745]: DEBUG nova.compute.manager [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:28:34 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:28:34 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Creating image(s)
Dec 01 17:28:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Acquiring lock "/opt/stack/data/nova/instances/31824d74-830c-4feb-ae7c-d68f23cc3a07/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:28:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Lock "/opt/stack/data/nova/instances/31824d74-830c-4feb-ae7c-d68f23cc3a07/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:28:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Lock "/opt/stack/data/nova/instances/31824d74-830c-4feb-ae7c-d68f23cc3a07/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:28:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.192s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:28:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:28:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.179s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/31824d74-830c-4feb-ae7c-d68f23cc3a07/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/31824d74-830c-4feb-ae7c-d68f23cc3a07/disk 1073741824" returned: 0 in 0.059s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:28:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:34 user nova-compute[75745]: DEBUG nova.network.neutron [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Successfully created port: 09845821-08f0-4128-9221-15dccf9de944 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.219s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Checking if we can resize image /opt/stack/data/nova/instances/31824d74-830c-4feb-ae7c-d68f23cc3a07/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31824d74-830c-4feb-ae7c-d68f23cc3a07/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31824d74-830c-4feb-ae7c-d68f23cc3a07/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Cannot resize image /opt/stack/data/nova/instances/31824d74-830c-4feb-ae7c-d68f23cc3a07/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Ensure instance console log exists: /opt/stack/data/nova/instances/31824d74-830c-4feb-ae7c-d68f23cc3a07/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG nova.network.neutron [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Successfully updated port: 09845821-08f0-4128-9221-15dccf9de944 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Acquiring lock "refresh_cache-31824d74-830c-4feb-ae7c-d68f23cc3a07" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Acquired lock "refresh_cache-31824d74-830c-4feb-ae7c-d68f23cc3a07" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG nova.network.neutron [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG nova.network.neutron [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG nova.compute.manager [req-ff852b49-98fa-4675-b2b4-0c2a73e821b6 req-af8ee1b8-c49c-4f0d-96dc-e54d2c723dab service nova] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Received event network-changed-09845821-08f0-4128-9221-15dccf9de944 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG nova.compute.manager [req-ff852b49-98fa-4675-b2b4-0c2a73e821b6 req-af8ee1b8-c49c-4f0d-96dc-e54d2c723dab service nova] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Refreshing instance network info cache due to event network-changed-09845821-08f0-4128-9221-15dccf9de944. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ff852b49-98fa-4675-b2b4-0c2a73e821b6 req-af8ee1b8-c49c-4f0d-96dc-e54d2c723dab service nova] Acquiring lock "refresh_cache-31824d74-830c-4feb-ae7c-d68f23cc3a07" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG nova.network.neutron [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Updating instance_info_cache with network_info: [{"id": "09845821-08f0-4128-9221-15dccf9de944", "address": "fa:16:3e:6b:59:63", "network": {"id": "4369e31c-31b6-429f-bfad-c83ed55005c0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1169310922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0461ab72f35b4ebb995e9b602935c5b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09845821-08", "ovs_interfaceid": "09845821-08f0-4128-9221-15dccf9de944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Releasing lock "refresh_cache-31824d74-830c-4feb-ae7c-d68f23cc3a07" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG nova.compute.manager [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Instance network_info: |[{"id": "09845821-08f0-4128-9221-15dccf9de944", "address": "fa:16:3e:6b:59:63", "network": {"id": "4369e31c-31b6-429f-bfad-c83ed55005c0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1169310922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0461ab72f35b4ebb995e9b602935c5b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09845821-08", "ovs_interfaceid": "09845821-08f0-4128-9221-15dccf9de944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ff852b49-98fa-4675-b2b4-0c2a73e821b6 req-af8ee1b8-c49c-4f0d-96dc-e54d2c723dab service nova] Acquired lock "refresh_cache-31824d74-830c-4feb-ae7c-d68f23cc3a07" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG nova.network.neutron [req-ff852b49-98fa-4675-b2b4-0c2a73e821b6 req-af8ee1b8-c49c-4f0d-96dc-e54d2c723dab service nova] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Refreshing network info cache for port 09845821-08f0-4128-9221-15dccf9de944 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Start _get_guest_xml network_info=[{"id": "09845821-08f0-4128-9221-15dccf9de944", "address": "fa:16:3e:6b:59:63", "network": {"id": "4369e31c-31b6-429f-bfad-c83ed55005c0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1169310922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0461ab72f35b4ebb995e9b602935c5b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09845821-08", "ovs_interfaceid": "09845821-08f0-4128-9221-15dccf9de944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:28:35 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:28:35 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:28:35 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:28:35 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:28:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:28:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1517598733',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1517598733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1517598',id=39,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJR6lw/cypLxMp4t6XQ7M+tSJvNtyIEeHgtwV636/5uNNNijKxwVBIvBEtmbY0k2xOd8sztcqY33siKtqt8VN2S+s3H68Q1hqjLUtcFM/8zizefjFfSFpUwzqWHbh0RBDQ==',key_name='tempest-keypair-1577444747',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0461ab72f35b4ebb995e9b602935c5b2',ramdisk_id='',reservation_id='r-rhw1zhei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1507989825',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:28:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0d492075e3d4171a9af5087c8eb8d25',uuid=31824d74-830c-4feb-ae7c-d68f23cc3a07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09845821-08f0-4128-9221-15dccf9de944", "address": "fa:16:3e:6b:59:63", "network": {"id": "4369e31c-31b6-429f-bfad-c83ed55005c0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1169310922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0461ab72f35b4ebb995e9b602935c5b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09845821-08", "ovs_interfaceid": "09845821-08f0-4128-9221-15dccf9de944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:28:36 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Converting VIF {"id": "09845821-08f0-4128-9221-15dccf9de944", "address": "fa:16:3e:6b:59:63", "network": {"id": "4369e31c-31b6-429f-bfad-c83ed55005c0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1169310922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0461ab72f35b4ebb995e9b602935c5b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09845821-08", "ovs_interfaceid": "09845821-08f0-4128-9221-15dccf9de944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:28:36 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:59:63,bridge_name='br-int',has_traffic_filtering=True,id=09845821-08f0-4128-9221-15dccf9de944,network=Network(4369e31c-31b6-429f-bfad-c83ed55005c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09845821-08') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:28:36 user nova-compute[75745]: DEBUG nova.objects.instance [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Lazy-loading 'pci_devices' on Instance uuid 31824d74-830c-4feb-ae7c-d68f23cc3a07 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:28:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:28:36 user nova-compute[75745]:   <uuid>31824d74-830c-4feb-ae7c-d68f23cc3a07</uuid>
Dec 01 17:28:36 user nova-compute[75745]:   <name>instance-00000027</name>
Dec 01 17:28:36 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:28:36 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:28:36 user nova-compute[75745]:   <metadata>
Dec 01 17:28:36 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:28:36 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:28:36 user nova-compute[75745]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1517598733</nova:name>
Dec 01 17:28:36 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:28:35</nova:creationTime>
Dec 01 17:28:36 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:28:36 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:28:36 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:28:36 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:28:36 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:28:36 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:28:36 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:28:36 user nova-compute[75745]:       <nova:owner>
Dec 01 17:28:36 user nova-compute[75745]:         <nova:user uuid="a0d492075e3d4171a9af5087c8eb8d25">tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member</nova:user>
Dec 01 17:28:36 user nova-compute[75745]:         <nova:project uuid="0461ab72f35b4ebb995e9b602935c5b2">tempest-TestServerVolumeAttachScenarioOldVersion-1507989825</nova:project>
Dec 01 17:28:36 user nova-compute[75745]:       </nova:owner>
Dec 01 17:28:36 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:28:36 user nova-compute[75745]:       <nova:ports>
Dec 01 17:28:36 user nova-compute[75745]:         <nova:port uuid="09845821-08f0-4128-9221-15dccf9de944">
Dec 01 17:28:36 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 01 17:28:36 user nova-compute[75745]:         </nova:port>
Dec 01 17:28:36 user nova-compute[75745]:       </nova:ports>
Dec 01 17:28:36 user nova-compute[75745]:     </nova:instance>
Dec 01 17:28:36 user nova-compute[75745]:   </metadata>
Dec 01 17:28:36 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:28:36 user nova-compute[75745]:     <system>
Dec 01 17:28:36 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:28:36 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:28:36 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:28:36 user nova-compute[75745]:       <entry name="serial">31824d74-830c-4feb-ae7c-d68f23cc3a07</entry>
Dec 01 17:28:36 user nova-compute[75745]:       <entry name="uuid">31824d74-830c-4feb-ae7c-d68f23cc3a07</entry>
Dec 01 17:28:36 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:28:36 user nova-compute[75745]:     </system>
Dec 01 17:28:36 user nova-compute[75745]:   </sysinfo>
Dec 01 17:28:36 user nova-compute[75745]:   <os>
Dec 01 17:28:36 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:28:36 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:28:36 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:28:36 user nova-compute[75745]:   </os>
Dec 01 17:28:36 user nova-compute[75745]:   <features>
Dec 01 17:28:36 user nova-compute[75745]:     <acpi/>
Dec 01 17:28:36 user nova-compute[75745]:     <apic/>
Dec 01 17:28:36 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:28:36 user nova-compute[75745]:   </features>
Dec 01 17:28:36 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:28:36 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:28:36 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:28:36 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:28:36 user nova-compute[75745]:   </clock>
Dec 01 17:28:36 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:28:36 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:28:36 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:28:36 user nova-compute[75745]:   </cpu>
Dec 01 17:28:36 user nova-compute[75745]:   <devices>
Dec 01 17:28:36 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:28:36 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:28:36 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/31824d74-830c-4feb-ae7c-d68f23cc3a07/disk"/>
Dec 01 17:28:36 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:28:36 user nova-compute[75745]:     </disk>
Dec 01 17:28:36 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:28:36 user nova-compute[75745]:       <mac address="fa:16:3e:6b:59:63"/>
Dec 01 17:28:36 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:28:36 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:28:36 user nova-compute[75745]:       <target dev="tap09845821-08"/>
Dec 01 17:28:36 user nova-compute[75745]:     </interface>
Dec 01 17:28:36 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:28:36 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/31824d74-830c-4feb-ae7c-d68f23cc3a07/console.log" append="off"/>
Dec 01 17:28:36 user nova-compute[75745]:     </serial>
Dec 01 17:28:36 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:28:36 user nova-compute[75745]:     <video>
Dec 01 17:28:36 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:28:36 user nova-compute[75745]:     </video>
Dec 01 17:28:36 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:28:36 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:28:36 user nova-compute[75745]:     </rng>
Dec 01 17:28:36 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:28:36 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:28:36 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:28:36 user nova-compute[75745]:     </memballoon>
Dec 01 17:28:36 user nova-compute[75745]:   </devices>
Dec 01 17:28:36 user nova-compute[75745]: </domain>
Dec 01 17:28:36 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:28:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:28:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1517598733',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1517598733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1517598',id=39,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJR6lw/cypLxMp4t6XQ7M+tSJvNtyIEeHgtwV636/5uNNNijKxwVBIvBEtmbY0k2xOd8sztcqY33siKtqt8VN2S+s3H68Q1hqjLUtcFM/8zizefjFfSFpUwzqWHbh0RBDQ==',key_name='tempest-keypair-1577444747',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0461ab72f35b4ebb995e9b602935c5b2',ramdisk_id='',reservation_id='r-rhw1zhei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1507989825',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:28:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0d492075e3d4171a9af5087c8eb8d25',uuid=31824d74-830c-4feb-ae7c-d68f23cc3a07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09845821-08f0-4128-9221-15dccf9de944", "address": "fa:16:3e:6b:59:63", "network": {"id": "4369e31c-31b6-429f-bfad-c83ed55005c0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1169310922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0461ab72f35b4ebb995e9b602935c5b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09845821-08", "ovs_interfaceid": "09845821-08f0-4128-9221-15dccf9de944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:28:36 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Converting VIF {"id": "09845821-08f0-4128-9221-15dccf9de944", "address": "fa:16:3e:6b:59:63", "network": {"id": "4369e31c-31b6-429f-bfad-c83ed55005c0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1169310922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0461ab72f35b4ebb995e9b602935c5b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09845821-08", "ovs_interfaceid": "09845821-08f0-4128-9221-15dccf9de944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:28:36 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:59:63,bridge_name='br-int',has_traffic_filtering=True,id=09845821-08f0-4128-9221-15dccf9de944,network=Network(4369e31c-31b6-429f-bfad-c83ed55005c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09845821-08') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:28:36 user nova-compute[75745]: DEBUG os_vif [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:59:63,bridge_name='br-int',has_traffic_filtering=True,id=09845821-08f0-4128-9221-15dccf9de944,network=Network(4369e31c-31b6-429f-bfad-c83ed55005c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09845821-08') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:28:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:28:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:28:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c22d7feb-cd3f-56b5-97ec-f08f100208bc', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:28:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09845821-08, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:28:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap09845821-08, col_values=(('qos', UUID('3e9b1ddd-1096-4237-830e-7edde81dbe78')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:28:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap09845821-08, col_values=(('external_ids', {'iface-id': '09845821-08f0-4128-9221-15dccf9de944', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:59:63', 'vm-uuid': '31824d74-830c-4feb-ae7c-d68f23cc3a07'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:28:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:28:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:36 user nova-compute[75745]: INFO os_vif [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:59:63,bridge_name='br-int',has_traffic_filtering=True,id=09845821-08f0-4128-9221-15dccf9de944,network=Network(4369e31c-31b6-429f-bfad-c83ed55005c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09845821-08')
Dec 01 17:28:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:28:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] No VIF found with MAC fa:16:3e:6b:59:63, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:28:36 user nova-compute[75745]: DEBUG nova.network.neutron [req-ff852b49-98fa-4675-b2b4-0c2a73e821b6 req-af8ee1b8-c49c-4f0d-96dc-e54d2c723dab service nova] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Updated VIF entry in instance network info cache for port 09845821-08f0-4128-9221-15dccf9de944. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:28:36 user nova-compute[75745]: DEBUG nova.network.neutron [req-ff852b49-98fa-4675-b2b4-0c2a73e821b6 req-af8ee1b8-c49c-4f0d-96dc-e54d2c723dab service nova] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Updating instance_info_cache with network_info: [{"id": "09845821-08f0-4128-9221-15dccf9de944", "address": "fa:16:3e:6b:59:63", "network": {"id": "4369e31c-31b6-429f-bfad-c83ed55005c0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1169310922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0461ab72f35b4ebb995e9b602935c5b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09845821-08", "ovs_interfaceid": "09845821-08f0-4128-9221-15dccf9de944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:28:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ff852b49-98fa-4675-b2b4-0c2a73e821b6 req-af8ee1b8-c49c-4f0d-96dc-e54d2c723dab service nova] Releasing lock "refresh_cache-31824d74-830c-4feb-ae7c-d68f23cc3a07" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:28:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:37 user nova-compute[75745]: DEBUG nova.compute.manager [req-cf95a48a-8ea7-491b-b1d0-712461fbacb7 req-0d3e9bb5-0a22-4078-a1c5-0b84e2dcca50 service nova] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Received event network-vif-plugged-09845821-08f0-4128-9221-15dccf9de944 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:28:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-cf95a48a-8ea7-491b-b1d0-712461fbacb7 req-0d3e9bb5-0a22-4078-a1c5-0b84e2dcca50 service nova] Acquiring lock "31824d74-830c-4feb-ae7c-d68f23cc3a07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:28:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-cf95a48a-8ea7-491b-b1d0-712461fbacb7 req-0d3e9bb5-0a22-4078-a1c5-0b84e2dcca50 service nova] Lock "31824d74-830c-4feb-ae7c-d68f23cc3a07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:28:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-cf95a48a-8ea7-491b-b1d0-712461fbacb7 req-0d3e9bb5-0a22-4078-a1c5-0b84e2dcca50 service nova] Lock "31824d74-830c-4feb-ae7c-d68f23cc3a07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:28:37 user nova-compute[75745]: DEBUG nova.compute.manager [req-cf95a48a-8ea7-491b-b1d0-712461fbacb7 req-0d3e9bb5-0a22-4078-a1c5-0b84e2dcca50 service nova] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] No waiting events found dispatching network-vif-plugged-09845821-08f0-4128-9221-15dccf9de944 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:28:37 user nova-compute[75745]: WARNING nova.compute.manager [req-cf95a48a-8ea7-491b-b1d0-712461fbacb7 req-0d3e9bb5-0a22-4078-a1c5-0b84e2dcca50 service nova] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Received unexpected event network-vif-plugged-09845821-08f0-4128-9221-15dccf9de944 for instance with vm_state building and task_state spawning.
Dec 01 17:28:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:39 user nova-compute[75745]: DEBUG nova.compute.manager [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:28:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:28:39 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Instance spawned successfully.
Dec 01 17:28:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:28:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:28:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:28:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:28:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:28:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:28:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:28:39 user nova-compute[75745]: INFO nova.compute.manager [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Took 5.21 seconds to spawn the instance on the hypervisor.
Dec 01 17:28:39 user nova-compute[75745]: DEBUG nova.compute.manager [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:28:39 user nova-compute[75745]: DEBUG nova.compute.manager [req-a60240de-23de-48cc-8f43-f7abc1b86780 req-e8859d6a-786d-4e97-b9ef-bba5242dc23b service nova] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Received event network-vif-plugged-09845821-08f0-4128-9221-15dccf9de944 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:28:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a60240de-23de-48cc-8f43-f7abc1b86780 req-e8859d6a-786d-4e97-b9ef-bba5242dc23b service nova] Acquiring lock "31824d74-830c-4feb-ae7c-d68f23cc3a07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:28:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a60240de-23de-48cc-8f43-f7abc1b86780 req-e8859d6a-786d-4e97-b9ef-bba5242dc23b service nova] Lock "31824d74-830c-4feb-ae7c-d68f23cc3a07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:28:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a60240de-23de-48cc-8f43-f7abc1b86780 req-e8859d6a-786d-4e97-b9ef-bba5242dc23b service nova] Lock "31824d74-830c-4feb-ae7c-d68f23cc3a07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:28:39 user nova-compute[75745]: DEBUG nova.compute.manager [req-a60240de-23de-48cc-8f43-f7abc1b86780 req-e8859d6a-786d-4e97-b9ef-bba5242dc23b service nova] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] No waiting events found dispatching network-vif-plugged-09845821-08f0-4128-9221-15dccf9de944 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:28:39 user nova-compute[75745]: WARNING nova.compute.manager [req-a60240de-23de-48cc-8f43-f7abc1b86780 req-e8859d6a-786d-4e97-b9ef-bba5242dc23b service nova] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Received unexpected event network-vif-plugged-09845821-08f0-4128-9221-15dccf9de944 for instance with vm_state building and task_state spawning.
Dec 01 17:28:39 user nova-compute[75745]: INFO nova.compute.manager [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Took 5.99 seconds to build instance.
Dec 01 17:28:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5a4cd108-5294-4514-b983-ddf1c4b2c6fb tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Lock "31824d74-830c-4feb-ae7c-d68f23cc3a07" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.073s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:28:40 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0 is timed out.
Dec 01 17:28:40 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Successfully detached device vdc from instance 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0 from the live domain config.
Dec 01 17:28:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xdytmZcW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:28:40 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:28:40 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a859d3-0a7f-4702-8db1-34fb44a26bb7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:28:40 user nova-compute[75745]: No targets found.
Dec 01 17:28:40 user nova-compute[75745]: iSNS:
Dec 01 17:28:40 user nova-compute[75745]: No targets found.
Dec 01 17:28:40 user nova-compute[75745]: STATIC:
Dec 01 17:28:40 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47
Dec 01 17:28:40 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:28:40 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:28:40 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df
Dec 01 17:28:40 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:28:40 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:28:40 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0
Dec 01 17:28:40 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:28:40 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:28:40 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740
Dec 01 17:28:40 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:28:40 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:28:40 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070
Dec 01 17:28:40 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:28:40 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:28:40 user nova-compute[75745]: FIRMWARE:
Dec 01 17:28:40 user nova-compute[75745]: No targets found.
Dec 01 17:28:40 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:28:40 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:28:40 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e47629d-ac5e-43a7-92ce-3b6909940a4a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7f41aa-55b5-4c4a-b2e4-467ddec1515e]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:28:40 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:28:40 user nova-compute[75745]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:28:40 user nova-compute[75745]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 (non-flash)
Dec 01 17:28:40 user nova-compute[75745]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47 (non-flash)
Dec 01 17:28:40 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:28:40 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:28:40 user nova-compute[75745]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:28:40 user nova-compute[75745]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 (non-flash)
Dec 01 17:28:40 user nova-compute[75745]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47 (non-flash)
Dec 01 17:28:40 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b85b36d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47'): ({'sdg'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Removing single pathed devices sdg {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ccb6a6-847c-4ea1-a81e-d36e68b7e762]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[651e3716-ed07-4268-a44b-19a90b447454]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Flushing IO for device /dev/sdg {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd9ec8b-8f16-44fe-81f5-ed1563f9b38c]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.052s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afc02b1-6c7d-4965-aac9-37188d94ca31]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] SCSI volumes sdg have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f79498-f4c6-4e90-9c32-cbce0db2c4a9]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a64191c-a8ba-4de1-a729-67a7671b399c]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47, portal: 172.16.0.220,3260]
Dec 01 17:28:40 user nova-compute[75745]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47, portal: 172.16.0.220,3260] successful.
Dec 01 17:28:40 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16e9f432-84e1-4182-a318-447327c7ce47 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc11228-3104-49ef-98ed-d6ffb42879fa]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] <== disconnect_volume: return (328ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:28:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:28:41 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:41 user nova-compute[75745]: DEBUG nova.objects.instance [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lazy-loading 'flavor' on Instance uuid 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:28:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6d570ae6-6778-461e-8de6-9e99be7f9765 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.771s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:28:42 user nova-compute[75745]: DEBUG nova.compute.manager [None req-714c1e35-1e06-4ed7-8c91-b958b48f85c3 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:28:42 user nova-compute[75745]: INFO nova.compute.manager [None req-714c1e35-1e06-4ed7-8c91-b958b48f85c3 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] instance snapshotting
Dec 01 17:28:42 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-714c1e35-1e06-4ed7-8c91-b958b48f85c3 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Beginning live snapshot process
Dec 01 17:28:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-714c1e35-1e06-4ed7-8c91-b958b48f85c3 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json -f qcow2 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-714c1e35-1e06-4ed7-8c91-b958b48f85c3 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-714c1e35-1e06-4ed7-8c91-b958b48f85c3 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json -f qcow2 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-714c1e35-1e06-4ed7-8c91-b958b48f85c3 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-714c1e35-1e06-4ed7-8c91-b958b48f85c3 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-714c1e35-1e06-4ed7-8c91-b958b48f85c3 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.176s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-714c1e35-1e06-4ed7-8c91-b958b48f85c3 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1gmxg0tn/e8dbb985980f4285b23c24d4b90ff620.delta 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:42 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-714c1e35-1e06-4ed7-8c91-b958b48f85c3 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1gmxg0tn/e8dbb985980f4285b23c24d4b90ff620.delta 1073741824" returned: 0 in 0.053s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:42 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-714c1e35-1e06-4ed7-8c91-b958b48f85c3 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Quiescing instance not available: QEMU guest agent is not enabled.
Dec 01 17:28:43 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-714c1e35-1e06-4ed7-8c91-b958b48f85c3 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75745) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 17:28:44 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-714c1e35-1e06-4ed7-8c91-b958b48f85c3 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75745) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 17:28:44 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-714c1e35-1e06-4ed7-8c91-b958b48f85c3 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 01 17:28:44 user nova-compute[75745]: DEBUG nova.privsep.utils [None req-714c1e35-1e06-4ed7-8c91-b958b48f85c3 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75745) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 17:28:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-714c1e35-1e06-4ed7-8c91-b958b48f85c3 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1gmxg0tn/e8dbb985980f4285b23c24d4b90ff620.delta /opt/stack/data/nova/instances/snapshots/tmp1gmxg0tn/e8dbb985980f4285b23c24d4b90ff620 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-714c1e35-1e06-4ed7-8c91-b958b48f85c3 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1gmxg0tn/e8dbb985980f4285b23c24d4b90ff620.delta /opt/stack/data/nova/instances/snapshots/tmp1gmxg0tn/e8dbb985980f4285b23c24d4b90ff620" returned: 0 in 0.655s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:44 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-714c1e35-1e06-4ed7-8c91-b958b48f85c3 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Snapshot extracted, beginning image upload
Dec 01 17:28:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:45 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c358f18c-44c4-45d4-a1eb-4f259c36a0d9 is timed out.
Dec 01 17:28:45 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Successfully detached device vdb from instance c358f18c-44c4-45d4-a1eb-4f259c36a0d9 from the live domain config.
Dec 01 17:28:45 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JrvSuhAq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:28:45 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:28:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ffb91e-0624-4e43-98fe-d92b6bdadd9b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:28:45 user nova-compute[75745]: No targets found.
Dec 01 17:28:45 user nova-compute[75745]: iSNS:
Dec 01 17:28:45 user nova-compute[75745]: No targets found.
Dec 01 17:28:45 user nova-compute[75745]: STATIC:
Dec 01 17:28:45 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df
Dec 01 17:28:45 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:28:45 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:28:45 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0
Dec 01 17:28:45 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:28:45 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:28:45 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740
Dec 01 17:28:45 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:28:45 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:28:45 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070
Dec 01 17:28:45 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:28:45 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:28:45 user nova-compute[75745]: FIRMWARE:
Dec 01 17:28:45 user nova-compute[75745]: No targets found.
Dec 01 17:28:45 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:28:45 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:28:45 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5b0f5d-cad2-49d0-9047-c7b07d430ef1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f4e920-bd19-46a8-be61-7f0f7f5cd3e0]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:28:45 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:28:45 user nova-compute[75745]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:28:45 user nova-compute[75745]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 (non-flash)
Dec 01 17:28:45 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:28:45 user nova-compute[75745]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 (non-flash)
Dec 01 17:28:45 user nova-compute[75745]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:28:45 user nova-compute[75745]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 (non-flash)
Dec 01 17:28:45 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b8503d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740'): ({'sdc'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Removing single pathed devices sdc {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[91615a5a-1579-4705-9734-6c04b3d35aac]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.040s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d9863c-86be-4221-a5f6-db8c636a0e1a]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Flushing IO for device /dev/sdc {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2674d347-ff1b-49ff-830c-d43b1229aa57]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ae8b19-70f9-4866-8f37-5045e9faa02f]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] SCSI volumes sdc have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.047s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8b2363-6403-49a4-9b8f-38f6c1f75d0e]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1d80ef-d143-4122-941d-5b124a820d2c]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740, portal: 172.16.0.220,3260]
Dec 01 17:28:45 user nova-compute[75745]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740, portal: 172.16.0.220,3260] successful.
Dec 01 17:28:45 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1bb7743-921b-4683-97c5-13a2e3832740 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffff1a3d-fd7e-4047-ae55-d9eb55db31e4]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.457s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] <== disconnect_volume: return (461ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:28:45 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:28:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:46 user nova-compute[75745]: DEBUG nova.objects.instance [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lazy-loading 'flavor' on Instance uuid c358f18c-44c4-45d4-a1eb-4f259c36a0d9 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:28:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-08bbd761-225b-4250-b97f-a1f06ce9ad7d tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.047s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:28:48 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-714c1e35-1e06-4ed7-8c91-b958b48f85c3 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Snapshot image upload complete
Dec 01 17:28:48 user nova-compute[75745]: INFO nova.compute.manager [None req-714c1e35-1e06-4ed7-8c91-b958b48f85c3 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Took 5.90 seconds to snapshot the instance on the hypervisor.
Dec 01 17:28:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:28:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:28:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:28:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:28:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:55 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:28:55 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:28:55 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:28:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:28:57 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:28:57 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:28:58 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:28:58 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:28:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:28:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:28:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:28:58 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:28:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:28:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:28:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0dc85bf3-9ba5-4cb6-b08f-9378d1786de7 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:29:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0dc85bf3-9ba5-4cb6-b08f-9378d1786de7 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:29:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0dc85bf3-9ba5-4cb6-b08f-9378d1786de7 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:29:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0dc85bf3-9ba5-4cb6-b08f-9378d1786de7 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:29:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0dc85bf3-9ba5-4cb6-b08f-9378d1786de7 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:29:00 user nova-compute[75745]: INFO nova.compute.manager [None req-0dc85bf3-9ba5-4cb6-b08f-9378d1786de7 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Terminating instance
Dec 01 17:29:00 user nova-compute[75745]: DEBUG nova.compute.manager [None req-0dc85bf3-9ba5-4cb6-b08f-9378d1786de7 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:29:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31824d74-830c-4feb-ae7c-d68f23cc3a07/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:01 user nova-compute[75745]: DEBUG nova.compute.manager [req-d7d28974-130a-4a40-b339-dbaa732b2b3a req-5e6c7aba-13e8-496d-a23c-f61293b275af service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Received event network-vif-unplugged-fff6dabe-5df3-4db0-85cb-6dce98f4b953 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:29:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d7d28974-130a-4a40-b339-dbaa732b2b3a req-5e6c7aba-13e8-496d-a23c-f61293b275af service nova] Acquiring lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:29:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d7d28974-130a-4a40-b339-dbaa732b2b3a req-5e6c7aba-13e8-496d-a23c-f61293b275af service nova] Lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:29:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d7d28974-130a-4a40-b339-dbaa732b2b3a req-5e6c7aba-13e8-496d-a23c-f61293b275af service nova] Lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:29:01 user nova-compute[75745]: DEBUG nova.compute.manager [req-d7d28974-130a-4a40-b339-dbaa732b2b3a req-5e6c7aba-13e8-496d-a23c-f61293b275af service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] No waiting events found dispatching network-vif-unplugged-fff6dabe-5df3-4db0-85cb-6dce98f4b953 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:29:01 user nova-compute[75745]: DEBUG nova.compute.manager [req-d7d28974-130a-4a40-b339-dbaa732b2b3a req-5e6c7aba-13e8-496d-a23c-f61293b275af service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Received event network-vif-unplugged-fff6dabe-5df3-4db0-85cb-6dce98f4b953 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:29:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31824d74-830c-4feb-ae7c-d68f23cc3a07/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31824d74-830c-4feb-ae7c-d68f23cc3a07/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31824d74-830c-4feb-ae7c-d68f23cc3a07/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:01 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:29:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:01 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Instance destroyed successfully.
Dec 01 17:29:01 user nova-compute[75745]: DEBUG nova.objects.instance [None req-0dc85bf3-9ba5-4cb6-b08f-9378d1786de7 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lazy-loading 'resources' on Instance uuid b26b6ef1-7a8b-4628-8cc1-d27cc27efcac {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:29:01 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-0dc85bf3-9ba5-4cb6-b08f-9378d1786de7 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:23:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2051733239',display_name='tempest-TestMinimumBasicScenario-server-2051733239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2051733239',id=35,image_ref='cb76920d-b7bf-4216-9c1a-8314539397bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnn9DbZ1Jp2KhqktMIfJFAy2AJFm/hYRjxHHwLjF9RbFVRyd8+/P6NS2CW73jwkJj6uEU3/IytWVgpFqd2zzTrgAhNQ0E7yUV0tGqXiGTIYZBRqkb4sHdY6cQgszpx+1g==',key_name='tempest-TestMinimumBasicScenario-1212427382',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:23:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c3088641ea74a31a80ade2623f85d91',ramdisk_id='',reservation_id='r-i38vr9t0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cb76920d-b7bf-4216-9c1a-8314539397bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-865236074',owner_user_name='tempest-TestMinimumBasicScenario-865236074-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:26:20Z,user_data=None,user_id='f75082346bbd4b2ebfc585a25a897f81',uuid=b26b6ef1-7a8b-4628-8cc1-d27cc27efcac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "address": "fa:16:3e:71:7f:4a", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff6dabe-5d", "ovs_interfaceid": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:29:01 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-0dc85bf3-9ba5-4cb6-b08f-9378d1786de7 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Converting VIF {"id": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "address": "fa:16:3e:71:7f:4a", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfff6dabe-5d", "ovs_interfaceid": "fff6dabe-5df3-4db0-85cb-6dce98f4b953", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:29:01 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-0dc85bf3-9ba5-4cb6-b08f-9378d1786de7 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:7f:4a,bridge_name='br-int',has_traffic_filtering=True,id=fff6dabe-5df3-4db0-85cb-6dce98f4b953,network=Network(bfcf7108-b710-4459-bcd7-fbfd464ee6a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfff6dabe-5d') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:29:01 user nova-compute[75745]: DEBUG os_vif [None req-0dc85bf3-9ba5-4cb6-b08f-9378d1786de7 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:7f:4a,bridge_name='br-int',has_traffic_filtering=True,id=fff6dabe-5df3-4db0-85cb-6dce98f4b953,network=Network(bfcf7108-b710-4459-bcd7-fbfd464ee6a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfff6dabe-5d') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:29:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfff6dabe-5d, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:29:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:29:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ecd99c0a-9b9b-43bb-a456-66d7e6540b2e) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:29:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:29:01 user nova-compute[75745]: INFO os_vif [None req-0dc85bf3-9ba5-4cb6-b08f-9378d1786de7 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:7f:4a,bridge_name='br-int',has_traffic_filtering=True,id=fff6dabe-5df3-4db0-85cb-6dce98f4b953,network=Network(bfcf7108-b710-4459-bcd7-fbfd464ee6a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfff6dabe-5d')
Dec 01 17:29:01 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-0dc85bf3-9ba5-4cb6-b08f-9378d1786de7 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Deleting instance files /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac_del
Dec 01 17:29:01 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-0dc85bf3-9ba5-4cb6-b08f-9378d1786de7 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Deletion of /opt/stack/data/nova/instances/b26b6ef1-7a8b-4628-8cc1-d27cc27efcac_del complete
Dec 01 17:29:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:01 user nova-compute[75745]: INFO nova.compute.manager [None req-0dc85bf3-9ba5-4cb6-b08f-9378d1786de7 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Took 0.94 seconds to destroy the instance on the hypervisor.
Dec 01 17:29:01 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-0dc85bf3-9ba5-4cb6-b08f-9378d1786de7 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:29:01 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:29:01 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:29:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:02 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:29:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff5eaad-45ab-4a21-bc9b-9ecef436cab0/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:02 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Took 0.59 seconds to deallocate network for instance.
Dec 01 17:29:02 user nova-compute[75745]: DEBUG nova.compute.manager [req-0cdb6d51-31c5-486a-a89e-5bfcd0868909 req-15d7317d-383f-446a-8464-204f78c2a626 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Received event network-vif-deleted-fff6dabe-5df3-4db0-85cb-6dce98f4b953 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:29:02 user nova-compute[75745]: INFO nova.compute.manager [req-0cdb6d51-31c5-486a-a89e-5bfcd0868909 req-15d7317d-383f-446a-8464-204f78c2a626 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Neutron deleted interface fff6dabe-5df3-4db0-85cb-6dce98f4b953; detaching it from the instance and deleting it from the info cache
Dec 01 17:29:02 user nova-compute[75745]: DEBUG nova.network.neutron [req-0cdb6d51-31c5-486a-a89e-5bfcd0868909 req-15d7317d-383f-446a-8464-204f78c2a626 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:29:02 user nova-compute[75745]: DEBUG nova.compute.manager [req-0cdb6d51-31c5-486a-a89e-5bfcd0868909 req-15d7317d-383f-446a-8464-204f78c2a626 service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Detach interface failed, port_id=fff6dabe-5df3-4db0-85cb-6dce98f4b953, reason: Instance b26b6ef1-7a8b-4628-8cc1-d27cc27efcac could not be found. {{(pid=75745) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 17:29:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0dc85bf3-9ba5-4cb6-b08f-9378d1786de7 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:29:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0dc85bf3-9ba5-4cb6-b08f-9378d1786de7 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:29:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff5eaad-45ab-4a21-bc9b-9ecef436cab0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff5eaad-45ab-4a21-bc9b-9ecef436cab0/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ff5eaad-45ab-4a21-bc9b-9ecef436cab0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:29:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:29:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:02 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-0dc85bf3-9ba5-4cb6-b08f-9378d1786de7 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:29:02 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-0dc85bf3-9ba5-4cb6-b08f-9378d1786de7 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:29:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0dc85bf3-9ba5-4cb6-b08f-9378d1786de7 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.533s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:29:02 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-0dc85bf3-9ba5-4cb6-b08f-9378d1786de7 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Deleted allocations for instance b26b6ef1-7a8b-4628-8cc1-d27cc27efcac
Dec 01 17:29:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0dc85bf3-9ba5-4cb6-b08f-9378d1786de7 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.301s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:29:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:03 user nova-compute[75745]: DEBUG nova.compute.manager [req-3428dccf-5036-49d8-9934-8600da4b0908 req-6fe59d29-cf07-4cd0-b463-10ffcf95b4fc service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Received event network-vif-plugged-fff6dabe-5df3-4db0-85cb-6dce98f4b953 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:29:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3428dccf-5036-49d8-9934-8600da4b0908 req-6fe59d29-cf07-4cd0-b463-10ffcf95b4fc service nova] Acquiring lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:29:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3428dccf-5036-49d8-9934-8600da4b0908 req-6fe59d29-cf07-4cd0-b463-10ffcf95b4fc service nova] Lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:29:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3428dccf-5036-49d8-9934-8600da4b0908 req-6fe59d29-cf07-4cd0-b463-10ffcf95b4fc service nova] Lock "b26b6ef1-7a8b-4628-8cc1-d27cc27efcac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:29:03 user nova-compute[75745]: DEBUG nova.compute.manager [req-3428dccf-5036-49d8-9934-8600da4b0908 req-6fe59d29-cf07-4cd0-b463-10ffcf95b4fc service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] No waiting events found dispatching network-vif-plugged-fff6dabe-5df3-4db0-85cb-6dce98f4b953 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:29:03 user nova-compute[75745]: WARNING nova.compute.manager [req-3428dccf-5036-49d8-9934-8600da4b0908 req-6fe59d29-cf07-4cd0-b463-10ffcf95b4fc service nova] [instance: b26b6ef1-7a8b-4628-8cc1-d27cc27efcac] Received unexpected event network-vif-plugged-fff6dabe-5df3-4db0-85cb-6dce98f4b953 for instance with vm_state deleted and task_state None.
Dec 01 17:29:03 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:29:03 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:29:03 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=7706MB free_disk=24.980018615722656GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:29:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:29:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:29:03 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance d997cdd6-67c6-4263-814a-17cf9e27bbeb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:29:03 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance e4ffb96e-456c-4fb9-9850-9e98310d63e5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:29:03 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 80962f79-dbb2-4380-b2c8-791642cfa86b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:29:03 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 5e631ac3-8122-46a3-a54f-2395c0f7cf7c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:29:03 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 5aee52eb-78e3-4f60-a920-7ade912735e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:29:03 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance c358f18c-44c4-45d4-a1eb-4f259c36a0d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:29:03 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:29:03 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:29:03 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 61e0e19b-f926-4524-82c8-833f804c9b72 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:29:03 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 31824d74-830c-4feb-ae7c-d68f23cc3a07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:29:03 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:29:03 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:29:03 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:29:03 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:29:03 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:29:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.416s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:29:04 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:29:04 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:29:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:05 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:29:05 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:29:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-5aee52eb-78e3-4f60-a920-7ade912735e8" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:29:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-5aee52eb-78e3-4f60-a920-7ade912735e8" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:29:06 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:29:06 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Updating instance_info_cache with network_info: [{"id": "7c69901c-a94e-47f8-8a4a-1654ed728b83", "address": "fa:16:3e:2e:86:ec", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c69901c-a9", "ovs_interfaceid": "7c69901c-a94e-47f8-8a4a-1654ed728b83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:29:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-5aee52eb-78e3-4f60-a920-7ade912735e8" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:29:06 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:29:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Acquiring lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:29:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:29:10 user nova-compute[75745]: INFO nova.compute.manager [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Detaching volume 4ca052d1-7350-48c8-a723-4e46c2cb7070
Dec 01 17:29:10 user nova-compute[75745]: INFO nova.virt.block_device [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Attempting to driver detach volume 4ca052d1-7350-48c8-a723-4e46c2cb7070 from mountpoint /dev/vdb
Dec 01 17:29:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Attempting to detach device vdb from instance 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0 from the persistent domain config. {{(pid=75745) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 17:29:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:29:10 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:29:10 user nova-compute[75745]:   <source dev="/dev/sdf"/>
Dec 01 17:29:10 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:29:10 user nova-compute[75745]:   <serial>4ca052d1-7350-48c8-a723-4e46c2cb7070</serial>
Dec 01 17:29:10 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 17:29:10 user nova-compute[75745]: </disk>
Dec 01 17:29:10 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:29:10 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Successfully detached device vdb from instance 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0 from the persistent domain config.
Dec 01 17:29:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0 from the live domain config. {{(pid=75745) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 17:29:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:29:10 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:29:10 user nova-compute[75745]:   <source dev="/dev/sdf"/>
Dec 01 17:29:10 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:29:10 user nova-compute[75745]:   <serial>4ca052d1-7350-48c8-a723-4e46c2cb7070</serial>
Dec 01 17:29:10 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 17:29:10 user nova-compute[75745]: </disk>
Dec 01 17:29:10 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:29:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0 {{(pid=75745) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 17:29:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9cbc9852-1c02-4ee4-9eb1-f73bb7becb6a tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:29:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9cbc9852-1c02-4ee4-9eb1-f73bb7becb6a tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:29:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9cbc9852-1c02-4ee4-9eb1-f73bb7becb6a tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:29:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9cbc9852-1c02-4ee4-9eb1-f73bb7becb6a tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:29:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9cbc9852-1c02-4ee4-9eb1-f73bb7becb6a tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:29:15 user nova-compute[75745]: INFO nova.compute.manager [None req-9cbc9852-1c02-4ee4-9eb1-f73bb7becb6a tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Terminating instance
Dec 01 17:29:15 user nova-compute[75745]: DEBUG nova.compute.manager [None req-9cbc9852-1c02-4ee4-9eb1-f73bb7becb6a tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:29:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:15 user nova-compute[75745]: DEBUG nova.compute.manager [req-6bb077ee-f082-4b44-a01a-62d33fee03ee req-2e6fd696-03fb-4fd3-b93a-40359f765e27 service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Received event network-vif-unplugged-d4c74908-1bd2-4891-b4d7-932d73d78217 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:29:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6bb077ee-f082-4b44-a01a-62d33fee03ee req-2e6fd696-03fb-4fd3-b93a-40359f765e27 service nova] Acquiring lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:29:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6bb077ee-f082-4b44-a01a-62d33fee03ee req-2e6fd696-03fb-4fd3-b93a-40359f765e27 service nova] Lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:29:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6bb077ee-f082-4b44-a01a-62d33fee03ee req-2e6fd696-03fb-4fd3-b93a-40359f765e27 service nova] Lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:29:15 user nova-compute[75745]: DEBUG nova.compute.manager [req-6bb077ee-f082-4b44-a01a-62d33fee03ee req-2e6fd696-03fb-4fd3-b93a-40359f765e27 service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] No waiting events found dispatching network-vif-unplugged-d4c74908-1bd2-4891-b4d7-932d73d78217 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:29:15 user nova-compute[75745]: DEBUG nova.compute.manager [req-6bb077ee-f082-4b44-a01a-62d33fee03ee req-2e6fd696-03fb-4fd3-b93a-40359f765e27 service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Received event network-vif-unplugged-d4c74908-1bd2-4891-b4d7-932d73d78217 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:29:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:16 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Instance destroyed successfully.
Dec 01 17:29:16 user nova-compute[75745]: DEBUG nova.objects.instance [None req-9cbc9852-1c02-4ee4-9eb1-f73bb7becb6a tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lazy-loading 'resources' on Instance uuid c358f18c-44c4-45d4-a1eb-4f259c36a0d9 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:29:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-9cbc9852-1c02-4ee4-9eb1-f73bb7becb6a tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:22:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1788989126',display_name='tempest-ServerRescueNegativeTestJSON-server-1788989126',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1788989126',id=33,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8Ny/kflSsA/c+tWkGK85ReUuke09ZnT0oGtBWkatJTKiv30mPJKfLxH/UO+SRW8uuaOsr7cRtGJRij8ZM2s2C3b2cN6ruVTZIIna3IJLwAR8q4wG9dKDCFKwRXopbBew==',key_name='tempest-keypair-1045907146',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:24:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4542114c14774241bb138dfafe3441ad',ramdisk_id='',reservation_id='r-3z4xnddl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1719994145',owner_user_name='tempest-ServerRescueNegativeTestJSON-1719994145-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:26:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bd90117cc3c433d953b7e0de3718f0d',uuid=c358f18c-44c4-45d4-a1eb-4f259c36a0d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4c74908-1bd2-4891-b4d7-932d73d78217", "address": "fa:16:3e:f0:97:04", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c74908-1b", "ovs_interfaceid": "d4c74908-1bd2-4891-b4d7-932d73d78217", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:29:16 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-9cbc9852-1c02-4ee4-9eb1-f73bb7becb6a tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Converting VIF {"id": "d4c74908-1bd2-4891-b4d7-932d73d78217", "address": "fa:16:3e:f0:97:04", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c74908-1b", "ovs_interfaceid": "d4c74908-1bd2-4891-b4d7-932d73d78217", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:29:16 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-9cbc9852-1c02-4ee4-9eb1-f73bb7becb6a tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:97:04,bridge_name='br-int',has_traffic_filtering=True,id=d4c74908-1bd2-4891-b4d7-932d73d78217,network=Network(fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4c74908-1b') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:29:16 user nova-compute[75745]: DEBUG os_vif [None req-9cbc9852-1c02-4ee4-9eb1-f73bb7becb6a tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:97:04,bridge_name='br-int',has_traffic_filtering=True,id=d4c74908-1bd2-4891-b4d7-932d73d78217,network=Network(fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4c74908-1b') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:29:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4c74908-1b, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:29:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:29:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09284a82-a505-42b8-86c4-1cd7308a41da) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:29:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:16 user nova-compute[75745]: INFO os_vif [None req-9cbc9852-1c02-4ee4-9eb1-f73bb7becb6a tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:97:04,bridge_name='br-int',has_traffic_filtering=True,id=d4c74908-1bd2-4891-b4d7-932d73d78217,network=Network(fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4c74908-1b')
Dec 01 17:29:16 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-9cbc9852-1c02-4ee4-9eb1-f73bb7becb6a tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Deleting instance files /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9_del
Dec 01 17:29:16 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-9cbc9852-1c02-4ee4-9eb1-f73bb7becb6a tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Deletion of /opt/stack/data/nova/instances/c358f18c-44c4-45d4-a1eb-4f259c36a0d9_del complete
Dec 01 17:29:16 user nova-compute[75745]: INFO nova.compute.manager [None req-9cbc9852-1c02-4ee4-9eb1-f73bb7becb6a tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Took 0.88 seconds to destroy the instance on the hypervisor.
Dec 01 17:29:16 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-9cbc9852-1c02-4ee4-9eb1-f73bb7becb6a tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:29:16 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:29:16 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:29:16 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:29:16 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Took 0.73 seconds to deallocate network for instance.
Dec 01 17:29:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9cbc9852-1c02-4ee4-9eb1-f73bb7becb6a tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:29:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9cbc9852-1c02-4ee4-9eb1-f73bb7becb6a tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:29:17 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-9cbc9852-1c02-4ee4-9eb1-f73bb7becb6a tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:29:17 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-9cbc9852-1c02-4ee4-9eb1-f73bb7becb6a tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:29:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9cbc9852-1c02-4ee4-9eb1-f73bb7becb6a tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:29:17 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-9cbc9852-1c02-4ee4-9eb1-f73bb7becb6a tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Deleted allocations for instance c358f18c-44c4-45d4-a1eb-4f259c36a0d9
Dec 01 17:29:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9cbc9852-1c02-4ee4-9eb1-f73bb7becb6a tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.148s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:29:17 user nova-compute[75745]: DEBUG nova.compute.manager [req-9039cca1-a12f-4282-a017-aa558529eb9a req-f68717c7-87c8-4b3d-9d76-ae18da81e9e0 service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Received event network-vif-plugged-d4c74908-1bd2-4891-b4d7-932d73d78217 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:29:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-9039cca1-a12f-4282-a017-aa558529eb9a req-f68717c7-87c8-4b3d-9d76-ae18da81e9e0 service nova] Acquiring lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:29:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-9039cca1-a12f-4282-a017-aa558529eb9a req-f68717c7-87c8-4b3d-9d76-ae18da81e9e0 service nova] Lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:29:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-9039cca1-a12f-4282-a017-aa558529eb9a req-f68717c7-87c8-4b3d-9d76-ae18da81e9e0 service nova] Lock "c358f18c-44c4-45d4-a1eb-4f259c36a0d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:29:17 user nova-compute[75745]: DEBUG nova.compute.manager [req-9039cca1-a12f-4282-a017-aa558529eb9a req-f68717c7-87c8-4b3d-9d76-ae18da81e9e0 service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] No waiting events found dispatching network-vif-plugged-d4c74908-1bd2-4891-b4d7-932d73d78217 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:29:17 user nova-compute[75745]: WARNING nova.compute.manager [req-9039cca1-a12f-4282-a017-aa558529eb9a req-f68717c7-87c8-4b3d-9d76-ae18da81e9e0 service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Received unexpected event network-vif-plugged-d4c74908-1bd2-4891-b4d7-932d73d78217 for instance with vm_state deleted and task_state None.
Dec 01 17:29:17 user nova-compute[75745]: DEBUG nova.compute.manager [req-9039cca1-a12f-4282-a017-aa558529eb9a req-f68717c7-87c8-4b3d-9d76-ae18da81e9e0 service nova] [instance: c358f18c-44c4-45d4-a1eb-4f259c36a0d9] Received event network-vif-deleted-d4c74908-1bd2-4891-b4d7-932d73d78217 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:29:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:29:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:29:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:29:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:29:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:29:18 user nova-compute[75745]: INFO nova.compute.manager [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Terminating instance
Dec 01 17:29:18 user nova-compute[75745]: DEBUG nova.compute.manager [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:29:18 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:18 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:19 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Instance destroyed successfully.
Dec 01 17:29:19 user nova-compute[75745]: DEBUG nova.objects.instance [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lazy-loading 'resources' on Instance uuid 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:22:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1848665207',display_name='tempest-ServerActionsTestOtherA-server-1848665207',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1848665207',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEe39hBsqXh7qTHbR/1n4TCThkWTxdl0f3mcj7VutursSM+B5AqiMiKGVg5IqL9MYbDfyNfGcyjgOxxpAU4qczogEswNK8dvSit+JyFqtuJxlzPiy3ZkcIr+yzYcqZB0A==',key_name='tempest-keypair-3711887',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:24:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='409356993ea442c5abdf4269aebe43ab',ramdisk_id='',reservation_id='r-0dzhv7we',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1500186869',owner_user_name='tempest-ServerActionsTestOtherA-1500186869-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:26:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5204ecaa9b354d10bac514c27acbccc6',uuid=2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eeff2c22-349b-42cf-9290-6efccc7686d6", "address": "fa:16:3e:67:06:2e", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeff2c22-34", "ovs_interfaceid": "eeff2c22-349b-42cf-9290-6efccc7686d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Converting VIF {"id": "eeff2c22-349b-42cf-9290-6efccc7686d6", "address": "fa:16:3e:67:06:2e", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeff2c22-34", "ovs_interfaceid": "eeff2c22-349b-42cf-9290-6efccc7686d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:06:2e,bridge_name='br-int',has_traffic_filtering=True,id=eeff2c22-349b-42cf-9290-6efccc7686d6,network=Network(f7cefc9d-2279-4601-8a81-a640ad1aea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeff2c22-34') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG os_vif [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:06:2e,bridge_name='br-int',has_traffic_filtering=True,id=eeff2c22-349b-42cf-9290-6efccc7686d6,network=Network(f7cefc9d-2279-4601-8a81-a640ad1aea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeff2c22-34') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeeff2c22-34, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4d207d5c-1f48-4ff9-8081-aa7fa472a38d) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:19 user nova-compute[75745]: INFO os_vif [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:06:2e,bridge_name='br-int',has_traffic_filtering=True,id=eeff2c22-349b-42cf-9290-6efccc7686d6,network=Network(f7cefc9d-2279-4601-8a81-a640ad1aea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeff2c22-34')
Dec 01 17:29:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DeWhlKJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:29:19 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:29:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b781d58-b1c4-4ec6-b724-ab9c2b3ae479]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:29:19 user nova-compute[75745]: No targets found.
Dec 01 17:29:19 user nova-compute[75745]: iSNS:
Dec 01 17:29:19 user nova-compute[75745]: No targets found.
Dec 01 17:29:19 user nova-compute[75745]: STATIC:
Dec 01 17:29:19 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df
Dec 01 17:29:19 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:29:19 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:29:19 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0
Dec 01 17:29:19 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:29:19 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:29:19 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070
Dec 01 17:29:19 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:29:19 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:29:19 user nova-compute[75745]: FIRMWARE:
Dec 01 17:29:19 user nova-compute[75745]: No targets found.
Dec 01 17:29:19 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:29:19 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:29:19 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba83e21-142e-474a-b3ba-25e4a888ae96]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef8d4a8-2d92-49ad-800b-2db4ec57688d]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:29:19 user nova-compute[75745]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:29:19 user nova-compute[75745]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 (non-flash)
Dec 01 17:29:19 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:29:19 user nova-compute[75745]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df (non-flash)
Dec 01 17:29:19 user nova-compute[75745]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 (non-flash)
Dec 01 17:29:19 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2498717c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df'): ({'sdd'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Removing single pathed devices sdd {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abc2a50-91f5-4ade-8cb4-85848aecb3ce]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG nova.compute.manager [req-3456d58f-4f4f-46f5-b08a-3d60fc87dfb6 req-29003f71-bdcf-4b6e-840e-63e5f4feaded service nova] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Received event network-vif-unplugged-eeff2c22-349b-42cf-9290-6efccc7686d6 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3456d58f-4f4f-46f5-b08a-3d60fc87dfb6 req-29003f71-bdcf-4b6e-840e-63e5f4feaded service nova] Acquiring lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3456d58f-4f4f-46f5-b08a-3d60fc87dfb6 req-29003f71-bdcf-4b6e-840e-63e5f4feaded service nova] Lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3456d58f-4f4f-46f5-b08a-3d60fc87dfb6 req-29003f71-bdcf-4b6e-840e-63e5f4feaded service nova] Lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG nova.compute.manager [req-3456d58f-4f4f-46f5-b08a-3d60fc87dfb6 req-29003f71-bdcf-4b6e-840e-63e5f4feaded service nova] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] No waiting events found dispatching network-vif-unplugged-eeff2c22-349b-42cf-9290-6efccc7686d6 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG nova.compute.manager [req-3456d58f-4f4f-46f5-b08a-3d60fc87dfb6 req-29003f71-bdcf-4b6e-840e-63e5f4feaded service nova] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Received event network-vif-unplugged-eeff2c22-349b-42cf-9290-6efccc7686d6 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG nova.compute.manager [req-3456d58f-4f4f-46f5-b08a-3d60fc87dfb6 req-29003f71-bdcf-4b6e-840e-63e5f4feaded service nova] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Received event network-vif-plugged-eeff2c22-349b-42cf-9290-6efccc7686d6 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3456d58f-4f4f-46f5-b08a-3d60fc87dfb6 req-29003f71-bdcf-4b6e-840e-63e5f4feaded service nova] Acquiring lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3456d58f-4f4f-46f5-b08a-3d60fc87dfb6 req-29003f71-bdcf-4b6e-840e-63e5f4feaded service nova] Lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3456d58f-4f4f-46f5-b08a-3d60fc87dfb6 req-29003f71-bdcf-4b6e-840e-63e5f4feaded service nova] Lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG nova.compute.manager [req-3456d58f-4f4f-46f5-b08a-3d60fc87dfb6 req-29003f71-bdcf-4b6e-840e-63e5f4feaded service nova] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] No waiting events found dispatching network-vif-plugged-eeff2c22-349b-42cf-9290-6efccc7686d6 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:29:19 user nova-compute[75745]: WARNING nova.compute.manager [req-3456d58f-4f4f-46f5-b08a-3d60fc87dfb6 req-29003f71-bdcf-4b6e-840e-63e5f4feaded service nova] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Received unexpected event network-vif-plugged-eeff2c22-349b-42cf-9290-6efccc7686d6 for instance with vm_state active and task_state deleting.
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa1f544-c212-4420-b400-c7e8678e53d5]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Flushing IO for device /dev/sdd {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceab42bf-4af0-47df-a1de-50d165f9f413]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.152s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d70166-b71e-4ab3-b525-0c95604b5b8d]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] SCSI volumes sdd have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_d1d440ca', '/dev/disk/by-id/scsi-26365393231383963', '/dev/disk/by-id/scsi-1SCST_BIOd1d440ca-ce92189cd70e48d2') {{(pid=86714) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 01 17:29:19 user nova-compute[75745]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_d1d440ca
Dec 01 17:29:19 user nova-compute[75745]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26365393231383963
Dec 01 17:29:19 user nova-compute[75745]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOd1d440ca-ce92189cd70e48d2
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bbc1f9-a5aa-4a3f-ae68-c2df757c4780]: (4, None) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d710a0-08c6-4575-85a8-eb29a9474572]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9cd046-eaba-4d17-8f47-f0bd603d7643]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df, portal: 172.16.0.220,3260]
Dec 01 17:29:19 user nova-compute[75745]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df, portal: 172.16.0.220,3260] successful.
Dec 01 17:29:19 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0457077a-1184-47fe-a03d-ceedda41d0df -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fc6f7e-09ba-4cdc-a0ad-5312f4d260d3]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.418s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] <== disconnect_volume: return (419ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:29:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:29:19 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Deleting instance files /opt/stack/data/nova/instances/2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13_del
Dec 01 17:29:19 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Deletion of /opt/stack/data/nova/instances/2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13_del complete
Dec 01 17:29:20 user nova-compute[75745]: INFO nova.compute.manager [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Took 1.27 seconds to destroy the instance on the hypervisor.
Dec 01 17:29:20 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:29:20 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:29:20 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:29:20 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:29:20 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Took 0.95 seconds to deallocate network for instance.
Dec 01 17:29:21 user nova-compute[75745]: DEBUG nova.compute.manager [req-d8f33661-c007-48bf-862a-863f7641ecfc req-1a6bb696-d9ad-4097-938c-36a269d4b79a service nova] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Received event network-vif-deleted-eeff2c22-349b-42cf-9290-6efccc7686d6 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:29:21 user nova-compute[75745]: INFO nova.compute.manager [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Took 0.79 seconds to detach 1 volumes for instance.
Dec 01 17:29:21 user nova-compute[75745]: DEBUG nova.compute.manager [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13] Deleting volume: 0457077a-1184-47fe-a03d-ceedda41d0df {{(pid=75745) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 01 17:29:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:29:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:29:22 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:29:22 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:29:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:29:22 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Deleted allocations for instance 2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13
Dec 01 17:29:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e50f36e6-db5e-44ed-a8d0-651d2f886330 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "2d6180f1-c2aa-4d53-8ff3-e85c0d6ced13" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.534s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:29:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:29:30 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0 is timed out.
Dec 01 17:29:30 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Successfully detached device vdb from instance 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0 from the live domain config.
Dec 01 17:29:30 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QbhajuSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:29:30 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:29:30 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd9bc89-2b8d-4558-975c-3cf131eb4071]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:29:30 user nova-compute[75745]: No targets found.
Dec 01 17:29:30 user nova-compute[75745]: iSNS:
Dec 01 17:29:30 user nova-compute[75745]: No targets found.
Dec 01 17:29:30 user nova-compute[75745]: STATIC:
Dec 01 17:29:30 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0
Dec 01 17:29:30 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:29:30 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:29:30 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070
Dec 01 17:29:30 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:29:30 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:29:30 user nova-compute[75745]: FIRMWARE:
Dec 01 17:29:30 user nova-compute[75745]: No targets found.
Dec 01 17:29:30 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:29:30 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:29:30 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80931d0-a9aa-4683-ab0f-102753726b80]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa4ea5a-edcc-4570-84eb-171b049bf777]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:29:30 user nova-compute[75745]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 (non-flash)
Dec 01 17:29:30 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:29:30 user nova-compute[75745]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 (non-flash)
Dec 01 17:29:30 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f249870fac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070'): ({'sdf'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Removing single pathed devices sdf {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a185fb9f-a37c-47f1-9add-c7ca3f7a8062]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8541e6a7-7949-4798-8de2-ceeff528ab49]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Flushing IO for device /dev/sdf {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d52ba2-2a34-4d05-a6cf-70f228c847e6]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.037s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[526e9aba-86e1-4813-bc41-2d9d41cc7bf4]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] SCSI volumes sdf have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[052b3829-1cd0-497d-bd2f-768bfd6d2745]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2696315-7e8c-424e-946f-ea2438371bdc]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070, portal: 172.16.0.220,3260]
Dec 01 17:29:30 user nova-compute[75745]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070, portal: 172.16.0.220,3260] successful.
Dec 01 17:29:30 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca052d1-7350-48c8-a723-4e46c2cb7070 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[781dc42a-13da-4d46-8cdf-4d8aad41e6b7]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] <== disconnect_volume: return (286ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:29:30 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:29:31 user nova-compute[75745]: DEBUG nova.objects.instance [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lazy-loading 'flavor' on Instance uuid 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:29:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1fa0f36e-0860-4f88-9566-33a44b50185c tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.627s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:29:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:29:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:29:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:29:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:29:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:29:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:29:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:29:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:29:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:29:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:29:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:29:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:29:49 user nova-compute[75745]: DEBUG nova.compute.manager [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:29:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:29:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:29:50 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:29:50 user nova-compute[75745]: INFO nova.compute.claims [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Claim successful on node user
Dec 01 17:29:50 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:29:50 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:29:50 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.405s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:29:50 user nova-compute[75745]: DEBUG nova.compute.manager [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:29:50 user nova-compute[75745]: DEBUG nova.compute.manager [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:29:50 user nova-compute[75745]: DEBUG nova.network.neutron [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:29:50 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:29:50 user nova-compute[75745]: DEBUG nova.compute.manager [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:29:50 user nova-compute[75745]: DEBUG nova.policy [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b319a47b86c04affa1858e1c2359876b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb3ba16695543cab6f10932fd6b2d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:29:50 user nova-compute[75745]: INFO nova.virt.block_device [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Booting with volume-backed-image 695c84b8-d08d-488d-9841-cc1da92fb985 at /dev/vda
Dec 01 17:29:51 user nova-compute[75745]: DEBUG nova.network.neutron [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Successfully created port: a990f44c-7717-43df-978e-beef133804aa {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:29:51 user nova-compute[75745]: DEBUG nova.network.neutron [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Successfully updated port: a990f44c-7717-43df-978e-beef133804aa {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:29:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "refresh_cache-d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:29:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquired lock "refresh_cache-d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:29:51 user nova-compute[75745]: DEBUG nova.network.neutron [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:29:52 user nova-compute[75745]: DEBUG nova.compute.manager [req-6f632142-f36c-4e32-a276-57cc32be0ca2 req-812fd33c-ddcb-46e8-9687-683c7ce55c06 service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Received event network-changed-a990f44c-7717-43df-978e-beef133804aa {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:29:52 user nova-compute[75745]: DEBUG nova.compute.manager [req-6f632142-f36c-4e32-a276-57cc32be0ca2 req-812fd33c-ddcb-46e8-9687-683c7ce55c06 service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Refreshing instance network info cache due to event network-changed-a990f44c-7717-43df-978e-beef133804aa. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:29:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6f632142-f36c-4e32-a276-57cc32be0ca2 req-812fd33c-ddcb-46e8-9687-683c7ce55c06 service nova] Acquiring lock "refresh_cache-d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:29:52 user nova-compute[75745]: DEBUG nova.network.neutron [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:29:52 user nova-compute[75745]: DEBUG nova.network.neutron [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Updating instance_info_cache with network_info: [{"id": "a990f44c-7717-43df-978e-beef133804aa", "address": "fa:16:3e:37:53:1d", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa990f44c-77", "ovs_interfaceid": "a990f44c-7717-43df-978e-beef133804aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:29:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Releasing lock "refresh_cache-d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:29:52 user nova-compute[75745]: DEBUG nova.compute.manager [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Instance network_info: |[{"id": "a990f44c-7717-43df-978e-beef133804aa", "address": "fa:16:3e:37:53:1d", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa990f44c-77", "ovs_interfaceid": "a990f44c-7717-43df-978e-beef133804aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:29:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6f632142-f36c-4e32-a276-57cc32be0ca2 req-812fd33c-ddcb-46e8-9687-683c7ce55c06 service nova] Acquired lock "refresh_cache-d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:29:52 user nova-compute[75745]: DEBUG nova.network.neutron [req-6f632142-f36c-4e32-a276-57cc32be0ca2 req-812fd33c-ddcb-46e8-9687-683c7ce55c06 service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Refreshing network info cache for port a990f44c-7717-43df-978e-beef133804aa {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:29:52 user nova-compute[75745]: DEBUG nova.network.neutron [req-6f632142-f36c-4e32-a276-57cc32be0ca2 req-812fd33c-ddcb-46e8-9687-683c7ce55c06 service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Updated VIF entry in instance network info cache for port a990f44c-7717-43df-978e-beef133804aa. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:29:52 user nova-compute[75745]: DEBUG nova.network.neutron [req-6f632142-f36c-4e32-a276-57cc32be0ca2 req-812fd33c-ddcb-46e8-9687-683c7ce55c06 service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Updating instance_info_cache with network_info: [{"id": "a990f44c-7717-43df-978e-beef133804aa", "address": "fa:16:3e:37:53:1d", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa990f44c-77", "ovs_interfaceid": "a990f44c-7717-43df-978e-beef133804aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:29:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6f632142-f36c-4e32-a276-57cc32be0ca2 req-812fd33c-ddcb-46e8-9687-683c7ce55c06 service nova] Releasing lock "refresh_cache-d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:29:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:29:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:29:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:29:55 user nova-compute[75745]: DEBUG nova.compute.manager [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:29:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:29:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:29:55 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:29:55 user nova-compute[75745]: INFO nova.compute.claims [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Claim successful on node user
Dec 01 17:29:55 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:29:55 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:29:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.473s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:29:55 user nova-compute[75745]: DEBUG nova.compute.manager [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:29:55 user nova-compute[75745]: DEBUG nova.compute.manager [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:29:55 user nova-compute[75745]: DEBUG nova.network.neutron [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:29:55 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:29:55 user nova-compute[75745]: DEBUG nova.compute.manager [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:29:55 user nova-compute[75745]: DEBUG nova.policy [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f75082346bbd4b2ebfc585a25a897f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3088641ea74a31a80ade2623f85d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:29:56 user nova-compute[75745]: DEBUG nova.compute.manager [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:29:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:29:56 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Creating image(s)
Dec 01 17:29:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "/opt/stack/data/nova/instances/37d1f284-e5ec-4f47-b819-e8ed8ca793d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:29:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "/opt/stack/data/nova/instances/37d1f284-e5ec-4f47-b819-e8ed8ca793d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:29:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "/opt/stack/data/nova/instances/37d1f284-e5ec-4f47-b819-e8ed8ca793d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:29:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "1272d41440fb2e0fa65f0fb2741276acbb416358" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:29:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "1272d41440fb2e0fa65f0fb2741276acbb416358" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:29:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1272d41440fb2e0fa65f0fb2741276acbb416358.part --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:56 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:29:56 user nova-compute[75745]: DEBUG nova.network.neutron [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Successfully created port: 511358d5-fc8c-4824-9f9e-1c7cda2fbb66 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:29:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1272d41440fb2e0fa65f0fb2741276acbb416358.part --force-share --output=json" returned: 0 in 0.201s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:56 user nova-compute[75745]: DEBUG nova.virt.images [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] affe1df3-19c1-458a-9ea6-a248b53c0c02 was qcow2, converting to raw {{(pid=75745) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 01 17:29:56 user nova-compute[75745]: DEBUG nova.privsep.utils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75745) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 17:29:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1272d41440fb2e0fa65f0fb2741276acbb416358.part /opt/stack/data/nova/instances/_base/1272d41440fb2e0fa65f0fb2741276acbb416358.converted {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:56 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:29:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1272d41440fb2e0fa65f0fb2741276acbb416358.part /opt/stack/data/nova/instances/_base/1272d41440fb2e0fa65f0fb2741276acbb416358.converted" returned: 0 in 0.434s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1272d41440fb2e0fa65f0fb2741276acbb416358.converted --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1272d41440fb2e0fa65f0fb2741276acbb416358.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "1272d41440fb2e0fa65f0fb2741276acbb416358" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.225s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:29:57 user nova-compute[75745]: DEBUG nova.network.neutron [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Successfully updated port: 511358d5-fc8c-4824-9f9e-1c7cda2fbb66 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:29:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1272d41440fb2e0fa65f0fb2741276acbb416358 --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "refresh_cache-37d1f284-e5ec-4f47-b819-e8ed8ca793d7" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:29:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquired lock "refresh_cache-37d1f284-e5ec-4f47-b819-e8ed8ca793d7" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:29:57 user nova-compute[75745]: DEBUG nova.network.neutron [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:29:57 user nova-compute[75745]: DEBUG nova.compute.manager [req-76bce080-723c-4307-a19a-0db3a4f5eb3a req-dfc07abf-8f72-46b9-a345-0e2522b42e74 service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Received event network-changed-511358d5-fc8c-4824-9f9e-1c7cda2fbb66 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:29:57 user nova-compute[75745]: DEBUG nova.compute.manager [req-76bce080-723c-4307-a19a-0db3a4f5eb3a req-dfc07abf-8f72-46b9-a345-0e2522b42e74 service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Refreshing instance network info cache due to event network-changed-511358d5-fc8c-4824-9f9e-1c7cda2fbb66. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:29:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-76bce080-723c-4307-a19a-0db3a4f5eb3a req-dfc07abf-8f72-46b9-a345-0e2522b42e74 service nova] Acquiring lock "refresh_cache-37d1f284-e5ec-4f47-b819-e8ed8ca793d7" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:29:57 user nova-compute[75745]: DEBUG nova.network.neutron [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:29:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1272d41440fb2e0fa65f0fb2741276acbb416358 --force-share --output=json" returned: 0 in 0.173s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "1272d41440fb2e0fa65f0fb2741276acbb416358" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:29:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "1272d41440fb2e0fa65f0fb2741276acbb416358" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:29:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1272d41440fb2e0fa65f0fb2741276acbb416358 --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1272d41440fb2e0fa65f0fb2741276acbb416358 --force-share --output=json" returned: 0 in 0.189s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1272d41440fb2e0fa65f0fb2741276acbb416358,backing_fmt=raw /opt/stack/data/nova/instances/37d1f284-e5ec-4f47-b819-e8ed8ca793d7/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:57 user nova-compute[75745]: DEBUG nova.network.neutron [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Updating instance_info_cache with network_info: [{"id": "511358d5-fc8c-4824-9f9e-1c7cda2fbb66", "address": "fa:16:3e:89:52:37", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511358d5-fc", "ovs_interfaceid": "511358d5-fc8c-4824-9f9e-1c7cda2fbb66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:29:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1272d41440fb2e0fa65f0fb2741276acbb416358,backing_fmt=raw /opt/stack/data/nova/instances/37d1f284-e5ec-4f47-b819-e8ed8ca793d7/disk 1073741824" returned: 0 in 0.049s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "1272d41440fb2e0fa65f0fb2741276acbb416358" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:29:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1272d41440fb2e0fa65f0fb2741276acbb416358 --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Releasing lock "refresh_cache-37d1f284-e5ec-4f47-b819-e8ed8ca793d7" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:29:57 user nova-compute[75745]: DEBUG nova.compute.manager [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Instance network_info: |[{"id": "511358d5-fc8c-4824-9f9e-1c7cda2fbb66", "address": "fa:16:3e:89:52:37", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511358d5-fc", "ovs_interfaceid": "511358d5-fc8c-4824-9f9e-1c7cda2fbb66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:29:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-76bce080-723c-4307-a19a-0db3a4f5eb3a req-dfc07abf-8f72-46b9-a345-0e2522b42e74 service nova] Acquired lock "refresh_cache-37d1f284-e5ec-4f47-b819-e8ed8ca793d7" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:29:57 user nova-compute[75745]: DEBUG nova.network.neutron [req-76bce080-723c-4307-a19a-0db3a4f5eb3a req-dfc07abf-8f72-46b9-a345-0e2522b42e74 service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Refreshing network info cache for port 511358d5-fc8c-4824-9f9e-1c7cda2fbb66 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:29:57 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:29:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1272d41440fb2e0fa65f0fb2741276acbb416358 --force-share --output=json" returned: 0 in 0.176s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:57 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:29:57 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:29:57 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Checking if we can resize image /opt/stack/data/nova/instances/37d1f284-e5ec-4f47-b819-e8ed8ca793d7/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:29:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37d1f284-e5ec-4f47-b819-e8ed8ca793d7/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37d1f284-e5ec-4f47-b819-e8ed8ca793d7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Cannot resize image /opt/stack/data/nova/instances/37d1f284-e5ec-4f47-b819-e8ed8ca793d7/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Ensure instance console log exists: /opt/stack/data/nova/instances/37d1f284-e5ec-4f47-b819-e8ed8ca793d7/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Start _get_guest_xml network_info=[{"id": "511358d5-fc8c-4824-9f9e-1c7cda2fbb66", "address": "fa:16:3e:89:52:37", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511358d5-fc", "ovs_interfaceid": "511358d5-fc8c-4824-9f9e-1c7cda2fbb66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:29:52Z,direct_url=<?>,disk_format='qcow2',id=affe1df3-19c1-458a-9ea6-a248b53c0c02,min_disk=0,min_ram=0,name='tempest-scenario-img--1266089677',owner='0c3088641ea74a31a80ade2623f85d91',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:29:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': 'affe1df3-19c1-458a-9ea6-a248b53c0c02'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:29:58 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:29:58 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:29:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:29:52Z,direct_url=<?>,disk_format='qcow2',id=affe1df3-19c1-458a-9ea6-a248b53c0c02,min_disk=0,min_ram=0,name='tempest-scenario-img--1266089677',owner='0c3088641ea74a31a80ade2623f85d91',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:29:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:29:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2116842336',display_name='tempest-TestMinimumBasicScenario-server-2116842336',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2116842336',id=41,image_ref='affe1df3-19c1-458a-9ea6-a248b53c0c02',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYI9OAeaPOMbOyq2tDbp4piZfifdWO4vL2uVJa61KkZCE4V1M1c/pCraShGJLc0bUEbxaGHc+vGZgIA0wGJjwv2ttR3ywRee1Bp1AAIAY5cAMO7QZfuaoRjdvqxLdqn5w==',key_name='tempest-TestMinimumBasicScenario-132590777',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c3088641ea74a31a80ade2623f85d91',ramdisk_id='',reservation_id='r-7funols1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='affe1df3-19c1-458a-9ea6-a248b53c0c02',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-865236074',owner_user_name='tempest-TestMinimumBasicScenario-865236074-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:29:56Z,user_data=None,user_id='f75082346bbd4b2ebfc585a25a897f81',uuid=37d1f284-e5ec-4f47-b819-e8ed8ca793d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "511358d5-fc8c-4824-9f9e-1c7cda2fbb66", "address": "fa:16:3e:89:52:37", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511358d5-fc", "ovs_interfaceid": "511358d5-fc8c-4824-9f9e-1c7cda2fbb66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Converting VIF {"id": "511358d5-fc8c-4824-9f9e-1c7cda2fbb66", "address": "fa:16:3e:89:52:37", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511358d5-fc", "ovs_interfaceid": "511358d5-fc8c-4824-9f9e-1c7cda2fbb66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:52:37,bridge_name='br-int',has_traffic_filtering=True,id=511358d5-fc8c-4824-9f9e-1c7cda2fbb66,network=Network(bfcf7108-b710-4459-bcd7-fbfd464ee6a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511358d5-fc') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG nova.objects.instance [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lazy-loading 'pci_devices' on Instance uuid 37d1f284-e5ec-4f47-b819-e8ed8ca793d7 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG nova.network.neutron [req-76bce080-723c-4307-a19a-0db3a4f5eb3a req-dfc07abf-8f72-46b9-a345-0e2522b42e74 service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Updated VIF entry in instance network info cache for port 511358d5-fc8c-4824-9f9e-1c7cda2fbb66. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG nova.network.neutron [req-76bce080-723c-4307-a19a-0db3a4f5eb3a req-dfc07abf-8f72-46b9-a345-0e2522b42e74 service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Updating instance_info_cache with network_info: [{"id": "511358d5-fc8c-4824-9f9e-1c7cda2fbb66", "address": "fa:16:3e:89:52:37", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511358d5-fc", "ovs_interfaceid": "511358d5-fc8c-4824-9f9e-1c7cda2fbb66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:29:58 user nova-compute[75745]:   <uuid>37d1f284-e5ec-4f47-b819-e8ed8ca793d7</uuid>
Dec 01 17:29:58 user nova-compute[75745]:   <name>instance-00000029</name>
Dec 01 17:29:58 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:29:58 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:29:58 user nova-compute[75745]:   <metadata>
Dec 01 17:29:58 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:29:58 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:29:58 user nova-compute[75745]:       <nova:name>tempest-TestMinimumBasicScenario-server-2116842336</nova:name>
Dec 01 17:29:58 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:29:58</nova:creationTime>
Dec 01 17:29:58 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:29:58 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:29:58 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:29:58 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:29:58 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:29:58 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:29:58 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:29:58 user nova-compute[75745]:       <nova:owner>
Dec 01 17:29:58 user nova-compute[75745]:         <nova:user uuid="f75082346bbd4b2ebfc585a25a897f81">tempest-TestMinimumBasicScenario-865236074-project-member</nova:user>
Dec 01 17:29:58 user nova-compute[75745]:         <nova:project uuid="0c3088641ea74a31a80ade2623f85d91">tempest-TestMinimumBasicScenario-865236074</nova:project>
Dec 01 17:29:58 user nova-compute[75745]:       </nova:owner>
Dec 01 17:29:58 user nova-compute[75745]:       <nova:root type="image" uuid="affe1df3-19c1-458a-9ea6-a248b53c0c02"/>
Dec 01 17:29:58 user nova-compute[75745]:       <nova:ports>
Dec 01 17:29:58 user nova-compute[75745]:         <nova:port uuid="511358d5-fc8c-4824-9f9e-1c7cda2fbb66">
Dec 01 17:29:58 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 01 17:29:58 user nova-compute[75745]:         </nova:port>
Dec 01 17:29:58 user nova-compute[75745]:       </nova:ports>
Dec 01 17:29:58 user nova-compute[75745]:     </nova:instance>
Dec 01 17:29:58 user nova-compute[75745]:   </metadata>
Dec 01 17:29:58 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:29:58 user nova-compute[75745]:     <system>
Dec 01 17:29:58 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:29:58 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:29:58 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:29:58 user nova-compute[75745]:       <entry name="serial">37d1f284-e5ec-4f47-b819-e8ed8ca793d7</entry>
Dec 01 17:29:58 user nova-compute[75745]:       <entry name="uuid">37d1f284-e5ec-4f47-b819-e8ed8ca793d7</entry>
Dec 01 17:29:58 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:29:58 user nova-compute[75745]:     </system>
Dec 01 17:29:58 user nova-compute[75745]:   </sysinfo>
Dec 01 17:29:58 user nova-compute[75745]:   <os>
Dec 01 17:29:58 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:29:58 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:29:58 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:29:58 user nova-compute[75745]:   </os>
Dec 01 17:29:58 user nova-compute[75745]:   <features>
Dec 01 17:29:58 user nova-compute[75745]:     <acpi/>
Dec 01 17:29:58 user nova-compute[75745]:     <apic/>
Dec 01 17:29:58 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:29:58 user nova-compute[75745]:   </features>
Dec 01 17:29:58 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:29:58 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:29:58 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:29:58 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:29:58 user nova-compute[75745]:   </clock>
Dec 01 17:29:58 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:29:58 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:29:58 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:29:58 user nova-compute[75745]:   </cpu>
Dec 01 17:29:58 user nova-compute[75745]:   <devices>
Dec 01 17:29:58 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:29:58 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:29:58 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/37d1f284-e5ec-4f47-b819-e8ed8ca793d7/disk"/>
Dec 01 17:29:58 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:29:58 user nova-compute[75745]:     </disk>
Dec 01 17:29:58 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:29:58 user nova-compute[75745]:       <mac address="fa:16:3e:89:52:37"/>
Dec 01 17:29:58 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:29:58 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:29:58 user nova-compute[75745]:       <target dev="tap511358d5-fc"/>
Dec 01 17:29:58 user nova-compute[75745]:     </interface>
Dec 01 17:29:58 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:29:58 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/37d1f284-e5ec-4f47-b819-e8ed8ca793d7/console.log" append="off"/>
Dec 01 17:29:58 user nova-compute[75745]:     </serial>
Dec 01 17:29:58 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:29:58 user nova-compute[75745]:     <video>
Dec 01 17:29:58 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:29:58 user nova-compute[75745]:     </video>
Dec 01 17:29:58 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:29:58 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:29:58 user nova-compute[75745]:     </rng>
Dec 01 17:29:58 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:29:58 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:29:58 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:29:58 user nova-compute[75745]:     </memballoon>
Dec 01 17:29:58 user nova-compute[75745]:   </devices>
Dec 01 17:29:58 user nova-compute[75745]: </domain>
Dec 01 17:29:58 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:29:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2116842336',display_name='tempest-TestMinimumBasicScenario-server-2116842336',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2116842336',id=41,image_ref='affe1df3-19c1-458a-9ea6-a248b53c0c02',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYI9OAeaPOMbOyq2tDbp4piZfifdWO4vL2uVJa61KkZCE4V1M1c/pCraShGJLc0bUEbxaGHc+vGZgIA0wGJjwv2ttR3ywRee1Bp1AAIAY5cAMO7QZfuaoRjdvqxLdqn5w==',key_name='tempest-TestMinimumBasicScenario-132590777',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c3088641ea74a31a80ade2623f85d91',ramdisk_id='',reservation_id='r-7funols1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='affe1df3-19c1-458a-9ea6-a248b53c0c02',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-865236074',owner_user_name='tempest-TestMinimumBasicScenario-865236074-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:29:56Z,user_data=None,user_id='f75082346bbd4b2ebfc585a25a897f81',uuid=37d1f284-e5ec-4f47-b819-e8ed8ca793d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "511358d5-fc8c-4824-9f9e-1c7cda2fbb66", "address": "fa:16:3e:89:52:37", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511358d5-fc", "ovs_interfaceid": "511358d5-fc8c-4824-9f9e-1c7cda2fbb66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Converting VIF {"id": "511358d5-fc8c-4824-9f9e-1c7cda2fbb66", "address": "fa:16:3e:89:52:37", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511358d5-fc", "ovs_interfaceid": "511358d5-fc8c-4824-9f9e-1c7cda2fbb66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:52:37,bridge_name='br-int',has_traffic_filtering=True,id=511358d5-fc8c-4824-9f9e-1c7cda2fbb66,network=Network(bfcf7108-b710-4459-bcd7-fbfd464ee6a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511358d5-fc') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG os_vif [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:52:37,bridge_name='br-int',has_traffic_filtering=True,id=511358d5-fc8c-4824-9f9e-1c7cda2fbb66,network=Network(bfcf7108-b710-4459-bcd7-fbfd464ee6a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511358d5-fc') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-76bce080-723c-4307-a19a-0db3a4f5eb3a req-dfc07abf-8f72-46b9-a345-0e2522b42e74 service nova] Releasing lock "refresh_cache-37d1f284-e5ec-4f47-b819-e8ed8ca793d7" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8fdd7a36-1f8c-5fbf-b815-0edb88a388dc', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap511358d5-fc, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap511358d5-fc, col_values=(('qos', UUID('2dec405b-feb5-4a5a-b61f-e4e38086d4b3')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap511358d5-fc, col_values=(('external_ids', {'iface-id': '511358d5-fc8c-4824-9f9e-1c7cda2fbb66', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:52:37', 'vm-uuid': '37d1f284-e5ec-4f47-b819-e8ed8ca793d7'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:58 user nova-compute[75745]: INFO os_vif [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:52:37,bridge_name='br-int',has_traffic_filtering=True,id=511358d5-fc8c-4824-9f9e-1c7cda2fbb66,network=Network(bfcf7108-b710-4459-bcd7-fbfd464ee6a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511358d5-fc')
Dec 01 17:29:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:29:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] No VIF found with MAC fa:16:3e:89:52:37, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:29:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:59 user nova-compute[75745]: DEBUG nova.compute.manager [req-e386c6d9-aee6-4a2c-80bc-ae4109db9d15 req-3521665a-dd52-4f9a-9282-c3fa36f8af8f service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Received event network-vif-plugged-511358d5-fc8c-4824-9f9e-1c7cda2fbb66 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:29:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e386c6d9-aee6-4a2c-80bc-ae4109db9d15 req-3521665a-dd52-4f9a-9282-c3fa36f8af8f service nova] Acquiring lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:29:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e386c6d9-aee6-4a2c-80bc-ae4109db9d15 req-3521665a-dd52-4f9a-9282-c3fa36f8af8f service nova] Lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:29:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e386c6d9-aee6-4a2c-80bc-ae4109db9d15 req-3521665a-dd52-4f9a-9282-c3fa36f8af8f service nova] Lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:29:59 user nova-compute[75745]: DEBUG nova.compute.manager [req-e386c6d9-aee6-4a2c-80bc-ae4109db9d15 req-3521665a-dd52-4f9a-9282-c3fa36f8af8f service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] No waiting events found dispatching network-vif-plugged-511358d5-fc8c-4824-9f9e-1c7cda2fbb66 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:29:59 user nova-compute[75745]: WARNING nova.compute.manager [req-e386c6d9-aee6-4a2c-80bc-ae4109db9d15 req-3521665a-dd52-4f9a-9282-c3fa36f8af8f service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Received unexpected event network-vif-plugged-511358d5-fc8c-4824-9f9e-1c7cda2fbb66 for instance with vm_state building and task_state spawning.
Dec 01 17:29:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:29:59 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:30:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e87581b6-ccb8-4da0-a8bc-9c06006d4cc8 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Acquiring lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:30:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e87581b6-ccb8-4da0-a8bc-9c06006d4cc8 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:30:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e87581b6-ccb8-4da0-a8bc-9c06006d4cc8 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Acquiring lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:30:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e87581b6-ccb8-4da0-a8bc-9c06006d4cc8 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:30:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e87581b6-ccb8-4da0-a8bc-9c06006d4cc8 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:30:00 user nova-compute[75745]: INFO nova.compute.manager [None req-e87581b6-ccb8-4da0-a8bc-9c06006d4cc8 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Terminating instance
Dec 01 17:30:00 user nova-compute[75745]: DEBUG nova.compute.manager [None req-e87581b6-ccb8-4da0-a8bc-9c06006d4cc8 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:30:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:00 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:30:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:30:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:30:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:30:00 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:30:01 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Instance destroyed successfully.
Dec 01 17:30:01 user nova-compute[75745]: DEBUG nova.objects.instance [None req-e87581b6-ccb8-4da0-a8bc-9c06006d4cc8 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lazy-loading 'resources' on Instance uuid 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-e87581b6-ccb8-4da0-a8bc-9c06006d4cc8 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:25:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1334314493',display_name='tempest-TestServerVolumeAttachmentScenario-server-1334314493',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1334314493',id=37,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqYlk8vqz6QWZawAqdvjDnEe0YBEViA8IxogPlvCutaB8WK59gKlA+x/zY+CS5CS5s21moQ/dR8n3LHuLfRELOPrzgnR7VMAZI8rTtpvQkMdhnC+s/fEhC9TyJaIczwIg==',key_name='tempest-keypair-426900645',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:26:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3244f1ca511a4c28809d26a694c45ee1',ramdisk_id='',reservation_id='r-55nns4dp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1906576828',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1906576828-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:26:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9787e4d7695a4187812090fcaf302a98',uuid=9ff5eaad-45ab-4a21-bc9b-9ecef436cab0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66185694-ac7f-4baa-9c61-6d19fd57ac5a", "address": "fa:16:3e:14:45:fc", "network": {"id": "a4801184-db1f-4acf-8cb8-5e26d3c01c33", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2001575939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3244f1ca511a4c28809d26a694c45ee1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66185694-ac", "ovs_interfaceid": "66185694-ac7f-4baa-9c61-6d19fd57ac5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-e87581b6-ccb8-4da0-a8bc-9c06006d4cc8 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Converting VIF {"id": "66185694-ac7f-4baa-9c61-6d19fd57ac5a", "address": "fa:16:3e:14:45:fc", "network": {"id": "a4801184-db1f-4acf-8cb8-5e26d3c01c33", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2001575939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3244f1ca511a4c28809d26a694c45ee1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66185694-ac", "ovs_interfaceid": "66185694-ac7f-4baa-9c61-6d19fd57ac5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-e87581b6-ccb8-4da0-a8bc-9c06006d4cc8 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:45:fc,bridge_name='br-int',has_traffic_filtering=True,id=66185694-ac7f-4baa-9c61-6d19fd57ac5a,network=Network(a4801184-db1f-4acf-8cb8-5e26d3c01c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66185694-ac') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG os_vif [None req-e87581b6-ccb8-4da0-a8bc-9c06006d4cc8 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:45:fc,bridge_name='br-int',has_traffic_filtering=True,id=66185694-ac7f-4baa-9c61-6d19fd57ac5a,network=Network(a4801184-db1f-4acf-8cb8-5e26d3c01c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66185694-ac') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66185694-ac, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a2a68111-a4bf-447c-9864-43b895b3b81e) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:30:01 user nova-compute[75745]: INFO os_vif [None req-e87581b6-ccb8-4da0-a8bc-9c06006d4cc8 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:45:fc,bridge_name='br-int',has_traffic_filtering=True,id=66185694-ac7f-4baa-9c61-6d19fd57ac5a,network=Network(a4801184-db1f-4acf-8cb8-5e26d3c01c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66185694-ac')
Dec 01 17:30:01 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-e87581b6-ccb8-4da0-a8bc-9c06006d4cc8 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Deleting instance files /opt/stack/data/nova/instances/9ff5eaad-45ab-4a21-bc9b-9ecef436cab0_del
Dec 01 17:30:01 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-e87581b6-ccb8-4da0-a8bc-9c06006d4cc8 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Deletion of /opt/stack/data/nova/instances/9ff5eaad-45ab-4a21-bc9b-9ecef436cab0_del complete
Dec 01 17:30:01 user nova-compute[75745]: INFO nova.compute.manager [None req-e87581b6-ccb8-4da0-a8bc-9c06006d4cc8 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Took 0.87 seconds to destroy the instance on the hypervisor.
Dec 01 17:30:01 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-e87581b6-ccb8-4da0-a8bc-9c06006d4cc8 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG nova.compute.manager [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:30:01 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Instance spawned successfully.
Dec 01 17:30:01 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG nova.compute.manager [req-67ec1ab8-d10c-492a-b2a9-e7822a6f0ca5 req-d3b0ee9e-9c92-4b91-b2fb-085fecf9808d service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Received event network-vif-plugged-511358d5-fc8c-4824-9f9e-1c7cda2fbb66 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-67ec1ab8-d10c-492a-b2a9-e7822a6f0ca5 req-d3b0ee9e-9c92-4b91-b2fb-085fecf9808d service nova] Acquiring lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-67ec1ab8-d10c-492a-b2a9-e7822a6f0ca5 req-d3b0ee9e-9c92-4b91-b2fb-085fecf9808d service nova] Lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-67ec1ab8-d10c-492a-b2a9-e7822a6f0ca5 req-d3b0ee9e-9c92-4b91-b2fb-085fecf9808d service nova] Lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG nova.compute.manager [req-67ec1ab8-d10c-492a-b2a9-e7822a6f0ca5 req-d3b0ee9e-9c92-4b91-b2fb-085fecf9808d service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] No waiting events found dispatching network-vif-plugged-511358d5-fc8c-4824-9f9e-1c7cda2fbb66 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:30:01 user nova-compute[75745]: WARNING nova.compute.manager [req-67ec1ab8-d10c-492a-b2a9-e7822a6f0ca5 req-d3b0ee9e-9c92-4b91-b2fb-085fecf9808d service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Received unexpected event network-vif-plugged-511358d5-fc8c-4824-9f9e-1c7cda2fbb66 for instance with vm_state building and task_state spawning.
Dec 01 17:30:01 user nova-compute[75745]: DEBUG nova.compute.manager [req-67ec1ab8-d10c-492a-b2a9-e7822a6f0ca5 req-d3b0ee9e-9c92-4b91-b2fb-085fecf9808d service nova] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Received event network-vif-unplugged-66185694-ac7f-4baa-9c61-6d19fd57ac5a {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-67ec1ab8-d10c-492a-b2a9-e7822a6f0ca5 req-d3b0ee9e-9c92-4b91-b2fb-085fecf9808d service nova] Acquiring lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-67ec1ab8-d10c-492a-b2a9-e7822a6f0ca5 req-d3b0ee9e-9c92-4b91-b2fb-085fecf9808d service nova] Lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-67ec1ab8-d10c-492a-b2a9-e7822a6f0ca5 req-d3b0ee9e-9c92-4b91-b2fb-085fecf9808d service nova] Lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG nova.compute.manager [req-67ec1ab8-d10c-492a-b2a9-e7822a6f0ca5 req-d3b0ee9e-9c92-4b91-b2fb-085fecf9808d service nova] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] No waiting events found dispatching network-vif-unplugged-66185694-ac7f-4baa-9c61-6d19fd57ac5a {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG nova.compute.manager [req-67ec1ab8-d10c-492a-b2a9-e7822a6f0ca5 req-d3b0ee9e-9c92-4b91-b2fb-085fecf9808d service nova] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Received event network-vif-unplugged-66185694-ac7f-4baa-9c61-6d19fd57ac5a for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG nova.compute.manager [req-67ec1ab8-d10c-492a-b2a9-e7822a6f0ca5 req-d3b0ee9e-9c92-4b91-b2fb-085fecf9808d service nova] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Received event network-vif-plugged-66185694-ac7f-4baa-9c61-6d19fd57ac5a {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-67ec1ab8-d10c-492a-b2a9-e7822a6f0ca5 req-d3b0ee9e-9c92-4b91-b2fb-085fecf9808d service nova] Acquiring lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-67ec1ab8-d10c-492a-b2a9-e7822a6f0ca5 req-d3b0ee9e-9c92-4b91-b2fb-085fecf9808d service nova] Lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-67ec1ab8-d10c-492a-b2a9-e7822a6f0ca5 req-d3b0ee9e-9c92-4b91-b2fb-085fecf9808d service nova] Lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG nova.compute.manager [req-67ec1ab8-d10c-492a-b2a9-e7822a6f0ca5 req-d3b0ee9e-9c92-4b91-b2fb-085fecf9808d service nova] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] No waiting events found dispatching network-vif-plugged-66185694-ac7f-4baa-9c61-6d19fd57ac5a {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:30:01 user nova-compute[75745]: WARNING nova.compute.manager [req-67ec1ab8-d10c-492a-b2a9-e7822a6f0ca5 req-d3b0ee9e-9c92-4b91-b2fb-085fecf9808d service nova] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Received unexpected event network-vif-plugged-66185694-ac7f-4baa-9c61-6d19fd57ac5a for instance with vm_state active and task_state deleting.
Dec 01 17:30:01 user nova-compute[75745]: DEBUG os_brick.utils [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b89228-dfb1-4beb-b65a-ef27b19937e3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cf0ff5-7531-4b6f-8947-0afc23ae2a86]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:01 user nova-compute[75745]: INFO nova.compute.manager [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Took 5.79 seconds to spawn the instance on the hypervisor.
Dec 01 17:30:01 user nova-compute[75745]: DEBUG nova.compute.manager [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d8b7a4-f060-4844-84ca-60af4f3bde75]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b915eca7-2ad3-4576-8f97-3b80485acc0d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:30:01 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:30:01 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd34242-8705-44fd-bc54-549b5bd9fa5a]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG os_brick.utils [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Updating existing volume attachment record: 264acdef-511a-4adb-9655-024288ee57c1 {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:30:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:01 user nova-compute[75745]: INFO nova.compute.manager [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Took 6.68 seconds to build instance.
Dec 01 17:30:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9e0c1395-9e4b-48d6-8c29-4da85aaca18a tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.782s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:30:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:02 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:30:02 user nova-compute[75745]: DEBUG nova.compute.manager [req-daf1c216-5b95-4792-965e-9d89fff92819 req-593086a3-3005-4c25-94bd-dec72fb79e1b service nova] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Received event network-vif-deleted-66185694-ac7f-4baa-9c61-6d19fd57ac5a {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:30:02 user nova-compute[75745]: INFO nova.compute.manager [req-daf1c216-5b95-4792-965e-9d89fff92819 req-593086a3-3005-4c25-94bd-dec72fb79e1b service nova] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Neutron deleted interface 66185694-ac7f-4baa-9c61-6d19fd57ac5a; detaching it from the instance and deleting it from the info cache
Dec 01 17:30:02 user nova-compute[75745]: DEBUG nova.network.neutron [req-daf1c216-5b95-4792-965e-9d89fff92819 req-593086a3-3005-4c25-94bd-dec72fb79e1b service nova] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:30:02 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Took 0.88 seconds to deallocate network for instance.
Dec 01 17:30:02 user nova-compute[75745]: DEBUG nova.compute.manager [req-daf1c216-5b95-4792-965e-9d89fff92819 req-593086a3-3005-4c25-94bd-dec72fb79e1b service nova] [instance: 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0] Detach interface failed, port_id=66185694-ac7f-4baa-9c61-6d19fd57ac5a, reason: Instance 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0 could not be found. {{(pid=75745) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 17:30:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e87581b6-ccb8-4da0-a8bc-9c06006d4cc8 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:30:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e87581b6-ccb8-4da0-a8bc-9c06006d4cc8 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:30:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31824d74-830c-4feb-ae7c-d68f23cc3a07/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:02 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-e87581b6-ccb8-4da0-a8bc-9c06006d4cc8 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:30:02 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-e87581b6-ccb8-4da0-a8bc-9c06006d4cc8 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:30:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e87581b6-ccb8-4da0-a8bc-9c06006d4cc8 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.473s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:30:02 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-e87581b6-ccb8-4da0-a8bc-9c06006d4cc8 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Deleted allocations for instance 9ff5eaad-45ab-4a21-bc9b-9ecef436cab0
Dec 01 17:30:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31824d74-830c-4feb-ae7c-d68f23cc3a07/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31824d74-830c-4feb-ae7c-d68f23cc3a07/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e87581b6-ccb8-4da0-a8bc-9c06006d4cc8 tempest-TestServerVolumeAttachmentScenario-1906576828 tempest-TestServerVolumeAttachmentScenario-1906576828-project-member] Lock "9ff5eaad-45ab-4a21-bc9b-9ecef436cab0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.441s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:30:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31824d74-830c-4feb-ae7c-d68f23cc3a07/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:03 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Error from libvirt while getting description of instance-00000025: [Error Code 42] Domain not found: no domain with matching uuid '9ff5eaad-45ab-4a21-bc9b-9ecef436cab0' (instance-00000025): libvirt.libvirtError: Domain not found: no domain with matching uuid '9ff5eaad-45ab-4a21-bc9b-9ecef436cab0' (instance-00000025)
Dec 01 17:30:03 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:30:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37d1f284-e5ec-4f47-b819-e8ed8ca793d7/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37d1f284-e5ec-4f47-b819-e8ed8ca793d7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37d1f284-e5ec-4f47-b819-e8ed8ca793d7/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37d1f284-e5ec-4f47-b819-e8ed8ca793d7/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:05 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:30:05 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:30:05 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=8220MB free_disk=25.002933502197266GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:30:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:30:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:30:05 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance d997cdd6-67c6-4263-814a-17cf9e27bbeb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:30:05 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance e4ffb96e-456c-4fb9-9850-9e98310d63e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:30:05 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 80962f79-dbb2-4380-b2c8-791642cfa86b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:30:05 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 5e631ac3-8122-46a3-a54f-2395c0f7cf7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:30:05 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 5aee52eb-78e3-4f60-a920-7ade912735e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:30:05 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 61e0e19b-f926-4524-82c8-833f804c9b72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:30:05 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 31824d74-830c-4feb-ae7c-d68f23cc3a07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:30:05 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:30:05 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 37d1f284-e5ec-4f47-b819-e8ed8ca793d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:30:05 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:30:05 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:30:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:05 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:30:05 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:30:05 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:30:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.455s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:30:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:06 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:30:06 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:30:06 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:30:06 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:30:06 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Didn't find any instances for network info cache update. {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 17:30:07 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG nova.compute.manager [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:30:11 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Creating image(s)
Dec 01 17:30:11 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Did not create local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Ensure instance console log exists: /opt/stack/data/nova/instances/d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Start _get_guest_xml network_info=[{"id": "a990f44c-7717-43df-978e-beef133804aa", "address": "fa:16:3e:37:53:1d", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa990f44c-77", "ovs_interfaceid": "a990f44c-7717-43df-978e-beef133804aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': '264acdef-511a-4adb-9655-024288ee57c1', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zcMiHqma', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3', 'attached_at': '', 'detached_at': '', 'volume_id': '522008c2-67f6-409f-ab67-f7d85f0c7c7a', 'serial': '522008c2-67f6-409f-ab67-f7d85f0c7c7a'}, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:30:11 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:30:11 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:30:11 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zcMiHqma', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:30:11 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:30:11 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:30:11 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:30:11 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:30:11 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:30:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9f0f4b-e4ba-4c5e-930e-19d484780cd9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:30:11 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7aeea0-e91a-417e-a95a-f199e6de2c54]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a] added
Dec 01 17:30:11 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc39116-31e9-41cc-bed2-b9803a61d166]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9da72eb-b406-4dda-8d60-f527acab73b2]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zcMiHqma {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zcMiHqma" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4741f667-72e2-421b-b278-6c58269c467d]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zcMiHqma'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed4effb-5698-4bc5-8aa9-3f4efc2e522f]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cfad10-3300-47c3-b6ce-18efb86bce4f]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:30:11 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:30:11 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e475116-41d8-475d-9d88-fa00ffe26354]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a, portal: 172.16.0.220,3260]
Dec 01 17:30:11 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a, portal: 172.16.0.220,3260] successful.
Dec 01 17:30:11 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5533ee-6785-4537-850f-779014cd80a0]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[293c12cb-8eec-42e3-8067-127580adeda1]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:30:11 user nova-compute[75745]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a (non-flash)
Dec 01 17:30:11 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:30:11 user nova-compute[75745]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a (non-flash)
Dec 01 17:30:11 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.028s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1874c6f4-dc24-472a-81a4-6bbc1e4d7250]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:30:11 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: None {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:30:12 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:30:12 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zcMiHqma', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:30:12 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:30:12 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23337623631356232', 'path': '/dev/sdc'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:30:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337623631356232', 'path': '/dev/sdc'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:30:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:29:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-371241425',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-371241425',id=40,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='adb3ba16695543cab6f10932fd6b2d2d',ramdisk_id='',reservation_id='r-aiu251ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-90723689',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:29:51Z,user_data=None,user_id='b319a47b86c04affa1858e1c2359876b',uuid=d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a990f44c-7717-43df-978e-beef133804aa", "address": "fa:16:3e:37:53:1d", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa990f44c-77", "ovs_interfaceid": "a990f44c-7717-43df-978e-beef133804aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:30:12 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Converting VIF {"id": "a990f44c-7717-43df-978e-beef133804aa", "address": "fa:16:3e:37:53:1d", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa990f44c-77", "ovs_interfaceid": "a990f44c-7717-43df-978e-beef133804aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:30:12 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:53:1d,bridge_name='br-int',has_traffic_filtering=True,id=a990f44c-7717-43df-978e-beef133804aa,network=Network(bf1db63d-d427-41c2-ac82-6fab9483a423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa990f44c-77') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:30:12 user nova-compute[75745]: DEBUG nova.objects.instance [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lazy-loading 'pci_devices' on Instance uuid d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:30:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:30:12 user nova-compute[75745]:   <uuid>d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3</uuid>
Dec 01 17:30:12 user nova-compute[75745]:   <name>instance-00000028</name>
Dec 01 17:30:12 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:30:12 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:30:12 user nova-compute[75745]:   <metadata>
Dec 01 17:30:12 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:30:12 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:30:12 user nova-compute[75745]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-371241425</nova:name>
Dec 01 17:30:12 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:30:11</nova:creationTime>
Dec 01 17:30:12 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:30:12 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:30:12 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:30:12 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:30:12 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:30:12 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:30:12 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:30:12 user nova-compute[75745]:       <nova:owner>
Dec 01 17:30:12 user nova-compute[75745]:         <nova:user uuid="b319a47b86c04affa1858e1c2359876b">tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member</nova:user>
Dec 01 17:30:12 user nova-compute[75745]:         <nova:project uuid="adb3ba16695543cab6f10932fd6b2d2d">tempest-ServerBootFromVolumeStableRescueTest-90723689</nova:project>
Dec 01 17:30:12 user nova-compute[75745]:       </nova:owner>
Dec 01 17:30:12 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:30:12 user nova-compute[75745]:       <nova:ports>
Dec 01 17:30:12 user nova-compute[75745]:         <nova:port uuid="a990f44c-7717-43df-978e-beef133804aa">
Dec 01 17:30:12 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 01 17:30:12 user nova-compute[75745]:         </nova:port>
Dec 01 17:30:12 user nova-compute[75745]:       </nova:ports>
Dec 01 17:30:12 user nova-compute[75745]:     </nova:instance>
Dec 01 17:30:12 user nova-compute[75745]:   </metadata>
Dec 01 17:30:12 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:30:12 user nova-compute[75745]:     <system>
Dec 01 17:30:12 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:30:12 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:30:12 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:30:12 user nova-compute[75745]:       <entry name="serial">d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3</entry>
Dec 01 17:30:12 user nova-compute[75745]:       <entry name="uuid">d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3</entry>
Dec 01 17:30:12 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:30:12 user nova-compute[75745]:     </system>
Dec 01 17:30:12 user nova-compute[75745]:   </sysinfo>
Dec 01 17:30:12 user nova-compute[75745]:   <os>
Dec 01 17:30:12 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:30:12 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:30:12 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:30:12 user nova-compute[75745]:   </os>
Dec 01 17:30:12 user nova-compute[75745]:   <features>
Dec 01 17:30:12 user nova-compute[75745]:     <acpi/>
Dec 01 17:30:12 user nova-compute[75745]:     <apic/>
Dec 01 17:30:12 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:30:12 user nova-compute[75745]:   </features>
Dec 01 17:30:12 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:30:12 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:30:12 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:30:12 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:30:12 user nova-compute[75745]:   </clock>
Dec 01 17:30:12 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:30:12 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:30:12 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:30:12 user nova-compute[75745]:   </cpu>
Dec 01 17:30:12 user nova-compute[75745]:   <devices>
Dec 01 17:30:12 user nova-compute[75745]:     <disk type="block" device="disk">
Dec 01 17:30:12 user nova-compute[75745]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:30:12 user nova-compute[75745]:       <source dev="/dev/sdc"/>
Dec 01 17:30:12 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:30:12 user nova-compute[75745]:       <serial>522008c2-67f6-409f-ab67-f7d85f0c7c7a</serial>
Dec 01 17:30:12 user nova-compute[75745]:     </disk>
Dec 01 17:30:12 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:30:12 user nova-compute[75745]:       <mac address="fa:16:3e:37:53:1d"/>
Dec 01 17:30:12 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:30:12 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:30:12 user nova-compute[75745]:       <target dev="tapa990f44c-77"/>
Dec 01 17:30:12 user nova-compute[75745]:     </interface>
Dec 01 17:30:12 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:30:12 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3/console.log" append="off"/>
Dec 01 17:30:12 user nova-compute[75745]:     </serial>
Dec 01 17:30:12 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:30:12 user nova-compute[75745]:     <video>
Dec 01 17:30:12 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:30:12 user nova-compute[75745]:     </video>
Dec 01 17:30:12 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:30:12 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:30:12 user nova-compute[75745]:     </rng>
Dec 01 17:30:12 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:30:12 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:30:12 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:30:12 user nova-compute[75745]:     </memballoon>
Dec 01 17:30:12 user nova-compute[75745]:   </devices>
Dec 01 17:30:12 user nova-compute[75745]: </domain>
Dec 01 17:30:12 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:30:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:29:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-371241425',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-371241425',id=40,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='adb3ba16695543cab6f10932fd6b2d2d',ramdisk_id='',reservation_id='r-aiu251ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-90723689',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:29:51Z,user_data=None,user_id='b319a47b86c04affa1858e1c2359876b',uuid=d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a990f44c-7717-43df-978e-beef133804aa", "address": "fa:16:3e:37:53:1d", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa990f44c-77", "ovs_interfaceid": "a990f44c-7717-43df-978e-beef133804aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:30:12 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Converting VIF {"id": "a990f44c-7717-43df-978e-beef133804aa", "address": "fa:16:3e:37:53:1d", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa990f44c-77", "ovs_interfaceid": "a990f44c-7717-43df-978e-beef133804aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:30:12 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:53:1d,bridge_name='br-int',has_traffic_filtering=True,id=a990f44c-7717-43df-978e-beef133804aa,network=Network(bf1db63d-d427-41c2-ac82-6fab9483a423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa990f44c-77') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:30:12 user nova-compute[75745]: DEBUG os_vif [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:53:1d,bridge_name='br-int',has_traffic_filtering=True,id=a990f44c-7717-43df-978e-beef133804aa,network=Network(bf1db63d-d427-41c2-ac82-6fab9483a423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa990f44c-77') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:30:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:30:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:30:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0268c594-525d-5be0-b103-130bdb468de8', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:30:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:30:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa990f44c-77, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:30:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa990f44c-77, col_values=(('qos', UUID('2e09a981-7116-44dc-b717-733ec3bacfaa')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:30:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa990f44c-77, col_values=(('external_ids', {'iface-id': 'a990f44c-7717-43df-978e-beef133804aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:53:1d', 'vm-uuid': 'd5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:30:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:30:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:12 user nova-compute[75745]: INFO os_vif [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:53:1d,bridge_name='br-int',has_traffic_filtering=True,id=a990f44c-7717-43df-978e-beef133804aa,network=Network(bf1db63d-d427-41c2-ac82-6fab9483a423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa990f44c-77')
Dec 01 17:30:13 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:30:13 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] No VIF found with MAC fa:16:3e:37:53:1d, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:30:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:14 user nova-compute[75745]: DEBUG nova.compute.manager [req-f845ea8f-9135-4ac9-9344-fe8c6b01053f req-e7e38e3e-2873-4357-bab1-85f8250c135e service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Received event network-vif-plugged-a990f44c-7717-43df-978e-beef133804aa {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:30:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-f845ea8f-9135-4ac9-9344-fe8c6b01053f req-e7e38e3e-2873-4357-bab1-85f8250c135e service nova] Acquiring lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:30:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-f845ea8f-9135-4ac9-9344-fe8c6b01053f req-e7e38e3e-2873-4357-bab1-85f8250c135e service nova] Lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:30:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-f845ea8f-9135-4ac9-9344-fe8c6b01053f req-e7e38e3e-2873-4357-bab1-85f8250c135e service nova] Lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:30:14 user nova-compute[75745]: DEBUG nova.compute.manager [req-f845ea8f-9135-4ac9-9344-fe8c6b01053f req-e7e38e3e-2873-4357-bab1-85f8250c135e service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] No waiting events found dispatching network-vif-plugged-a990f44c-7717-43df-978e-beef133804aa {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:30:14 user nova-compute[75745]: WARNING nova.compute.manager [req-f845ea8f-9135-4ac9-9344-fe8c6b01053f req-e7e38e3e-2873-4357-bab1-85f8250c135e service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Received unexpected event network-vif-plugged-a990f44c-7717-43df-978e-beef133804aa for instance with vm_state building and task_state spawning.
Dec 01 17:30:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-3f8b8ebf-63f0-4846-aed9-2c55d6e50999 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "d997cdd6-67c6-4263-814a-17cf9e27bbeb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:30:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-3f8b8ebf-63f0-4846-aed9-2c55d6e50999 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "d997cdd6-67c6-4263-814a-17cf9e27bbeb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:30:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-3f8b8ebf-63f0-4846-aed9-2c55d6e50999 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "d997cdd6-67c6-4263-814a-17cf9e27bbeb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:30:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-3f8b8ebf-63f0-4846-aed9-2c55d6e50999 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "d997cdd6-67c6-4263-814a-17cf9e27bbeb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:30:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-3f8b8ebf-63f0-4846-aed9-2c55d6e50999 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "d997cdd6-67c6-4263-814a-17cf9e27bbeb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:30:14 user nova-compute[75745]: INFO nova.compute.manager [None req-3f8b8ebf-63f0-4846-aed9-2c55d6e50999 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Terminating instance
Dec 01 17:30:14 user nova-compute[75745]: DEBUG nova.compute.manager [None req-3f8b8ebf-63f0-4846-aed9-2c55d6e50999 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:30:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1321e936-e805-44c5-ad19-c7c2177c1c97 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "80962f79-dbb2-4380-b2c8-791642cfa86b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:30:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1321e936-e805-44c5-ad19-c7c2177c1c97 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "80962f79-dbb2-4380-b2c8-791642cfa86b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:30:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1321e936-e805-44c5-ad19-c7c2177c1c97 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "80962f79-dbb2-4380-b2c8-791642cfa86b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:30:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1321e936-e805-44c5-ad19-c7c2177c1c97 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "80962f79-dbb2-4380-b2c8-791642cfa86b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.008s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:30:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1321e936-e805-44c5-ad19-c7c2177c1c97 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "80962f79-dbb2-4380-b2c8-791642cfa86b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.004s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:30:15 user nova-compute[75745]: INFO nova.compute.manager [None req-1321e936-e805-44c5-ad19-c7c2177c1c97 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Terminating instance
Dec 01 17:30:15 user nova-compute[75745]: DEBUG nova.compute.manager [None req-1321e936-e805-44c5-ad19-c7c2177c1c97 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:30:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:15 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Instance destroyed successfully.
Dec 01 17:30:15 user nova-compute[75745]: DEBUG nova.objects.instance [None req-3f8b8ebf-63f0-4846-aed9-2c55d6e50999 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lazy-loading 'resources' on Instance uuid d997cdd6-67c6-4263-814a-17cf9e27bbeb {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:30:15 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-3f8b8ebf-63f0-4846-aed9-2c55d6e50999 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:11:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-100760774',display_name='tempest-ServerActionsTestOtherA-server-100760774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-100760774',id=16,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEe39hBsqXh7qTHbR/1n4TCThkWTxdl0f3mcj7VutursSM+B5AqiMiKGVg5IqL9MYbDfyNfGcyjgOxxpAU4qczogEswNK8dvSit+JyFqtuJxlzPiy3ZkcIr+yzYcqZB0A==',key_name='tempest-keypair-3711887',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:11:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='409356993ea442c5abdf4269aebe43ab',ramdisk_id='',reservation_id='r-65dv89la',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1500186869',owner_user_name='tempest-ServerActionsTestOtherA-1500186869-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:11:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5204ecaa9b354d10bac514c27acbccc6',uuid=d997cdd6-67c6-4263-814a-17cf9e27bbeb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d64a643-0dca-4fe1-8734-9778689292bc", "address": "fa:16:3e:e2:0c:90", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d64a643-0d", "ovs_interfaceid": "9d64a643-0dca-4fe1-8734-9778689292bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:30:15 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-3f8b8ebf-63f0-4846-aed9-2c55d6e50999 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Converting VIF {"id": "9d64a643-0dca-4fe1-8734-9778689292bc", "address": "fa:16:3e:e2:0c:90", "network": {"id": "f7cefc9d-2279-4601-8a81-a640ad1aea25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1884243825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409356993ea442c5abdf4269aebe43ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d64a643-0d", "ovs_interfaceid": "9d64a643-0dca-4fe1-8734-9778689292bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:30:15 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-3f8b8ebf-63f0-4846-aed9-2c55d6e50999 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:0c:90,bridge_name='br-int',has_traffic_filtering=True,id=9d64a643-0dca-4fe1-8734-9778689292bc,network=Network(f7cefc9d-2279-4601-8a81-a640ad1aea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d64a643-0d') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:30:15 user nova-compute[75745]: DEBUG os_vif [None req-3f8b8ebf-63f0-4846-aed9-2c55d6e50999 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:0c:90,bridge_name='br-int',has_traffic_filtering=True,id=9d64a643-0dca-4fe1-8734-9778689292bc,network=Network(f7cefc9d-2279-4601-8a81-a640ad1aea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d64a643-0d') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:30:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d64a643-0d, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:30:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:30:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9eba087d-530f-4cf6-afd6-62ed7477864b) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:30:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:30:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:15 user nova-compute[75745]: INFO os_vif [None req-3f8b8ebf-63f0-4846-aed9-2c55d6e50999 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:0c:90,bridge_name='br-int',has_traffic_filtering=True,id=9d64a643-0dca-4fe1-8734-9778689292bc,network=Network(f7cefc9d-2279-4601-8a81-a640ad1aea25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d64a643-0d')
Dec 01 17:30:15 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-3f8b8ebf-63f0-4846-aed9-2c55d6e50999 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Deleting instance files /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb_del
Dec 01 17:30:15 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-3f8b8ebf-63f0-4846-aed9-2c55d6e50999 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Deletion of /opt/stack/data/nova/instances/d997cdd6-67c6-4263-814a-17cf9e27bbeb_del complete
Dec 01 17:30:15 user nova-compute[75745]: DEBUG nova.compute.manager [req-5d8f1f99-d62b-43dd-819c-6fc48b8c7049 req-b9a918d2-244d-4f61-b6a1-d96acbae2338 service nova] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Received event network-vif-unplugged-68718048-8e77-438b-a7e0-15675cc9e543 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:30:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5d8f1f99-d62b-43dd-819c-6fc48b8c7049 req-b9a918d2-244d-4f61-b6a1-d96acbae2338 service nova] Acquiring lock "80962f79-dbb2-4380-b2c8-791642cfa86b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:30:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5d8f1f99-d62b-43dd-819c-6fc48b8c7049 req-b9a918d2-244d-4f61-b6a1-d96acbae2338 service nova] Lock "80962f79-dbb2-4380-b2c8-791642cfa86b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:30:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5d8f1f99-d62b-43dd-819c-6fc48b8c7049 req-b9a918d2-244d-4f61-b6a1-d96acbae2338 service nova] Lock "80962f79-dbb2-4380-b2c8-791642cfa86b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:30:15 user nova-compute[75745]: DEBUG nova.compute.manager [req-5d8f1f99-d62b-43dd-819c-6fc48b8c7049 req-b9a918d2-244d-4f61-b6a1-d96acbae2338 service nova] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] No waiting events found dispatching network-vif-unplugged-68718048-8e77-438b-a7e0-15675cc9e543 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:30:15 user nova-compute[75745]: DEBUG nova.compute.manager [req-5d8f1f99-d62b-43dd-819c-6fc48b8c7049 req-b9a918d2-244d-4f61-b6a1-d96acbae2338 service nova] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Received event network-vif-unplugged-68718048-8e77-438b-a7e0-15675cc9e543 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:30:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:15 user nova-compute[75745]: INFO nova.compute.manager [None req-3f8b8ebf-63f0-4846-aed9-2c55d6e50999 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Took 1.03 seconds to destroy the instance on the hypervisor.
Dec 01 17:30:15 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-3f8b8ebf-63f0-4846-aed9-2c55d6e50999 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:30:15 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:30:15 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:30:16 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Instance destroyed successfully.
Dec 01 17:30:16 user nova-compute[75745]: DEBUG nova.objects.instance [None req-1321e936-e805-44c5-ad19-c7c2177c1c97 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lazy-loading 'resources' on Instance uuid 80962f79-dbb2-4380-b2c8-791642cfa86b {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-1321e936-e805-44c5-ad19-c7c2177c1c97 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:14:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1242750524',display_name='tempest-ServerRescueNegativeTestJSON-server-1242750524',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1242750524',id=23,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:16:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4542114c14774241bb138dfafe3441ad',ramdisk_id='',reservation_id='r-6q139kig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1719994145',owner_user_name='tempest-ServerRescueNegativeTestJSON-1719994145-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:16:00Z,user_data=None,user_id='7bd90117cc3c433d953b7e0de3718f0d',uuid=80962f79-dbb2-4380-b2c8-791642cfa86b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "68718048-8e77-438b-a7e0-15675cc9e543", "address": "fa:16:3e:bf:09:08", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68718048-8e", "ovs_interfaceid": "68718048-8e77-438b-a7e0-15675cc9e543", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-1321e936-e805-44c5-ad19-c7c2177c1c97 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Converting VIF {"id": "68718048-8e77-438b-a7e0-15675cc9e543", "address": "fa:16:3e:bf:09:08", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68718048-8e", "ovs_interfaceid": "68718048-8e77-438b-a7e0-15675cc9e543", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-1321e936-e805-44c5-ad19-c7c2177c1c97 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:09:08,bridge_name='br-int',has_traffic_filtering=True,id=68718048-8e77-438b-a7e0-15675cc9e543,network=Network(fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68718048-8e') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG os_vif [None req-1321e936-e805-44c5-ad19-c7c2177c1c97 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:09:08,bridge_name='br-int',has_traffic_filtering=True,id=68718048-8e77-438b-a7e0-15675cc9e543,network=Network(fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68718048-8e') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68718048-8e, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fe63ba27-1e53-48a6-a4c6-361156613011) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:30:16 user nova-compute[75745]: INFO os_vif [None req-1321e936-e805-44c5-ad19-c7c2177c1c97 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:09:08,bridge_name='br-int',has_traffic_filtering=True,id=68718048-8e77-438b-a7e0-15675cc9e543,network=Network(fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68718048-8e')
Dec 01 17:30:16 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-1321e936-e805-44c5-ad19-c7c2177c1c97 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Deleting instance files /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b_del
Dec 01 17:30:16 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-1321e936-e805-44c5-ad19-c7c2177c1c97 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Deletion of /opt/stack/data/nova/instances/80962f79-dbb2-4380-b2c8-791642cfa86b_del complete
Dec 01 17:30:16 user nova-compute[75745]: INFO nova.compute.manager [None req-1321e936-e805-44c5-ad19-c7c2177c1c97 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Took 0.96 seconds to destroy the instance on the hypervisor.
Dec 01 17:30:16 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-1321e936-e805-44c5-ad19-c7c2177c1c97 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG nova.compute.manager [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:30:16 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Instance spawned successfully.
Dec 01 17:30:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:30:16 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Took 0.75 seconds to deallocate network for instance.
Dec 01 17:30:16 user nova-compute[75745]: DEBUG nova.compute.manager [req-8d0611a1-fad5-4a35-be06-c6a6359d25fe req-620d4e4c-1af1-4e34-9ffb-133adaa59b52 service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Received event network-vif-plugged-a990f44c-7717-43df-978e-beef133804aa {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8d0611a1-fad5-4a35-be06-c6a6359d25fe req-620d4e4c-1af1-4e34-9ffb-133adaa59b52 service nova] Acquiring lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8d0611a1-fad5-4a35-be06-c6a6359d25fe req-620d4e4c-1af1-4e34-9ffb-133adaa59b52 service nova] Lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8d0611a1-fad5-4a35-be06-c6a6359d25fe req-620d4e4c-1af1-4e34-9ffb-133adaa59b52 service nova] Lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG nova.compute.manager [req-8d0611a1-fad5-4a35-be06-c6a6359d25fe req-620d4e4c-1af1-4e34-9ffb-133adaa59b52 service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] No waiting events found dispatching network-vif-plugged-a990f44c-7717-43df-978e-beef133804aa {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:30:16 user nova-compute[75745]: WARNING nova.compute.manager [req-8d0611a1-fad5-4a35-be06-c6a6359d25fe req-620d4e4c-1af1-4e34-9ffb-133adaa59b52 service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Received unexpected event network-vif-plugged-a990f44c-7717-43df-978e-beef133804aa for instance with vm_state building and task_state spawning.
Dec 01 17:30:16 user nova-compute[75745]: DEBUG nova.compute.manager [req-8d0611a1-fad5-4a35-be06-c6a6359d25fe req-620d4e4c-1af1-4e34-9ffb-133adaa59b52 service nova] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Received event network-vif-unplugged-9d64a643-0dca-4fe1-8734-9778689292bc {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8d0611a1-fad5-4a35-be06-c6a6359d25fe req-620d4e4c-1af1-4e34-9ffb-133adaa59b52 service nova] Acquiring lock "d997cdd6-67c6-4263-814a-17cf9e27bbeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8d0611a1-fad5-4a35-be06-c6a6359d25fe req-620d4e4c-1af1-4e34-9ffb-133adaa59b52 service nova] Lock "d997cdd6-67c6-4263-814a-17cf9e27bbeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8d0611a1-fad5-4a35-be06-c6a6359d25fe req-620d4e4c-1af1-4e34-9ffb-133adaa59b52 service nova] Lock "d997cdd6-67c6-4263-814a-17cf9e27bbeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG nova.compute.manager [req-8d0611a1-fad5-4a35-be06-c6a6359d25fe req-620d4e4c-1af1-4e34-9ffb-133adaa59b52 service nova] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] No waiting events found dispatching network-vif-unplugged-9d64a643-0dca-4fe1-8734-9778689292bc {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG nova.compute.manager [req-8d0611a1-fad5-4a35-be06-c6a6359d25fe req-620d4e4c-1af1-4e34-9ffb-133adaa59b52 service nova] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Received event network-vif-unplugged-9d64a643-0dca-4fe1-8734-9778689292bc for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG nova.compute.manager [req-8d0611a1-fad5-4a35-be06-c6a6359d25fe req-620d4e4c-1af1-4e34-9ffb-133adaa59b52 service nova] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Received event network-vif-plugged-9d64a643-0dca-4fe1-8734-9778689292bc {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8d0611a1-fad5-4a35-be06-c6a6359d25fe req-620d4e4c-1af1-4e34-9ffb-133adaa59b52 service nova] Acquiring lock "d997cdd6-67c6-4263-814a-17cf9e27bbeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8d0611a1-fad5-4a35-be06-c6a6359d25fe req-620d4e4c-1af1-4e34-9ffb-133adaa59b52 service nova] Lock "d997cdd6-67c6-4263-814a-17cf9e27bbeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8d0611a1-fad5-4a35-be06-c6a6359d25fe req-620d4e4c-1af1-4e34-9ffb-133adaa59b52 service nova] Lock "d997cdd6-67c6-4263-814a-17cf9e27bbeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG nova.compute.manager [req-8d0611a1-fad5-4a35-be06-c6a6359d25fe req-620d4e4c-1af1-4e34-9ffb-133adaa59b52 service nova] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] No waiting events found dispatching network-vif-plugged-9d64a643-0dca-4fe1-8734-9778689292bc {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:30:16 user nova-compute[75745]: WARNING nova.compute.manager [req-8d0611a1-fad5-4a35-be06-c6a6359d25fe req-620d4e4c-1af1-4e34-9ffb-133adaa59b52 service nova] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Received unexpected event network-vif-plugged-9d64a643-0dca-4fe1-8734-9778689292bc for instance with vm_state active and task_state deleting.
Dec 01 17:30:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-3f8b8ebf-63f0-4846-aed9-2c55d6e50999 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-3f8b8ebf-63f0-4846-aed9-2c55d6e50999 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:30:16 user nova-compute[75745]: INFO nova.compute.manager [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Took 5.31 seconds to spawn the instance on the hypervisor.
Dec 01 17:30:16 user nova-compute[75745]: DEBUG nova.compute.manager [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:30:16 user nova-compute[75745]: INFO nova.compute.manager [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Took 26.87 seconds to build instance.
Dec 01 17:30:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fc98c4cc-eb0a-445d-a848-52fa6a705654 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.975s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:30:16 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:30:17 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Took 0.60 seconds to deallocate network for instance.
Dec 01 17:30:17 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-3f8b8ebf-63f0-4846-aed9-2c55d6e50999 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:30:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1321e936-e805-44c5-ad19-c7c2177c1c97 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:30:17 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-3f8b8ebf-63f0-4846-aed9-2c55d6e50999 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:30:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-3f8b8ebf-63f0-4846-aed9-2c55d6e50999 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:30:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1321e936-e805-44c5-ad19-c7c2177c1c97 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.065s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:30:17 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-3f8b8ebf-63f0-4846-aed9-2c55d6e50999 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Deleted allocations for instance d997cdd6-67c6-4263-814a-17cf9e27bbeb
Dec 01 17:30:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-3f8b8ebf-63f0-4846-aed9-2c55d6e50999 tempest-ServerActionsTestOtherA-1500186869 tempest-ServerActionsTestOtherA-1500186869-project-member] Lock "d997cdd6-67c6-4263-814a-17cf9e27bbeb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.386s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:30:17 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-1321e936-e805-44c5-ad19-c7c2177c1c97 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:30:17 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-1321e936-e805-44c5-ad19-c7c2177c1c97 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:30:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1321e936-e805-44c5-ad19-c7c2177c1c97 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.328s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:30:17 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-1321e936-e805-44c5-ad19-c7c2177c1c97 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Deleted allocations for instance 80962f79-dbb2-4380-b2c8-791642cfa86b
Dec 01 17:30:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1321e936-e805-44c5-ad19-c7c2177c1c97 tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "80962f79-dbb2-4380-b2c8-791642cfa86b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.176s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:30:17 user nova-compute[75745]: DEBUG nova.compute.manager [req-57e8ffdb-0989-4c20-8940-475c460d5c82 req-5374a873-3e01-4e7c-bb0a-5c9a131282bf service nova] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Received event network-vif-plugged-68718048-8e77-438b-a7e0-15675cc9e543 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:30:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-57e8ffdb-0989-4c20-8940-475c460d5c82 req-5374a873-3e01-4e7c-bb0a-5c9a131282bf service nova] Acquiring lock "80962f79-dbb2-4380-b2c8-791642cfa86b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:30:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-57e8ffdb-0989-4c20-8940-475c460d5c82 req-5374a873-3e01-4e7c-bb0a-5c9a131282bf service nova] Lock "80962f79-dbb2-4380-b2c8-791642cfa86b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:30:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-57e8ffdb-0989-4c20-8940-475c460d5c82 req-5374a873-3e01-4e7c-bb0a-5c9a131282bf service nova] Lock "80962f79-dbb2-4380-b2c8-791642cfa86b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:30:17 user nova-compute[75745]: DEBUG nova.compute.manager [req-57e8ffdb-0989-4c20-8940-475c460d5c82 req-5374a873-3e01-4e7c-bb0a-5c9a131282bf service nova] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] No waiting events found dispatching network-vif-plugged-68718048-8e77-438b-a7e0-15675cc9e543 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:30:17 user nova-compute[75745]: WARNING nova.compute.manager [req-57e8ffdb-0989-4c20-8940-475c460d5c82 req-5374a873-3e01-4e7c-bb0a-5c9a131282bf service nova] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Received unexpected event network-vif-plugged-68718048-8e77-438b-a7e0-15675cc9e543 for instance with vm_state deleted and task_state None.
Dec 01 17:30:17 user nova-compute[75745]: DEBUG nova.compute.manager [req-57e8ffdb-0989-4c20-8940-475c460d5c82 req-5374a873-3e01-4e7c-bb0a-5c9a131282bf service nova] [instance: d997cdd6-67c6-4263-814a-17cf9e27bbeb] Received event network-vif-deleted-9d64a643-0dca-4fe1-8734-9778689292bc {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:30:18 user nova-compute[75745]: DEBUG nova.compute.manager [req-d70b2f14-bb1a-4f8e-9eb9-200a1539a89f req-c87e7ba3-69ac-4942-8d21-c7ad78fc3c53 service nova] [instance: 80962f79-dbb2-4380-b2c8-791642cfa86b] Received event network-vif-deleted-68718048-8e77-438b-a7e0-15675cc9e543 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:30:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:24 user nova-compute[75745]: DEBUG nova.compute.manager [req-5b12d168-5bee-43ad-9a08-4d034593ccee req-fc850cfd-d155-454d-8383-c69da31272a9 service nova] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Received event network-changed-09845821-08f0-4128-9221-15dccf9de944 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:30:24 user nova-compute[75745]: DEBUG nova.compute.manager [req-5b12d168-5bee-43ad-9a08-4d034593ccee req-fc850cfd-d155-454d-8383-c69da31272a9 service nova] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Refreshing instance network info cache due to event network-changed-09845821-08f0-4128-9221-15dccf9de944. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:30:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5b12d168-5bee-43ad-9a08-4d034593ccee req-fc850cfd-d155-454d-8383-c69da31272a9 service nova] Acquiring lock "refresh_cache-31824d74-830c-4feb-ae7c-d68f23cc3a07" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:30:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5b12d168-5bee-43ad-9a08-4d034593ccee req-fc850cfd-d155-454d-8383-c69da31272a9 service nova] Acquired lock "refresh_cache-31824d74-830c-4feb-ae7c-d68f23cc3a07" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:30:24 user nova-compute[75745]: DEBUG nova.network.neutron [req-5b12d168-5bee-43ad-9a08-4d034593ccee req-fc850cfd-d155-454d-8383-c69da31272a9 service nova] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Refreshing network info cache for port 09845821-08f0-4128-9221-15dccf9de944 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:30:25 user nova-compute[75745]: DEBUG nova.network.neutron [req-5b12d168-5bee-43ad-9a08-4d034593ccee req-fc850cfd-d155-454d-8383-c69da31272a9 service nova] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Updated VIF entry in instance network info cache for port 09845821-08f0-4128-9221-15dccf9de944. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:30:25 user nova-compute[75745]: DEBUG nova.network.neutron [req-5b12d168-5bee-43ad-9a08-4d034593ccee req-fc850cfd-d155-454d-8383-c69da31272a9 service nova] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Updating instance_info_cache with network_info: [{"id": "09845821-08f0-4128-9221-15dccf9de944", "address": "fa:16:3e:6b:59:63", "network": {"id": "4369e31c-31b6-429f-bfad-c83ed55005c0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1169310922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0461ab72f35b4ebb995e9b602935c5b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09845821-08", "ovs_interfaceid": "09845821-08f0-4128-9221-15dccf9de944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:30:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5b12d168-5bee-43ad-9a08-4d034593ccee req-fc850cfd-d155-454d-8383-c69da31272a9 service nova] Releasing lock "refresh_cache-31824d74-830c-4feb-ae7c-d68f23cc3a07" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:30:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Acquiring lock "31824d74-830c-4feb-ae7c-d68f23cc3a07" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:30:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Lock "31824d74-830c-4feb-ae7c-d68f23cc3a07" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:30:28 user nova-compute[75745]: DEBUG nova.objects.instance [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Lazy-loading 'flavor' on Instance uuid 31824d74-830c-4feb-ae7c-d68f23cc3a07 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:30:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Lock "31824d74-830c-4feb-ae7c-d68f23cc3a07" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:30:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Acquiring lock "31824d74-830c-4feb-ae7c-d68f23cc3a07" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:30:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Lock "31824d74-830c-4feb-ae7c-d68f23cc3a07" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:30:28 user nova-compute[75745]: INFO nova.compute.manager [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Attaching volume dea3a534-40be-4888-8461-748cb33295af to /dev/vdb
Dec 01 17:30:29 user nova-compute[75745]: DEBUG os_brick.utils [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:30:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:29 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[52968958-bd92-40c1-b981-86d6af7cc501]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:30:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:29 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f74ec8a-2fef-47fc-b3d9-9375358f17cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:30:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:29 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[629c9533-ac95-4edb-adab-14fc61f83225]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:30:29 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c33868-4fed-4a00-810e-196cb2f63e3d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:30:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:30:29 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:30:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:29 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:30:29 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:30:29 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afd99f2-f8bb-406a-9319-7a6ce5bc9474]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:30:29 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:30:29 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:30:29 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:30:29 user nova-compute[75745]: DEBUG os_brick.utils [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:30:29 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Updating existing volume attachment record: 96d43772-8a7d-46a4-bcf4-b63d33ed1609 {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:30:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UKRmxjYc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:30:38 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:30:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:30:38 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:30:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:30:38 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:30:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[072ecc0d-fad7-4452-bc7e-b4ba78416193]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:30:38 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1647f46e-f9b7-436f-b922-43ed541b84d6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af] added
Dec 01 17:30:38 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9b44da-1b40-4d2a-896e-0ab91ee0a5bf]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[89dc4961-c753-451f-bace-260cc550fb7c]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UKRmxjYc {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UKRmxjYc" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[294c5328-06b5-4608-afcd-ac5c9e6492e1]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UKRmxjYc'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48ca3ec-1d1a-42a3-be53-8ad21b20a8ab]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afb3dd0-2df2-4cac-8105-863b6f83b663]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:30:38 user nova-compute[75745]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a (non-flash)
Dec 01 17:30:38 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:30:38 user nova-compute[75745]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a (non-flash)
Dec 01 17:30:38 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8a10d4-d049-412e-811b-5d4efe552377]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af, portal: 172.16.0.220,3260]
Dec 01 17:30:38 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af, portal: 172.16.0.220,3260] successful.
Dec 01 17:30:38 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e22dfc-d0c3-48cc-a0e4-99e9cf85647c]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b513264-25ef-4ba1-9713-8012d97ca57d]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:30:38 user nova-compute[75745]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a (non-flash)
Dec 01 17:30:38 user nova-compute[75745]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af (non-flash)
Dec 01 17:30:38 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:30:38 user nova-compute[75745]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a (non-flash)
Dec 01 17:30:38 user nova-compute[75745]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af (non-flash)
Dec 01 17:30:38 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3e3fbe-2ab1-4821-b818-56badba10d36]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:30:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UKRmxjYc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:30:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:30:39 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23133336564613965', 'path': '/dev/sdd'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:30:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133336564613965', 'path': '/dev/sdd'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:30:39 user nova-compute[75745]: DEBUG nova.objects.instance [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Lazy-loading 'flavor' on Instance uuid 31824d74-830c-4feb-ae7c-d68f23cc3a07 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:30:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 17:30:39 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:30:39 user nova-compute[75745]:   <source dev="/dev/sdd"/>
Dec 01 17:30:39 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:30:39 user nova-compute[75745]:   <serial>dea3a534-40be-4888-8461-748cb33295af</serial>
Dec 01 17:30:39 user nova-compute[75745]: </disk>
Dec 01 17:30:39 user nova-compute[75745]:  {{(pid=75745) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 17:30:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:30:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:30:39 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] No VIF found with MAC fa:16:3e:6b:59:63, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:30:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9a0021e4-9895-4c37-8856-0885634c70be tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Lock "31824d74-830c-4feb-ae7c-d68f23cc3a07" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.122s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:30:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:41 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Acquiring lock "31824d74-830c-4feb-ae7c-d68f23cc3a07" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:30:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Lock "31824d74-830c-4feb-ae7c-d68f23cc3a07" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:30:41 user nova-compute[75745]: INFO nova.compute.manager [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Detaching volume dea3a534-40be-4888-8461-748cb33295af
Dec 01 17:30:41 user nova-compute[75745]: INFO nova.virt.block_device [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Attempting to driver detach volume dea3a534-40be-4888-8461-748cb33295af from mountpoint /dev/vdb
Dec 01 17:30:41 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Attempting to detach device vdb from instance 31824d74-830c-4feb-ae7c-d68f23cc3a07 from the persistent domain config. {{(pid=75745) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 17:30:41 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:30:41 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:30:41 user nova-compute[75745]:   <source dev="/dev/sdd"/>
Dec 01 17:30:41 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:30:41 user nova-compute[75745]:   <serial>dea3a534-40be-4888-8461-748cb33295af</serial>
Dec 01 17:30:41 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 17:30:41 user nova-compute[75745]: </disk>
Dec 01 17:30:41 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:30:41 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Successfully detached device vdb from instance 31824d74-830c-4feb-ae7c-d68f23cc3a07 from the persistent domain config.
Dec 01 17:30:41 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 31824d74-830c-4feb-ae7c-d68f23cc3a07 from the live domain config. {{(pid=75745) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 17:30:41 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:30:41 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:30:41 user nova-compute[75745]:   <source dev="/dev/sdd"/>
Dec 01 17:30:41 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:30:41 user nova-compute[75745]:   <serial>dea3a534-40be-4888-8461-748cb33295af</serial>
Dec 01 17:30:41 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 17:30:41 user nova-compute[75745]: </disk>
Dec 01 17:30:41 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:30:42 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 31824d74-830c-4feb-ae7c-d68f23cc3a07 {{(pid=75745) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 17:30:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:30:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:30:57 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:30:57 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:30:58 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:30:58 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:30:58 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:30:59 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:31:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:00 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:31:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:31:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:31:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:31:00 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:31:01 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:31:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31824d74-830c-4feb-ae7c-d68f23cc3a07/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31824d74-830c-4feb-ae7c-d68f23cc3a07/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31824d74-830c-4feb-ae7c-d68f23cc3a07/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31824d74-830c-4feb-ae7c-d68f23cc3a07/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:01 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:02 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 31824d74-830c-4feb-ae7c-d68f23cc3a07 is timed out.
Dec 01 17:31:02 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Successfully detached device vdb from instance 31824d74-830c-4feb-ae7c-d68f23cc3a07 from the live domain config.
Dec 01 17:31:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UKRmxjYc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:31:02 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:31:02 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aaa9fee-64db-4015-bae7-60a18c7075b4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:31:02 user nova-compute[75745]: No targets found.
Dec 01 17:31:02 user nova-compute[75745]: iSNS:
Dec 01 17:31:02 user nova-compute[75745]: No targets found.
Dec 01 17:31:02 user nova-compute[75745]: STATIC:
Dec 01 17:31:02 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af
Dec 01 17:31:02 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:31:02 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:31:02 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0
Dec 01 17:31:02 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:31:02 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:31:02 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a
Dec 01 17:31:02 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:31:02 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:31:02 user nova-compute[75745]: FIRMWARE:
Dec 01 17:31:02 user nova-compute[75745]: No targets found.
Dec 01 17:31:02 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:31:02 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:31:02 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a21e505-120f-4a2d-bf29-b0e21bbe9ff8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[425c51c2-d7d7-4573-bbec-64a151b855aa]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:31:02 user nova-compute[75745]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a (non-flash)
Dec 01 17:31:02 user nova-compute[75745]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af (non-flash)
Dec 01 17:31:02 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:31:02 user nova-compute[75745]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a (non-flash)
Dec 01 17:31:02 user nova-compute[75745]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af (non-flash)
Dec 01 17:31:02 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f249870d090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af'): ({'sdd'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Removing single pathed devices sdd {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a40fad-e8ef-46f6-947c-806d1455b5c9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68cf19f-bf31-4824-b141-1fea1e591d21]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Flushing IO for device /dev/sdd {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7866ec0b-5c41-4b01-8eb3-4849a3bbef58]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e7c644-7217-462b-b6e2-4e2fa1e1cab9]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] SCSI volumes sdd have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37d1f284-e5ec-4f47-b819-e8ed8ca793d7/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f9e2ab-4f2f-4ef8-a5b9-ed95a47000db]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbe0d63-abd0-40b9-acef-375e7922ae17]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af, portal: 172.16.0.220,3260]
Dec 01 17:31:02 user nova-compute[75745]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af, portal: 172.16.0.220,3260] successful.
Dec 01 17:31:02 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea3a534-40be-4888-8461-748cb33295af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4aedc68-763c-49dd-a9fa-2c159b9aa98a]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] <== disconnect_volume: return (380ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37d1f284-e5ec-4f47-b819-e8ed8ca793d7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37d1f284-e5ec-4f47-b819-e8ed8ca793d7/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37d1f284-e5ec-4f47-b819-e8ed8ca793d7/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:03 user nova-compute[75745]: DEBUG nova.objects.instance [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Lazy-loading 'flavor' on Instance uuid 31824d74-830c-4feb-ae7c-d68f23cc3a07 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:31:03 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:31:03 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:31:03 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=8153MB free_disk=25.056049346923828GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:31:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:31:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:31:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a2b5d25e-5fe3-46b3-8b25-7a4d71445890 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Lock "31824d74-830c-4feb-ae7c-d68f23cc3a07" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.090s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:31:03 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance e4ffb96e-456c-4fb9-9850-9e98310d63e5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:31:03 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 5e631ac3-8122-46a3-a54f-2395c0f7cf7c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:31:03 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 5aee52eb-78e3-4f60-a920-7ade912735e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:31:03 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 61e0e19b-f926-4524-82c8-833f804c9b72 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:31:03 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 31824d74-830c-4feb-ae7c-d68f23cc3a07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:31:03 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:31:03 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 37d1f284-e5ec-4f47-b819-e8ed8ca793d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:31:03 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:31:03 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:31:03 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:31:03 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:31:03 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:31:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.372s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:31:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:05 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:31:05 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:31:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-adf0aef5-76c0-4c0f-ba79-048bffa4d07b tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:31:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-adf0aef5-76c0-4c0f-ba79-048bffa4d07b tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:31:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-adf0aef5-76c0-4c0f-ba79-048bffa4d07b tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:31:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-adf0aef5-76c0-4c0f-ba79-048bffa4d07b tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:31:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-adf0aef5-76c0-4c0f-ba79-048bffa4d07b tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:31:05 user nova-compute[75745]: INFO nova.compute.manager [None req-adf0aef5-76c0-4c0f-ba79-048bffa4d07b tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Terminating instance
Dec 01 17:31:05 user nova-compute[75745]: DEBUG nova.compute.manager [None req-adf0aef5-76c0-4c0f-ba79-048bffa4d07b tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:31:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:06 user nova-compute[75745]: DEBUG nova.compute.manager [req-60b61dbd-0c9e-47b2-985c-6155d23b76c8 req-ce0ea38d-6561-4e04-90cd-02905cdeae44 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Received event network-vif-unplugged-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:31:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-60b61dbd-0c9e-47b2-985c-6155d23b76c8 req-ce0ea38d-6561-4e04-90cd-02905cdeae44 service nova] Acquiring lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:31:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-60b61dbd-0c9e-47b2-985c-6155d23b76c8 req-ce0ea38d-6561-4e04-90cd-02905cdeae44 service nova] Lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:31:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-60b61dbd-0c9e-47b2-985c-6155d23b76c8 req-ce0ea38d-6561-4e04-90cd-02905cdeae44 service nova] Lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:31:06 user nova-compute[75745]: DEBUG nova.compute.manager [req-60b61dbd-0c9e-47b2-985c-6155d23b76c8 req-ce0ea38d-6561-4e04-90cd-02905cdeae44 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] No waiting events found dispatching network-vif-unplugged-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:31:06 user nova-compute[75745]: DEBUG nova.compute.manager [req-60b61dbd-0c9e-47b2-985c-6155d23b76c8 req-ce0ea38d-6561-4e04-90cd-02905cdeae44 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Received event network-vif-unplugged-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:31:06 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Instance destroyed successfully.
Dec 01 17:31:06 user nova-compute[75745]: DEBUG nova.objects.instance [None req-adf0aef5-76c0-4c0f-ba79-048bffa4d07b tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lazy-loading 'resources' on Instance uuid e4ffb96e-456c-4fb9-9850-9e98310d63e5 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:31:06 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-adf0aef5-76c0-4c0f-ba79-048bffa4d07b tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:14:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-910276691',display_name='tempest-ServerRescueNegativeTestJSON-server-910276691',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-910276691',id=22,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:18:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4542114c14774241bb138dfafe3441ad',ramdisk_id='',reservation_id='r-px22dfxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1719994145',owner_user_name='tempest-ServerRescueNegativeTestJSON-1719994145-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:20:45Z,user_data=None,user_id='7bd90117cc3c433d953b7e0de3718f0d',uuid=e4ffb96e-456c-4fb9-9850-9e98310d63e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebf45b7a-1ee5-43d6-9940-0ca049c95d71", "address": "fa:16:3e:39:c0:e3", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf45b7a-1e", "ovs_interfaceid": "ebf45b7a-1ee5-43d6-9940-0ca049c95d71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:31:06 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-adf0aef5-76c0-4c0f-ba79-048bffa4d07b tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Converting VIF {"id": "ebf45b7a-1ee5-43d6-9940-0ca049c95d71", "address": "fa:16:3e:39:c0:e3", "network": {"id": "fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1694306402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4542114c14774241bb138dfafe3441ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebf45b7a-1e", "ovs_interfaceid": "ebf45b7a-1ee5-43d6-9940-0ca049c95d71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:31:06 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-adf0aef5-76c0-4c0f-ba79-048bffa4d07b tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:c0:e3,bridge_name='br-int',has_traffic_filtering=True,id=ebf45b7a-1ee5-43d6-9940-0ca049c95d71,network=Network(fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf45b7a-1e') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:31:06 user nova-compute[75745]: DEBUG os_vif [None req-adf0aef5-76c0-4c0f-ba79-048bffa4d07b tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:c0:e3,bridge_name='br-int',has_traffic_filtering=True,id=ebf45b7a-1ee5-43d6-9940-0ca049c95d71,network=Network(fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf45b7a-1e') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:31:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebf45b7a-1e, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:31:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:31:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8a8911a4-7985-49eb-975d-1502e11f90cb) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:31:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:31:06 user nova-compute[75745]: INFO os_vif [None req-adf0aef5-76c0-4c0f-ba79-048bffa4d07b tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:c0:e3,bridge_name='br-int',has_traffic_filtering=True,id=ebf45b7a-1ee5-43d6-9940-0ca049c95d71,network=Network(fd7fec2c-380d-4f8e-a35b-d58c4dca6bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebf45b7a-1e')
Dec 01 17:31:06 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-adf0aef5-76c0-4c0f-ba79-048bffa4d07b tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Deleting instance files /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5_del
Dec 01 17:31:06 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-adf0aef5-76c0-4c0f-ba79-048bffa4d07b tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Deletion of /opt/stack/data/nova/instances/e4ffb96e-456c-4fb9-9850-9e98310d63e5_del complete
Dec 01 17:31:06 user nova-compute[75745]: INFO nova.compute.manager [None req-adf0aef5-76c0-4c0f-ba79-048bffa4d07b tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Took 0.90 seconds to destroy the instance on the hypervisor.
Dec 01 17:31:06 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-adf0aef5-76c0-4c0f-ba79-048bffa4d07b tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:31:06 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:31:06 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:31:06 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:31:06 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:31:06 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Rebuilding the list of instances to heal {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 17:31:06 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Skipping network cache update for instance because it is being deleted. {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Dec 01 17:31:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-5e631ac3-8122-46a3-a54f-2395c0f7cf7c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:31:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-5e631ac3-8122-46a3-a54f-2395c0f7cf7c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:31:07 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:31:07 user nova-compute[75745]: DEBUG nova.objects.instance [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lazy-loading 'info_cache' on Instance uuid 5e631ac3-8122-46a3-a54f-2395c0f7cf7c {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:31:07 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Updating instance_info_cache with network_info: [{"id": "7239781d-a3ed-42f7-a30b-d8e5410bc622", "address": "fa:16:3e:0a:8d:a9", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7239781d-a3", "ovs_interfaceid": "7239781d-a3ed-42f7-a30b-d8e5410bc622", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:31:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-5e631ac3-8122-46a3-a54f-2395c0f7cf7c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:31:07 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:31:08 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:31:08 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Took 1.23 seconds to deallocate network for instance.
Dec 01 17:31:08 user nova-compute[75745]: DEBUG nova.compute.manager [req-0930f843-fc9b-4a0f-8405-bb01058398b4 req-be273917-bc51-441f-8e08-0e207595993c service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Received event network-vif-deleted-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:31:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-adf0aef5-76c0-4c0f-ba79-048bffa4d07b tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:31:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-adf0aef5-76c0-4c0f-ba79-048bffa4d07b tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:31:08 user nova-compute[75745]: DEBUG nova.compute.manager [req-79f77a48-c314-401c-b233-2c38ea72142a req-62aa4b1b-94b2-41cf-80a8-3cec2fc0da00 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Received event network-vif-plugged-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:31:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-79f77a48-c314-401c-b233-2c38ea72142a req-62aa4b1b-94b2-41cf-80a8-3cec2fc0da00 service nova] Acquiring lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:31:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-79f77a48-c314-401c-b233-2c38ea72142a req-62aa4b1b-94b2-41cf-80a8-3cec2fc0da00 service nova] Lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:31:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-79f77a48-c314-401c-b233-2c38ea72142a req-62aa4b1b-94b2-41cf-80a8-3cec2fc0da00 service nova] Lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:31:08 user nova-compute[75745]: DEBUG nova.compute.manager [req-79f77a48-c314-401c-b233-2c38ea72142a req-62aa4b1b-94b2-41cf-80a8-3cec2fc0da00 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] No waiting events found dispatching network-vif-plugged-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:31:08 user nova-compute[75745]: WARNING nova.compute.manager [req-79f77a48-c314-401c-b233-2c38ea72142a req-62aa4b1b-94b2-41cf-80a8-3cec2fc0da00 service nova] [instance: e4ffb96e-456c-4fb9-9850-9e98310d63e5] Received unexpected event network-vif-plugged-ebf45b7a-1ee5-43d6-9940-0ca049c95d71 for instance with vm_state deleted and task_state None.
Dec 01 17:31:08 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-adf0aef5-76c0-4c0f-ba79-048bffa4d07b tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:31:08 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-adf0aef5-76c0-4c0f-ba79-048bffa4d07b tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:31:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-adf0aef5-76c0-4c0f-ba79-048bffa4d07b tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.284s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:31:08 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-adf0aef5-76c0-4c0f-ba79-048bffa4d07b tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Deleted allocations for instance e4ffb96e-456c-4fb9-9850-9e98310d63e5
Dec 01 17:31:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-adf0aef5-76c0-4c0f-ba79-048bffa4d07b tempest-ServerRescueNegativeTestJSON-1719994145 tempest-ServerRescueNegativeTestJSON-1719994145-project-member] Lock "e4ffb96e-456c-4fb9-9850-9e98310d63e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.648s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:31:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:31:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:31:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:31:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:31:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:31:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:31:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d688693b-9be9-42a6-80f8-539d5da65609 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Acquiring lock "31824d74-830c-4feb-ae7c-d68f23cc3a07" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:31:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d688693b-9be9-42a6-80f8-539d5da65609 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Lock "31824d74-830c-4feb-ae7c-d68f23cc3a07" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:31:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d688693b-9be9-42a6-80f8-539d5da65609 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Acquiring lock "31824d74-830c-4feb-ae7c-d68f23cc3a07-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:31:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d688693b-9be9-42a6-80f8-539d5da65609 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Lock "31824d74-830c-4feb-ae7c-d68f23cc3a07-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:31:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d688693b-9be9-42a6-80f8-539d5da65609 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Lock "31824d74-830c-4feb-ae7c-d68f23cc3a07-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:31:36 user nova-compute[75745]: INFO nova.compute.manager [None req-d688693b-9be9-42a6-80f8-539d5da65609 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Terminating instance
Dec 01 17:31:36 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d688693b-9be9-42a6-80f8-539d5da65609 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:31:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:36 user nova-compute[75745]: DEBUG nova.compute.manager [req-348deee7-57b3-4226-9dd0-14da8cfea06b req-4ae1d255-c6f5-45e5-8fed-4f05cb3a55a9 service nova] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Received event network-vif-unplugged-09845821-08f0-4128-9221-15dccf9de944 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:31:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-348deee7-57b3-4226-9dd0-14da8cfea06b req-4ae1d255-c6f5-45e5-8fed-4f05cb3a55a9 service nova] Acquiring lock "31824d74-830c-4feb-ae7c-d68f23cc3a07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:31:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-348deee7-57b3-4226-9dd0-14da8cfea06b req-4ae1d255-c6f5-45e5-8fed-4f05cb3a55a9 service nova] Lock "31824d74-830c-4feb-ae7c-d68f23cc3a07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:31:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-348deee7-57b3-4226-9dd0-14da8cfea06b req-4ae1d255-c6f5-45e5-8fed-4f05cb3a55a9 service nova] Lock "31824d74-830c-4feb-ae7c-d68f23cc3a07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:31:36 user nova-compute[75745]: DEBUG nova.compute.manager [req-348deee7-57b3-4226-9dd0-14da8cfea06b req-4ae1d255-c6f5-45e5-8fed-4f05cb3a55a9 service nova] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] No waiting events found dispatching network-vif-unplugged-09845821-08f0-4128-9221-15dccf9de944 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:31:36 user nova-compute[75745]: DEBUG nova.compute.manager [req-348deee7-57b3-4226-9dd0-14da8cfea06b req-4ae1d255-c6f5-45e5-8fed-4f05cb3a55a9 service nova] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Received event network-vif-unplugged-09845821-08f0-4128-9221-15dccf9de944 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:31:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:37 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Instance destroyed successfully.
Dec 01 17:31:37 user nova-compute[75745]: DEBUG nova.objects.instance [None req-d688693b-9be9-42a6-80f8-539d5da65609 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Lazy-loading 'resources' on Instance uuid 31824d74-830c-4feb-ae7c-d68f23cc3a07 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:31:37 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-d688693b-9be9-42a6-80f8-539d5da65609 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:28:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1517598733',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1517598733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1517598',id=39,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJR6lw/cypLxMp4t6XQ7M+tSJvNtyIEeHgtwV636/5uNNNijKxwVBIvBEtmbY0k2xOd8sztcqY33siKtqt8VN2S+s3H68Q1hqjLUtcFM/8zizefjFfSFpUwzqWHbh0RBDQ==',key_name='tempest-keypair-1577444747',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:28:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0461ab72f35b4ebb995e9b602935c5b2',ramdisk_id='',reservation_id='r-rhw1zhei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1507989825',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:28:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0d492075e3d4171a9af5087c8eb8d25',uuid=31824d74-830c-4feb-ae7c-d68f23cc3a07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09845821-08f0-4128-9221-15dccf9de944", "address": "fa:16:3e:6b:59:63", "network": {"id": "4369e31c-31b6-429f-bfad-c83ed55005c0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1169310922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0461ab72f35b4ebb995e9b602935c5b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09845821-08", "ovs_interfaceid": "09845821-08f0-4128-9221-15dccf9de944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:31:37 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-d688693b-9be9-42a6-80f8-539d5da65609 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Converting VIF {"id": "09845821-08f0-4128-9221-15dccf9de944", "address": "fa:16:3e:6b:59:63", "network": {"id": "4369e31c-31b6-429f-bfad-c83ed55005c0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1169310922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0461ab72f35b4ebb995e9b602935c5b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09845821-08", "ovs_interfaceid": "09845821-08f0-4128-9221-15dccf9de944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:31:37 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-d688693b-9be9-42a6-80f8-539d5da65609 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:59:63,bridge_name='br-int',has_traffic_filtering=True,id=09845821-08f0-4128-9221-15dccf9de944,network=Network(4369e31c-31b6-429f-bfad-c83ed55005c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09845821-08') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:31:37 user nova-compute[75745]: DEBUG os_vif [None req-d688693b-9be9-42a6-80f8-539d5da65609 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:59:63,bridge_name='br-int',has_traffic_filtering=True,id=09845821-08f0-4128-9221-15dccf9de944,network=Network(4369e31c-31b6-429f-bfad-c83ed55005c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09845821-08') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:31:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09845821-08, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:31:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3e9b1ddd-1096-4237-830e-7edde81dbe78) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:31:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:31:37 user nova-compute[75745]: INFO os_vif [None req-d688693b-9be9-42a6-80f8-539d5da65609 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:59:63,bridge_name='br-int',has_traffic_filtering=True,id=09845821-08f0-4128-9221-15dccf9de944,network=Network(4369e31c-31b6-429f-bfad-c83ed55005c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09845821-08')
Dec 01 17:31:37 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-d688693b-9be9-42a6-80f8-539d5da65609 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Deleting instance files /opt/stack/data/nova/instances/31824d74-830c-4feb-ae7c-d68f23cc3a07_del
Dec 01 17:31:37 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-d688693b-9be9-42a6-80f8-539d5da65609 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Deletion of /opt/stack/data/nova/instances/31824d74-830c-4feb-ae7c-d68f23cc3a07_del complete
Dec 01 17:31:37 user nova-compute[75745]: INFO nova.compute.manager [None req-d688693b-9be9-42a6-80f8-539d5da65609 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Took 0.90 seconds to destroy the instance on the hypervisor.
Dec 01 17:31:37 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-d688693b-9be9-42a6-80f8-539d5da65609 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:31:37 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:31:37 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:31:37 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:31:37 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Took 0.87 seconds to deallocate network for instance.
Dec 01 17:31:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d688693b-9be9-42a6-80f8-539d5da65609 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:31:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d688693b-9be9-42a6-80f8-539d5da65609 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:31:38 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-d688693b-9be9-42a6-80f8-539d5da65609 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:31:38 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-d688693b-9be9-42a6-80f8-539d5da65609 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:31:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d688693b-9be9-42a6-80f8-539d5da65609 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.238s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:31:38 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-d688693b-9be9-42a6-80f8-539d5da65609 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Deleted allocations for instance 31824d74-830c-4feb-ae7c-d68f23cc3a07
Dec 01 17:31:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d688693b-9be9-42a6-80f8-539d5da65609 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825 tempest-TestServerVolumeAttachScenarioOldVersion-1507989825-project-member] Lock "31824d74-830c-4feb-ae7c-d68f23cc3a07" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.184s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:31:38 user nova-compute[75745]: DEBUG nova.compute.manager [req-cb4204a6-7e8f-4fa8-96bf-464451e445bf req-9343bc15-6964-470f-a764-92df077ef164 service nova] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Received event network-vif-plugged-09845821-08f0-4128-9221-15dccf9de944 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:31:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-cb4204a6-7e8f-4fa8-96bf-464451e445bf req-9343bc15-6964-470f-a764-92df077ef164 service nova] Acquiring lock "31824d74-830c-4feb-ae7c-d68f23cc3a07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:31:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-cb4204a6-7e8f-4fa8-96bf-464451e445bf req-9343bc15-6964-470f-a764-92df077ef164 service nova] Lock "31824d74-830c-4feb-ae7c-d68f23cc3a07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:31:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-cb4204a6-7e8f-4fa8-96bf-464451e445bf req-9343bc15-6964-470f-a764-92df077ef164 service nova] Lock "31824d74-830c-4feb-ae7c-d68f23cc3a07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:31:38 user nova-compute[75745]: DEBUG nova.compute.manager [req-cb4204a6-7e8f-4fa8-96bf-464451e445bf req-9343bc15-6964-470f-a764-92df077ef164 service nova] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] No waiting events found dispatching network-vif-plugged-09845821-08f0-4128-9221-15dccf9de944 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:31:38 user nova-compute[75745]: WARNING nova.compute.manager [req-cb4204a6-7e8f-4fa8-96bf-464451e445bf req-9343bc15-6964-470f-a764-92df077ef164 service nova] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Received unexpected event network-vif-plugged-09845821-08f0-4128-9221-15dccf9de944 for instance with vm_state deleted and task_state None.
Dec 01 17:31:38 user nova-compute[75745]: DEBUG nova.compute.manager [req-cb4204a6-7e8f-4fa8-96bf-464451e445bf req-9343bc15-6964-470f-a764-92df077ef164 service nova] [instance: 31824d74-830c-4feb-ae7c-d68f23cc3a07] Received event network-vif-deleted-09845821-08f0-4128-9221-15dccf9de944 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:31:40 user nova-compute[75745]: INFO nova.compute.manager [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Rescuing
Dec 01 17:31:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "refresh_cache-d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:31:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquired lock "refresh_cache-d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:31:40 user nova-compute[75745]: DEBUG nova.network.neutron [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:31:41 user nova-compute[75745]: DEBUG nova.network.neutron [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Updating instance_info_cache with network_info: [{"id": "a990f44c-7717-43df-978e-beef133804aa", "address": "fa:16:3e:37:53:1d", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa990f44c-77", "ovs_interfaceid": "a990f44c-7717-43df-978e-beef133804aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:31:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Releasing lock "refresh_cache-d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:31:41 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:41 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:41 user nova-compute[75745]: DEBUG nova.compute.manager [req-acf94cdf-a999-4034-ad37-0a58adfe93dd req-0170bcf1-4304-4c71-8d10-a4fcae324dfd service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Received event network-vif-unplugged-a990f44c-7717-43df-978e-beef133804aa {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:31:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-acf94cdf-a999-4034-ad37-0a58adfe93dd req-0170bcf1-4304-4c71-8d10-a4fcae324dfd service nova] Acquiring lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:31:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-acf94cdf-a999-4034-ad37-0a58adfe93dd req-0170bcf1-4304-4c71-8d10-a4fcae324dfd service nova] Lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:31:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-acf94cdf-a999-4034-ad37-0a58adfe93dd req-0170bcf1-4304-4c71-8d10-a4fcae324dfd service nova] Lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:31:41 user nova-compute[75745]: DEBUG nova.compute.manager [req-acf94cdf-a999-4034-ad37-0a58adfe93dd req-0170bcf1-4304-4c71-8d10-a4fcae324dfd service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] No waiting events found dispatching network-vif-unplugged-a990f44c-7717-43df-978e-beef133804aa {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:31:41 user nova-compute[75745]: WARNING nova.compute.manager [req-acf94cdf-a999-4034-ad37-0a58adfe93dd req-0170bcf1-4304-4c71-8d10-a4fcae324dfd service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Received unexpected event network-vif-unplugged-a990f44c-7717-43df-978e-beef133804aa for instance with vm_state active and task_state rescuing.
Dec 01 17:31:41 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:41 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:42 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Instance destroyed successfully.
Dec 01 17:31:42 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Attempting a stable device rescue
Dec 01 17:31:42 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75745) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 01 17:31:42 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Instance directory exists: not creating {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Dec 01 17:31:42 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Creating image(s)
Dec 01 17:31:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:31:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "/opt/stack/data/nova/instances/d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:31:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "/opt/stack/data/nova/instances/d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:31:42 user nova-compute[75745]: DEBUG nova.objects.instance [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lazy-loading 'trusted_certs' on Instance uuid d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:31:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "a9723ca95a631d31b9d4e5e654b4b630a693ec7a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:31:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "a9723ca95a631d31b9d4e5e654b4b630a693ec7a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:31:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9723ca95a631d31b9d4e5e654b4b630a693ec7a.part --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9723ca95a631d31b9d4e5e654b4b630a693ec7a.part --force-share --output=json" returned: 0 in 0.189s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:43 user nova-compute[75745]: DEBUG nova.virt.images [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] 980337f8-578d-4d68-80da-3399b87dcbf5 was qcow2, converting to raw {{(pid=75745) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 01 17:31:43 user nova-compute[75745]: DEBUG nova.privsep.utils [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75745) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 17:31:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a9723ca95a631d31b9d4e5e654b4b630a693ec7a.part /opt/stack/data/nova/instances/_base/a9723ca95a631d31b9d4e5e654b4b630a693ec7a.converted {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:43 user nova-compute[75745]: DEBUG nova.compute.manager [req-471b3192-642c-487c-ba65-87bd7ad5be9f req-179a4f07-b651-4b7c-989f-e6b78ed5bf79 service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Received event network-vif-plugged-a990f44c-7717-43df-978e-beef133804aa {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:31:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-471b3192-642c-487c-ba65-87bd7ad5be9f req-179a4f07-b651-4b7c-989f-e6b78ed5bf79 service nova] Acquiring lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:31:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-471b3192-642c-487c-ba65-87bd7ad5be9f req-179a4f07-b651-4b7c-989f-e6b78ed5bf79 service nova] Lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:31:43 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-471b3192-642c-487c-ba65-87bd7ad5be9f req-179a4f07-b651-4b7c-989f-e6b78ed5bf79 service nova] Lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:31:43 user nova-compute[75745]: DEBUG nova.compute.manager [req-471b3192-642c-487c-ba65-87bd7ad5be9f req-179a4f07-b651-4b7c-989f-e6b78ed5bf79 service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] No waiting events found dispatching network-vif-plugged-a990f44c-7717-43df-978e-beef133804aa {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:31:43 user nova-compute[75745]: WARNING nova.compute.manager [req-471b3192-642c-487c-ba65-87bd7ad5be9f req-179a4f07-b651-4b7c-989f-e6b78ed5bf79 service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Received unexpected event network-vif-plugged-a990f44c-7717-43df-978e-beef133804aa for instance with vm_state active and task_state rescuing.
Dec 01 17:31:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a9723ca95a631d31b9d4e5e654b4b630a693ec7a.part /opt/stack/data/nova/instances/_base/a9723ca95a631d31b9d4e5e654b4b630a693ec7a.converted" returned: 0 in 0.741s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9723ca95a631d31b9d4e5e654b4b630a693ec7a.converted --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9723ca95a631d31b9d4e5e654b4b630a693ec7a.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "a9723ca95a631d31b9d4e5e654b4b630a693ec7a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.312s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "a9723ca95a631d31b9d4e5e654b4b630a693ec7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "a9723ca95a631d31b9d4e5e654b4b630a693ec7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9723ca95a631d31b9d4e5e654b4b630a693ec7a --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9723ca95a631d31b9d4e5e654b4b630a693ec7a --force-share --output=json" returned: 0 in 0.170s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9723ca95a631d31b9d4e5e654b4b630a693ec7a,backing_fmt=raw /opt/stack/data/nova/instances/d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3/disk.rescue {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9723ca95a631d31b9d4e5e654b4b630a693ec7a,backing_fmt=raw /opt/stack/data/nova/instances/d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3/disk.rescue" returned: 0 in 0.052s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "a9723ca95a631d31b9d4e5e654b4b630a693ec7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG nova.objects.instance [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lazy-loading 'migration_context' on Instance uuid d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG nova.objects.base [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Object Instance<d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Start _get_guest_xml network_info=[{"id": "a990f44c-7717-43df-978e-beef133804aa", "address": "fa:16:3e:37:53:1d", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "vif_mac": "fa:16:3e:37:53:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa990f44c-77", "ovs_interfaceid": "a990f44c-7717-43df-978e-beef133804aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '980337f8-578d-4d68-80da-3399b87dcbf5', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': '264acdef-511a-4adb-9655-024288ee57c1', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zcMiHqma', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'd5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3', 'attached_at': '', 'detached_at': '', 'volume_id': '522008c2-67f6-409f-ab67-f7d85f0c7c7a', 'serial': '522008c2-67f6-409f-ab67-f7d85f0c7c7a'}, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG nova.objects.instance [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lazy-loading 'resources' on Instance uuid d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG nova.objects.base [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Object Instance<d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG nova.objects.instance [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lazy-loading 'numa_topology' on Instance uuid d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG nova.objects.base [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Object Instance<d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:31:44 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:31:44 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:31:44 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG nova.objects.instance [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lazy-loading 'vcpu_model' on Instance uuid d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG nova.objects.base [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Object Instance<d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zcMiHqma', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:31:44 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:31:44 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:31:44 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:31:44 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:31:44 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:31:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d22ec00-1962-473b-8da1-0aca0d018c24]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = zcMiHqma\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Dec 01 17:31:44 user nova-compute[75745]: node.name = iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a
Dec 01 17:31:44 user nova-compute[75745]: node.tpgt = -1
Dec 01 17:31:44 user nova-compute[75745]: node.startup = automatic
Dec 01 17:31:44 user nova-compute[75745]: node.leading_login = No
Dec 01 17:31:44 user nova-compute[75745]: iface.iscsi_ifacename = default
Dec 01 17:31:44 user nova-compute[75745]: iface.net_ifacename = <empty>
Dec 01 17:31:44 user nova-compute[75745]: iface.ipaddress = <empty>
Dec 01 17:31:44 user nova-compute[75745]: iface.prefix_len = 0
Dec 01 17:31:44 user nova-compute[75745]: iface.hwaddress = <empty>
Dec 01 17:31:44 user nova-compute[75745]: iface.transport_name = tcp
Dec 01 17:31:44 user nova-compute[75745]: iface.initiatorname = <empty>
Dec 01 17:31:44 user nova-compute[75745]: iface.state = <empty>
Dec 01 17:31:44 user nova-compute[75745]: iface.vlan_id = 0
Dec 01 17:31:44 user nova-compute[75745]: iface.vlan_priority = 0
Dec 01 17:31:44 user nova-compute[75745]: iface.vlan_state = <empty>
Dec 01 17:31:44 user nova-compute[75745]: iface.iface_num = 0
Dec 01 17:31:44 user nova-compute[75745]: iface.mtu = 0
Dec 01 17:31:44 user nova-compute[75745]: iface.port = 0
Dec 01 17:31:44 user nova-compute[75745]: iface.bootproto = <empty>
Dec 01 17:31:44 user nova-compute[75745]: iface.subnet_mask = <empty>
Dec 01 17:31:44 user nova-compute[75745]: iface.gateway = <empty>
Dec 01 17:31:44 user nova-compute[75745]: iface.dhcp_alt_client_id_state = <empty>
Dec 01 17:31:44 user nova-compute[75745]: iface.dhcp_alt_client_id = <empty>
Dec 01 17:31:44 user nova-compute[75745]: iface.dhcp_dns = <empty>
Dec 01 17:31:44 user nova-compute[75745]: iface.dhcp_learn_iqn = <empty>
Dec 01 17:31:44 user nova-compute[75745]: iface.dhcp_req_vendor_id_state = <empty>
Dec 01 17:31:44 user nova-compute[75745]: iface.dhcp_vendor_id_state = <empty>
Dec 01 17:31:44 user nova-compute[75745]: iface.dhcp_vendor_id = <empty>
Dec 01 17:31:44 user nova-compute[75745]: iface.dhcp_slp_da = <empty>
Dec 01 17:31:44 user nova-compute[75745]: iface.fragmentation = <empty>
Dec 01 17:31:44 user nova-compute[75745]: iface.gratuitous_arp = <empty>
Dec 01 17:31:44 user nova-compute[75745]: iface.incoming_forwarding = <empty>
Dec 01 17:31:44 user nova-compute[75745]: iface.tos_state = <empty>
Dec 01 17:31:44 user nova-compute[75745]: iface.tos = 0
Dec 01 17:31:44 user nova-compute[75745]: iface.ttl = 0
Dec 01 17:31:44 user nova-compute[75745]: iface.delayed_ack = <empty>
Dec 01 17:31:44 user nova-compute[75745]: iface.tcp_nagle = <empty>
Dec 01 17:31:44 user nova-compute[75745]: iface.tcp_wsf_state = <empty>
Dec 01 17:31:44 user nova-compute[75745]: iface.tcp_wsf = 0
Dec 01 17:31:44 user nova-compute[75745]: iface.tcp_timer_scale = 0
Dec 01 17:31:44 user nova-compute[75745]: iface.tcp_timestamp = <empty>
Dec 01 17:31:44 user nova-compute[75745]: iface.redirect = <empty>
Dec 01 17:31:44 user nova-compute[75745]: iface.def_task_mgmt_timeout = 0
Dec 01 17:31:44 user nova-compute[75745]: iface.header_digest = <empty>
Dec 01 17:31:44 user nova-compute[75745]: iface.data_digest = <empty>
Dec 01 17:31:44 user nova-compute[75745]: iface.immediate_data = <empty>
Dec 01 17:31:44 user nova-compute[75745]: iface.initial_r2t = <empty>
Dec 01 17:31:44 user nova-compute[75745]: iface.data_seq_inorder = <empty>
Dec 01 17:31:44 user nova-compute[75745]: iface.data_pdu_inorder = <empty>
Dec 01 17:31:44 user nova-compute[75745]: iface.erl = 0
Dec 01 17:31:44 user nova-compute[75745]: iface.max_receive_data_len = 0
Dec 01 17:31:44 user nova-compute[75745]: iface.first_burst_len = 0
Dec 01 17:31:44 user nova-compute[75745]: iface.max_outstanding_r2t = 0
Dec 01 17:31:44 user nova-compute[75745]: iface.max_burst_len = 0
Dec 01 17:31:44 user nova-compute[75745]: iface.chap_auth = <empty>
Dec 01 17:31:44 user nova-compute[75745]: iface.bidi_chap = <empty>
Dec 01 17:31:44 user nova-compute[75745]: iface.strict_login_compliance = <empty>
Dec 01 17:31:44 user nova-compute[75745]: iface.discovery_auth = <empty>
Dec 01 17:31:44 user nova-compute[75745]: iface.discovery_logout = <empty>
Dec 01 17:31:44 user nova-compute[75745]: node.discovery_address = <empty>
Dec 01 17:31:44 user nova-compute[75745]: node.discovery_port = 0
Dec 01 17:31:44 user nova-compute[75745]: node.discovery_type = static
Dec 01 17:31:44 user nova-compute[75745]: node.session.initial_cmdsn = 0
Dec 01 17:31:44 user nova-compute[75745]: node.session.initial_login_retry_max = 8
Dec 01 17:31:44 user nova-compute[75745]: node.session.xmit_thread_priority = -20
Dec 01 17:31:44 user nova-compute[75745]: node.session.cmds_max = 128
Dec 01 17:31:44 user nova-compute[75745]: node.session.queue_depth = 32
Dec 01 17:31:44 user nova-compute[75745]: node.session.nr_sessions = 1
Dec 01 17:31:44 user nova-compute[75745]: node.session.auth.authmethod = CHAP
Dec 01 17:31:44 user nova-compute[75745]: node.session.auth.username = zcMiHqma
Dec 01 17:31:44 user nova-compute[75745]: node.session.auth.password = ***
Dec 01 17:31:44 user nova-compute[75745]: node.session.auth.username_in = <empty>
Dec 01 17:31:44 user nova-compute[75745]: node.session.auth.password_in = <empty>
Dec 01 17:31:44 user nova-compute[75745]: node.session.auth.chap_algs = MD5
Dec 01 17:31:44 user nova-compute[75745]: node.session.timeo.replacement_timeout = 120
Dec 01 17:31:44 user nova-compute[75745]: node.session.err_timeo.abort_timeout = 15
Dec 01 17:31:44 user nova-compute[75745]: node.session.err_timeo.lu_reset_timeout = 30
Dec 01 17:31:44 user nova-compute[75745]: node.session.err_timeo.tgt_reset_timeout = 30
Dec 01 17:31:44 user nova-compute[75745]: node.session.err_timeo.host_reset_timeout = 60
Dec 01 17:31:44 user nova-compute[75745]: node.session.iscsi.FastAbort = Yes
Dec 01 17:31:44 user nova-compute[75745]: node.session.iscsi.InitialR2T = No
Dec 01 17:31:44 user nova-compute[75745]: node.session.iscsi.ImmediateData = Yes
Dec 01 17:31:44 user nova-compute[75745]: node.session.iscsi.FirstBurstLength = 262144
Dec 01 17:31:44 user nova-compute[75745]: node.session.iscsi.MaxBurstLength = 16776192
Dec 01 17:31:44 user nova-compute[75745]: node.session.iscsi.DefaultTime2Retain = 0
Dec 01 17:31:44 user nova-compute[75745]: node.session.iscsi.DefaultTime2Wait = 2
Dec 01 17:31:44 user nova-compute[75745]: node.session.iscsi.MaxConnections = 1
Dec 01 17:31:44 user nova-compute[75745]: node.session.iscsi.MaxOutstandingR2T = 1
Dec 01 17:31:44 user nova-compute[75745]: node.session.iscsi.ERL = 0
Dec 01 17:31:44 user nova-compute[75745]: node.session.scan = manual
Dec 01 17:31:44 user nova-compute[75745]: node.session.reopen_max = 0
Dec 01 17:31:44 user nova-compute[75745]: node.conn[0].address = 172.16.0.220
Dec 01 17:31:44 user nova-compute[75745]: node.conn[0].port = 3260
Dec 01 17:31:44 user nova-compute[75745]: node.conn[0].startup = manual
Dec 01 17:31:44 user nova-compute[75745]: node.conn[0].tcp.window_size = 524288
Dec 01 17:31:44 user nova-compute[75745]: node.conn[0].tcp.type_of_service = 0
Dec 01 17:31:44 user nova-compute[75745]: node.conn[0].timeo.logout_timeout = 15
Dec 01 17:31:44 user nova-compute[75745]: node.conn[0].timeo.login_timeout = 15
Dec 01 17:31:44 user nova-compute[75745]: node.conn[0].timeo.auth_timeout = 45
Dec 01 17:31:44 user nova-compute[75745]: node.conn[0].timeo.noop_out_interval = 5
Dec 01 17:31:44 user nova-compute[75745]: node.conn[0].timeo.noop_out_timeout = 5
Dec 01 17:31:44 user nova-compute[75745]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Dec 01 17:31:44 user nova-compute[75745]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Dec 01 17:31:44 user nova-compute[75745]: node.conn[0].iscsi.HeaderDigest = None
Dec 01 17:31:44 user nova-compute[75745]: node.conn[0].iscsi.DataDigest = None
Dec 01 17:31:44 user nova-compute[75745]: node.conn[0].iscsi.IFMarker = No
Dec 01 17:31:44 user nova-compute[75745]: node.conn[0].iscsi.OFMarker = No
Dec 01 17:31:44 user nova-compute[75745]: # END RECORD
Dec 01 17:31:44 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f6dac5-2357-4160-885d-b55f40b42430]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bb2599-f3cf-4d3c-9ee4-5fbe3c2f9afc]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zcMiHqma {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zcMiHqma" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba9e764-106a-4d0d-910e-2a9429e4651b]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zcMiHqma'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc14337e-ab0f-4b24-9ed6-5983bfed2c09]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[815bb544-136f-435e-b1eb-a94695f3b034]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:31:44 user nova-compute[75745]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a (non-flash)
Dec 01 17:31:44 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:31:44 user nova-compute[75745]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a (non-flash)
Dec 01 17:31:44 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.135s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] HCTL ('34', '0', '0', 0) found on session 45 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e8c771-87e9-4cc0-9a9b-3e24d36f782b]: (4, ('0 0 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Searching for a device in session 45 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zcMiHqma', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.158s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] <== connect_volume: return (159ms) {'type': 'block', 'scsi_wwn': '23337623631356232', 'path': '/dev/sdc'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:31:44 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337623631356232', 'path': '/dev/sdc'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:31:45 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:29:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-371241425',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-371241425',id=40,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:30:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='adb3ba16695543cab6f10932fd6b2d2d',ramdisk_id='',reservation_id='r-aiu251ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-90723689',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:30:17Z,user_data=None,user_id='b319a47b86c04affa1858e1c2359876b',uuid=d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a990f44c-7717-43df-978e-beef133804aa", "address": "fa:16:3e:37:53:1d", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "vif_mac": "fa:16:3e:37:53:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa990f44c-77", "ovs_interfaceid": "a990f44c-7717-43df-978e-beef133804aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:31:45 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Converting VIF {"id": "a990f44c-7717-43df-978e-beef133804aa", "address": "fa:16:3e:37:53:1d", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "vif_mac": "fa:16:3e:37:53:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa990f44c-77", "ovs_interfaceid": "a990f44c-7717-43df-978e-beef133804aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:31:45 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:53:1d,bridge_name='br-int',has_traffic_filtering=True,id=a990f44c-7717-43df-978e-beef133804aa,network=Network(bf1db63d-d427-41c2-ac82-6fab9483a423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa990f44c-77') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:31:45 user nova-compute[75745]: DEBUG nova.objects.instance [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lazy-loading 'pci_devices' on Instance uuid d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:31:45 user nova-compute[75745]: DEBUG nova.objects.base [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Object Instance<d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:31:45 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:31:45 user nova-compute[75745]:   <uuid>d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3</uuid>
Dec 01 17:31:45 user nova-compute[75745]:   <name>instance-00000028</name>
Dec 01 17:31:45 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:31:45 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:31:45 user nova-compute[75745]:   <metadata>
Dec 01 17:31:45 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:31:45 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:31:45 user nova-compute[75745]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-371241425</nova:name>
Dec 01 17:31:45 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:31:44</nova:creationTime>
Dec 01 17:31:45 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:31:45 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:31:45 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:31:45 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:31:45 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:31:45 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:31:45 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:31:45 user nova-compute[75745]:       <nova:owner>
Dec 01 17:31:45 user nova-compute[75745]:         <nova:user uuid="b319a47b86c04affa1858e1c2359876b">tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member</nova:user>
Dec 01 17:31:45 user nova-compute[75745]:         <nova:project uuid="adb3ba16695543cab6f10932fd6b2d2d">tempest-ServerBootFromVolumeStableRescueTest-90723689</nova:project>
Dec 01 17:31:45 user nova-compute[75745]:       </nova:owner>
Dec 01 17:31:45 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:31:45 user nova-compute[75745]:       <nova:ports>
Dec 01 17:31:45 user nova-compute[75745]:         <nova:port uuid="a990f44c-7717-43df-978e-beef133804aa">
Dec 01 17:31:45 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 01 17:31:45 user nova-compute[75745]:         </nova:port>
Dec 01 17:31:45 user nova-compute[75745]:       </nova:ports>
Dec 01 17:31:45 user nova-compute[75745]:     </nova:instance>
Dec 01 17:31:45 user nova-compute[75745]:   </metadata>
Dec 01 17:31:45 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:31:45 user nova-compute[75745]:     <system>
Dec 01 17:31:45 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:31:45 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:31:45 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:31:45 user nova-compute[75745]:       <entry name="serial">d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3</entry>
Dec 01 17:31:45 user nova-compute[75745]:       <entry name="uuid">d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3</entry>
Dec 01 17:31:45 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:31:45 user nova-compute[75745]:     </system>
Dec 01 17:31:45 user nova-compute[75745]:   </sysinfo>
Dec 01 17:31:45 user nova-compute[75745]:   <os>
Dec 01 17:31:45 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:31:45 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:31:45 user nova-compute[75745]:   </os>
Dec 01 17:31:45 user nova-compute[75745]:   <features>
Dec 01 17:31:45 user nova-compute[75745]:     <acpi/>
Dec 01 17:31:45 user nova-compute[75745]:     <apic/>
Dec 01 17:31:45 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:31:45 user nova-compute[75745]:   </features>
Dec 01 17:31:45 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:31:45 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:31:45 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:31:45 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:31:45 user nova-compute[75745]:   </clock>
Dec 01 17:31:45 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:31:45 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:31:45 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:31:45 user nova-compute[75745]:   </cpu>
Dec 01 17:31:45 user nova-compute[75745]:   <devices>
Dec 01 17:31:45 user nova-compute[75745]:     <disk type="block" device="disk">
Dec 01 17:31:45 user nova-compute[75745]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:31:45 user nova-compute[75745]:       <source dev="/dev/sdc"/>
Dec 01 17:31:45 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:31:45 user nova-compute[75745]:       <serial>522008c2-67f6-409f-ab67-f7d85f0c7c7a</serial>
Dec 01 17:31:45 user nova-compute[75745]:     </disk>
Dec 01 17:31:45 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:31:45 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:31:45 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3/disk.rescue"/>
Dec 01 17:31:45 user nova-compute[75745]:       <target dev="vdb" bus="virtio"/>
Dec 01 17:31:45 user nova-compute[75745]:       <boot order="1"/>
Dec 01 17:31:45 user nova-compute[75745]:     </disk>
Dec 01 17:31:45 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:31:45 user nova-compute[75745]:       <mac address="fa:16:3e:37:53:1d"/>
Dec 01 17:31:45 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:31:45 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:31:45 user nova-compute[75745]:       <target dev="tapa990f44c-77"/>
Dec 01 17:31:45 user nova-compute[75745]:     </interface>
Dec 01 17:31:45 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:31:45 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3/console.log" append="off"/>
Dec 01 17:31:45 user nova-compute[75745]:     </serial>
Dec 01 17:31:45 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:31:45 user nova-compute[75745]:     <video>
Dec 01 17:31:45 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:31:45 user nova-compute[75745]:     </video>
Dec 01 17:31:45 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:31:45 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:31:45 user nova-compute[75745]:     </rng>
Dec 01 17:31:45 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:31:45 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:31:45 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:31:45 user nova-compute[75745]:     </memballoon>
Dec 01 17:31:45 user nova-compute[75745]:   </devices>
Dec 01 17:31:45 user nova-compute[75745]: </domain>
Dec 01 17:31:45 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:31:45 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Instance destroyed successfully.
Dec 01 17:31:45 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:31:45 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:31:45 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] No VIF found with MAC fa:16:3e:37:53:1d, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:31:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:46 user nova-compute[75745]: DEBUG nova.compute.manager [req-51f40319-420f-47c2-9f97-6fbf4dd4827f req-d4b97eb6-7c37-45d1-8c23-e81e91821dcb service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Received event network-vif-plugged-a990f44c-7717-43df-978e-beef133804aa {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:31:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-51f40319-420f-47c2-9f97-6fbf4dd4827f req-d4b97eb6-7c37-45d1-8c23-e81e91821dcb service nova] Acquiring lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:31:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-51f40319-420f-47c2-9f97-6fbf4dd4827f req-d4b97eb6-7c37-45d1-8c23-e81e91821dcb service nova] Lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:31:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-51f40319-420f-47c2-9f97-6fbf4dd4827f req-d4b97eb6-7c37-45d1-8c23-e81e91821dcb service nova] Lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:31:46 user nova-compute[75745]: DEBUG nova.compute.manager [req-51f40319-420f-47c2-9f97-6fbf4dd4827f req-d4b97eb6-7c37-45d1-8c23-e81e91821dcb service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] No waiting events found dispatching network-vif-plugged-a990f44c-7717-43df-978e-beef133804aa {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:31:46 user nova-compute[75745]: WARNING nova.compute.manager [req-51f40319-420f-47c2-9f97-6fbf4dd4827f req-d4b97eb6-7c37-45d1-8c23-e81e91821dcb service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Received unexpected event network-vif-plugged-a990f44c-7717-43df-978e-beef133804aa for instance with vm_state active and task_state rescuing.
Dec 01 17:31:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:48 user nova-compute[75745]: DEBUG nova.compute.manager [req-f0939a78-9730-4aa7-8840-8c1af3c27867 req-c304433b-df01-408c-974e-57cc0c7df772 service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Received event network-vif-plugged-a990f44c-7717-43df-978e-beef133804aa {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:31:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-f0939a78-9730-4aa7-8840-8c1af3c27867 req-c304433b-df01-408c-974e-57cc0c7df772 service nova] Acquiring lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:31:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-f0939a78-9730-4aa7-8840-8c1af3c27867 req-c304433b-df01-408c-974e-57cc0c7df772 service nova] Lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:31:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-f0939a78-9730-4aa7-8840-8c1af3c27867 req-c304433b-df01-408c-974e-57cc0c7df772 service nova] Lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:31:48 user nova-compute[75745]: DEBUG nova.compute.manager [req-f0939a78-9730-4aa7-8840-8c1af3c27867 req-c304433b-df01-408c-974e-57cc0c7df772 service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] No waiting events found dispatching network-vif-plugged-a990f44c-7717-43df-978e-beef133804aa {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:31:48 user nova-compute[75745]: WARNING nova.compute.manager [req-f0939a78-9730-4aa7-8840-8c1af3c27867 req-c304433b-df01-408c-974e-57cc0c7df772 service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Received unexpected event network-vif-plugged-a990f44c-7717-43df-978e-beef133804aa for instance with vm_state active and task_state rescuing.
Dec 01 17:31:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:31:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:31:49 user nova-compute[75745]: DEBUG nova.objects.instance [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lazy-loading 'flavor' on Instance uuid 37d1f284-e5ec-4f47-b819-e8ed8ca793d7 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:31:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:31:49 user nova-compute[75745]: DEBUG nova.compute.manager [None req-55cc07f8-b492-4fe7-9114-2af2883d1962 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:31:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:31:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:31:49 user nova-compute[75745]: INFO nova.compute.manager [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Attaching volume bcd1f49e-a684-4c68-a762-5475fb913b50 to /dev/vdb
Dec 01 17:31:49 user nova-compute[75745]: DEBUG os_brick.utils [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:31:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed87726b-839f-4bac-9ca1-005a9b304546]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:31:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9d0bae-7a00-4a79-b522-250570fbd5c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:31:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc92170-4c66-49ca-bd87-29a9f67ea136]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:31:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d646c21-0e89-4a8d-a4e2-95c4409bee30]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:31:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:31:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:31:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:49 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:31:49 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:31:49 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4980d5-8f03-488d-9c7a-73a557498f75]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:31:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:31:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:31:49 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:31:49 user nova-compute[75745]: DEBUG os_brick.utils [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:31:49 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Updating existing volume attachment record: 535e2805-6dc5-4f84-9a9c-129d894f5db0 {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:31:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:52 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:31:54 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:31:54 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Cleaning up deleted instances {{(pid=75745) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 01 17:31:54 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] There are 0 instances to clean {{(pid=75745) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 01 17:31:54 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:31:54 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75745) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 01 17:31:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:31:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:31:58 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uqQykrKi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:31:58 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:31:58 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:31:58 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:31:58 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:31:58 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:31:58 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:31:58 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:31:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:58 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:31:58 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:31:58 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:31:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:58 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[479118e0-09df-4165-b24d-a99eda60053f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:31:58 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:31:58 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:31:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:58 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[000791f8-1e43-4c68-bcc0-db584240eb9a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:31:58 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50] added
Dec 01 17:31:58 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:31:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:58 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ced4c33-0b66-414c-9234-0e2e6bae72c6]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:31:58 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:31:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:58 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c7322f-2118-46a9-9e84-8bb76522027b]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:31:58 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:31:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uqQykrKi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:31:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uqQykrKi" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:59 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f5473a-4982-403e-8456-0ddf3d9c6db3]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:31:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uqQykrKi'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:31:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:59 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6cc73e-c149-4c7d-bc79-92467ad82120]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:31:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:31:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:59 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af2aa3a-b473-4384-93d8-07755766b6d4]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:31:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:31:59 user nova-compute[75745]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a (non-flash)
Dec 01 17:31:59 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:31:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:31:59 user nova-compute[75745]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a (non-flash)
Dec 01 17:31:59 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:31:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:59 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[83787c17-710e-4903-931a-4ff0dca710a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:31:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50, portal: 172.16.0.220,3260]
Dec 01 17:31:59 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50, portal: 172.16.0.220,3260] successful.
Dec 01 17:31:59 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:31:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:59 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[26db9ac4-0d63-436c-a4bc-2ce9928a86f9]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:31:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:31:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:59 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8224c7-a967-4e3e-8231-4343a4560eb9]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:31:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:31:59 user nova-compute[75745]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a (non-flash)
Dec 01 17:31:59 user nova-compute[75745]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50 (non-flash)
Dec 01 17:31:59 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:31:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:31:59 user nova-compute[75745]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a (non-flash)
Dec 01 17:31:59 user nova-compute[75745]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50 (non-flash)
Dec 01 17:31:59 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:31:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:31:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:31:59 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:31:59 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:31:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:31:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:31:59 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45f369f-d92e-4dfb-b223-c2b24b6d25ae]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:31:59 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:31:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uqQykrKi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:31:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:32:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:32:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '26337376536663865', 'path': '/dev/sdd'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:32:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337376536663865', 'path': '/dev/sdd'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:32:00 user nova-compute[75745]: DEBUG nova.objects.instance [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lazy-loading 'flavor' on Instance uuid 37d1f284-e5ec-4f47-b819-e8ed8ca793d7 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:32:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 17:32:00 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:32:00 user nova-compute[75745]:   <source dev="/dev/sdd"/>
Dec 01 17:32:00 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:32:00 user nova-compute[75745]:   <serial>bcd1f49e-a684-4c68-a762-5475fb913b50</serial>
Dec 01 17:32:00 user nova-compute[75745]: </disk>
Dec 01 17:32:00 user nova-compute[75745]:  {{(pid=75745) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 17:32:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:32:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:32:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] No VIF found with MAC fa:16:3e:89:52:37, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:32:00 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:32:00 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:32:00 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:32:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ac7823b3-f04f-404a-b595-264da0bb4e17 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.529s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:32:01 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:32:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:32:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:32:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:32:01 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:32:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:32:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:32:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:32:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:32:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:32:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:32:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:32:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:32:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:32:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:32:02 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:32:02 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37d1f284-e5ec-4f47-b819-e8ed8ca793d7/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:32:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37d1f284-e5ec-4f47-b819-e8ed8ca793d7/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:32:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37d1f284-e5ec-4f47-b819-e8ed8ca793d7/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:32:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37d1f284-e5ec-4f47-b819-e8ed8ca793d7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:32:03 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:32:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:32:03 user nova-compute[75745]: DEBUG nova.compute.manager [req-25afabfc-b279-46b1-8d94-f344edfe678f req-56f57f70-26ef-4566-b9d1-42a9d10e25fa service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Received event network-changed-511358d5-fc8c-4824-9f9e-1c7cda2fbb66 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:32:03 user nova-compute[75745]: DEBUG nova.compute.manager [req-25afabfc-b279-46b1-8d94-f344edfe678f req-56f57f70-26ef-4566-b9d1-42a9d10e25fa service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Refreshing instance network info cache due to event network-changed-511358d5-fc8c-4824-9f9e-1c7cda2fbb66. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:32:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-25afabfc-b279-46b1-8d94-f344edfe678f req-56f57f70-26ef-4566-b9d1-42a9d10e25fa service nova] Acquiring lock "refresh_cache-37d1f284-e5ec-4f47-b819-e8ed8ca793d7" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:32:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-25afabfc-b279-46b1-8d94-f344edfe678f req-56f57f70-26ef-4566-b9d1-42a9d10e25fa service nova] Acquired lock "refresh_cache-37d1f284-e5ec-4f47-b819-e8ed8ca793d7" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:32:03 user nova-compute[75745]: DEBUG nova.network.neutron [req-25afabfc-b279-46b1-8d94-f344edfe678f req-56f57f70-26ef-4566-b9d1-42a9d10e25fa service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Refreshing network info cache for port 511358d5-fc8c-4824-9f9e-1c7cda2fbb66 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:32:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:32:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:32:03 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:32:04 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:32:04 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:32:04 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=8414MB free_disk=25.005592346191406GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:32:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:32:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:32:04 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 5e631ac3-8122-46a3-a54f-2395c0f7cf7c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:32:04 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 5aee52eb-78e3-4f60-a920-7ade912735e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:32:04 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 61e0e19b-f926-4524-82c8-833f804c9b72 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:32:04 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:32:04 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 37d1f284-e5ec-4f47-b819-e8ed8ca793d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:32:04 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:32:04 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:32:04 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:32:04 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:32:04 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:32:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.333s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:32:04 user nova-compute[75745]: DEBUG nova.network.neutron [req-25afabfc-b279-46b1-8d94-f344edfe678f req-56f57f70-26ef-4566-b9d1-42a9d10e25fa service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Updated VIF entry in instance network info cache for port 511358d5-fc8c-4824-9f9e-1c7cda2fbb66. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:32:04 user nova-compute[75745]: DEBUG nova.network.neutron [req-25afabfc-b279-46b1-8d94-f344edfe678f req-56f57f70-26ef-4566-b9d1-42a9d10e25fa service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Updating instance_info_cache with network_info: [{"id": "511358d5-fc8c-4824-9f9e-1c7cda2fbb66", "address": "fa:16:3e:89:52:37", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511358d5-fc", "ovs_interfaceid": "511358d5-fc8c-4824-9f9e-1c7cda2fbb66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:32:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-25afabfc-b279-46b1-8d94-f344edfe678f req-56f57f70-26ef-4566-b9d1-42a9d10e25fa service nova] Releasing lock "refresh_cache-37d1f284-e5ec-4f47-b819-e8ed8ca793d7" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:32:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:32:05 user nova-compute[75745]: DEBUG nova.compute.manager [req-c4e9cc06-e2ab-4b8f-943a-1224701ffff5 req-1bfbb7d7-d91c-4206-897a-a4fbe792f156 service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Received event network-changed-511358d5-fc8c-4824-9f9e-1c7cda2fbb66 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:32:05 user nova-compute[75745]: DEBUG nova.compute.manager [req-c4e9cc06-e2ab-4b8f-943a-1224701ffff5 req-1bfbb7d7-d91c-4206-897a-a4fbe792f156 service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Refreshing instance network info cache due to event network-changed-511358d5-fc8c-4824-9f9e-1c7cda2fbb66. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:32:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c4e9cc06-e2ab-4b8f-943a-1224701ffff5 req-1bfbb7d7-d91c-4206-897a-a4fbe792f156 service nova] Acquiring lock "refresh_cache-37d1f284-e5ec-4f47-b819-e8ed8ca793d7" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:32:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c4e9cc06-e2ab-4b8f-943a-1224701ffff5 req-1bfbb7d7-d91c-4206-897a-a4fbe792f156 service nova] Acquired lock "refresh_cache-37d1f284-e5ec-4f47-b819-e8ed8ca793d7" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:32:05 user nova-compute[75745]: DEBUG nova.network.neutron [req-c4e9cc06-e2ab-4b8f-943a-1224701ffff5 req-1bfbb7d7-d91c-4206-897a-a4fbe792f156 service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Refreshing network info cache for port 511358d5-fc8c-4824-9f9e-1c7cda2fbb66 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:32:06 user nova-compute[75745]: DEBUG nova.network.neutron [req-c4e9cc06-e2ab-4b8f-943a-1224701ffff5 req-1bfbb7d7-d91c-4206-897a-a4fbe792f156 service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Updated VIF entry in instance network info cache for port 511358d5-fc8c-4824-9f9e-1c7cda2fbb66. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:32:06 user nova-compute[75745]: DEBUG nova.network.neutron [req-c4e9cc06-e2ab-4b8f-943a-1224701ffff5 req-1bfbb7d7-d91c-4206-897a-a4fbe792f156 service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Updating instance_info_cache with network_info: [{"id": "511358d5-fc8c-4824-9f9e-1c7cda2fbb66", "address": "fa:16:3e:89:52:37", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511358d5-fc", "ovs_interfaceid": "511358d5-fc8c-4824-9f9e-1c7cda2fbb66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:32:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c4e9cc06-e2ab-4b8f-943a-1224701ffff5 req-1bfbb7d7-d91c-4206-897a-a4fbe792f156 service nova] Releasing lock "refresh_cache-37d1f284-e5ec-4f47-b819-e8ed8ca793d7" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:32:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-651af871-e3a2-4c8d-a51b-ad52eea1e312 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:32:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-651af871-e3a2-4c8d-a51b-ad52eea1e312 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:32:06 user nova-compute[75745]: INFO nova.compute.manager [None req-651af871-e3a2-4c8d-a51b-ad52eea1e312 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Rebooting instance
Dec 01 17:32:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-651af871-e3a2-4c8d-a51b-ad52eea1e312 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "refresh_cache-37d1f284-e5ec-4f47-b819-e8ed8ca793d7" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:32:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-651af871-e3a2-4c8d-a51b-ad52eea1e312 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquired lock "refresh_cache-37d1f284-e5ec-4f47-b819-e8ed8ca793d7" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:32:06 user nova-compute[75745]: DEBUG nova.network.neutron [None req-651af871-e3a2-4c8d-a51b-ad52eea1e312 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:32:06 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:32:06 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:32:06 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:32:06 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:32:06 user nova-compute[75745]: DEBUG nova.network.neutron [None req-651af871-e3a2-4c8d-a51b-ad52eea1e312 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Updating instance_info_cache with network_info: [{"id": "511358d5-fc8c-4824-9f9e-1c7cda2fbb66", "address": "fa:16:3e:89:52:37", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511358d5-fc", "ovs_interfaceid": "511358d5-fc8c-4824-9f9e-1c7cda2fbb66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:32:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-651af871-e3a2-4c8d-a51b-ad52eea1e312 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Releasing lock "refresh_cache-37d1f284-e5ec-4f47-b819-e8ed8ca793d7" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:32:06 user nova-compute[75745]: DEBUG nova.compute.manager [None req-651af871-e3a2-4c8d-a51b-ad52eea1e312 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:32:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-5aee52eb-78e3-4f60-a920-7ade912735e8" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:32:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-5aee52eb-78e3-4f60-a920-7ade912735e8" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:32:06 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:32:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:32:07 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Updating instance_info_cache with network_info: [{"id": "7c69901c-a94e-47f8-8a4a-1654ed728b83", "address": "fa:16:3e:2e:86:ec", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c69901c-a9", "ovs_interfaceid": "7c69901c-a94e-47f8-8a4a-1654ed728b83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:32:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-5aee52eb-78e3-4f60-a920-7ade912735e8" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:32:07 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:32:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:32:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:32:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:32:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:32:09 user nova-compute[75745]: DEBUG nova.compute.manager [req-588343f5-5dbb-477f-844a-3fcc6e814ed3 req-6632dae3-dc01-4059-a52d-2be2e575bb17 service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Received event network-vif-unplugged-511358d5-fc8c-4824-9f9e-1c7cda2fbb66 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:32:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-588343f5-5dbb-477f-844a-3fcc6e814ed3 req-6632dae3-dc01-4059-a52d-2be2e575bb17 service nova] Acquiring lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:32:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-588343f5-5dbb-477f-844a-3fcc6e814ed3 req-6632dae3-dc01-4059-a52d-2be2e575bb17 service nova] Lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:32:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-588343f5-5dbb-477f-844a-3fcc6e814ed3 req-6632dae3-dc01-4059-a52d-2be2e575bb17 service nova] Lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:32:09 user nova-compute[75745]: DEBUG nova.compute.manager [req-588343f5-5dbb-477f-844a-3fcc6e814ed3 req-6632dae3-dc01-4059-a52d-2be2e575bb17 service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] No waiting events found dispatching network-vif-unplugged-511358d5-fc8c-4824-9f9e-1c7cda2fbb66 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:32:09 user nova-compute[75745]: WARNING nova.compute.manager [req-588343f5-5dbb-477f-844a-3fcc6e814ed3 req-6632dae3-dc01-4059-a52d-2be2e575bb17 service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Received unexpected event network-vif-unplugged-511358d5-fc8c-4824-9f9e-1c7cda2fbb66 for instance with vm_state active and task_state reboot_started.
Dec 01 17:32:10 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-651af871-e3a2-4c8d-a51b-ad52eea1e312 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Instance shutdown successfully.
Dec 01 17:32:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:32:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:32:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:32:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:32:11 user nova-compute[75745]: DEBUG nova.compute.manager [req-f145c81a-4e34-4a1b-854d-f9463e096825 req-92550fa3-4869-496f-a2c5-8e472d0b87d7 service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Received event network-vif-plugged-511358d5-fc8c-4824-9f9e-1c7cda2fbb66 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:32:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-f145c81a-4e34-4a1b-854d-f9463e096825 req-92550fa3-4869-496f-a2c5-8e472d0b87d7 service nova] Acquiring lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:32:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-f145c81a-4e34-4a1b-854d-f9463e096825 req-92550fa3-4869-496f-a2c5-8e472d0b87d7 service nova] Lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:32:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-f145c81a-4e34-4a1b-854d-f9463e096825 req-92550fa3-4869-496f-a2c5-8e472d0b87d7 service nova] Lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:32:11 user nova-compute[75745]: DEBUG nova.compute.manager [req-f145c81a-4e34-4a1b-854d-f9463e096825 req-92550fa3-4869-496f-a2c5-8e472d0b87d7 service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] No waiting events found dispatching network-vif-plugged-511358d5-fc8c-4824-9f9e-1c7cda2fbb66 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:32:11 user nova-compute[75745]: WARNING nova.compute.manager [req-f145c81a-4e34-4a1b-854d-f9463e096825 req-92550fa3-4869-496f-a2c5-8e472d0b87d7 service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Received unexpected event network-vif-plugged-511358d5-fc8c-4824-9f9e-1c7cda2fbb66 for instance with vm_state active and task_state reboot_started.
Dec 01 17:32:11 user nova-compute[75745]: DEBUG nova.compute.manager [req-f145c81a-4e34-4a1b-854d-f9463e096825 req-92550fa3-4869-496f-a2c5-8e472d0b87d7 service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Received event network-vif-plugged-511358d5-fc8c-4824-9f9e-1c7cda2fbb66 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:32:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-f145c81a-4e34-4a1b-854d-f9463e096825 req-92550fa3-4869-496f-a2c5-8e472d0b87d7 service nova] Acquiring lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:32:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-f145c81a-4e34-4a1b-854d-f9463e096825 req-92550fa3-4869-496f-a2c5-8e472d0b87d7 service nova] Lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:32:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-f145c81a-4e34-4a1b-854d-f9463e096825 req-92550fa3-4869-496f-a2c5-8e472d0b87d7 service nova] Lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:32:11 user nova-compute[75745]: DEBUG nova.compute.manager [req-f145c81a-4e34-4a1b-854d-f9463e096825 req-92550fa3-4869-496f-a2c5-8e472d0b87d7 service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] No waiting events found dispatching network-vif-plugged-511358d5-fc8c-4824-9f9e-1c7cda2fbb66 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:32:11 user nova-compute[75745]: WARNING nova.compute.manager [req-f145c81a-4e34-4a1b-854d-f9463e096825 req-92550fa3-4869-496f-a2c5-8e472d0b87d7 service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Received unexpected event network-vif-plugged-511358d5-fc8c-4824-9f9e-1c7cda2fbb66 for instance with vm_state active and task_state reboot_started.
Dec 01 17:32:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:32:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:32:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:32:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:32:13 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:32:13 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Instance running successfully.
Dec 01 17:32:13 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-651af871-e3a2-4c8d-a51b-ad52eea1e312 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Instance soft rebooted successfully.
Dec 01 17:32:13 user nova-compute[75745]: DEBUG nova.compute.manager [None req-651af871-e3a2-4c8d-a51b-ad52eea1e312 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:32:13 user nova-compute[75745]: DEBUG nova.compute.manager [req-d3d7b90f-05b2-4f49-90f2-8cf62b3d17cb req-4a61e94d-5790-461e-bdf3-07f1604025a0 service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Received event network-vif-plugged-511358d5-fc8c-4824-9f9e-1c7cda2fbb66 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:32:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d3d7b90f-05b2-4f49-90f2-8cf62b3d17cb req-4a61e94d-5790-461e-bdf3-07f1604025a0 service nova] Acquiring lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:32:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d3d7b90f-05b2-4f49-90f2-8cf62b3d17cb req-4a61e94d-5790-461e-bdf3-07f1604025a0 service nova] Lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:32:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d3d7b90f-05b2-4f49-90f2-8cf62b3d17cb req-4a61e94d-5790-461e-bdf3-07f1604025a0 service nova] Lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:32:13 user nova-compute[75745]: DEBUG nova.compute.manager [req-d3d7b90f-05b2-4f49-90f2-8cf62b3d17cb req-4a61e94d-5790-461e-bdf3-07f1604025a0 service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] No waiting events found dispatching network-vif-plugged-511358d5-fc8c-4824-9f9e-1c7cda2fbb66 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:32:13 user nova-compute[75745]: WARNING nova.compute.manager [req-d3d7b90f-05b2-4f49-90f2-8cf62b3d17cb req-4a61e94d-5790-461e-bdf3-07f1604025a0 service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Received unexpected event network-vif-plugged-511358d5-fc8c-4824-9f9e-1c7cda2fbb66 for instance with vm_state active and task_state reboot_started.
Dec 01 17:32:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-651af871-e3a2-4c8d-a51b-ad52eea1e312 tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.684s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:32:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:32:17 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:32:18 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:32:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:32:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:32:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:32:27 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:32:29 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:32:29 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Triggering sync for uuid 5e631ac3-8122-46a3-a54f-2395c0f7cf7c {{(pid=75745) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 17:32:29 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Triggering sync for uuid 5aee52eb-78e3-4f60-a920-7ade912735e8 {{(pid=75745) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 17:32:29 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Triggering sync for uuid 61e0e19b-f926-4524-82c8-833f804c9b72 {{(pid=75745) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 17:32:29 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Triggering sync for uuid d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3 {{(pid=75745) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 17:32:29 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Triggering sync for uuid 37d1f284-e5ec-4f47-b819-e8ed8ca793d7 {{(pid=75745) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 17:32:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "5e631ac3-8122-46a3-a54f-2395c0f7cf7c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:32:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "5e631ac3-8122-46a3-a54f-2395c0f7cf7c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:32:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "5aee52eb-78e3-4f60-a920-7ade912735e8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:32:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "5aee52eb-78e3-4f60-a920-7ade912735e8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:32:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "61e0e19b-f926-4524-82c8-833f804c9b72" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:32:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "61e0e19b-f926-4524-82c8-833f804c9b72" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:32:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:32:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:32:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:32:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:32:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "5aee52eb-78e3-4f60-a920-7ade912735e8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:32:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "5e631ac3-8122-46a3-a54f-2395c0f7cf7c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:32:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:32:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "61e0e19b-f926-4524-82c8-833f804c9b72" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:32:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:32:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:32:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:32:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:32:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:32:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:32:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:32:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:32:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:32:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:32:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:32:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:32:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:32:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:32:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:32:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:32:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:32:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:32:58 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:33:00 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:33:00 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:33:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:33:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:33:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:33:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:33:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:02 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:33:02 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:33:02 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:33:03 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:33:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:33:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:33:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:33:03 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:33:04 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:33:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:33:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:33:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3/disk.rescue --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:33:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:33:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:33:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:33:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:33:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:33:04 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:33:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37d1f284-e5ec-4f47-b819-e8ed8ca793d7/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:33:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37d1f284-e5ec-4f47-b819-e8ed8ca793d7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:33:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37d1f284-e5ec-4f47-b819-e8ed8ca793d7/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:33:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37d1f284-e5ec-4f47-b819-e8ed8ca793d7/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:33:05 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:33:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:33:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:33:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:33:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:33:06 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:33:06 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:33:06 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=8475MB free_disk=24.98343276977539GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:33:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:33:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:33:06 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 5e631ac3-8122-46a3-a54f-2395c0f7cf7c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:33:06 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 5aee52eb-78e3-4f60-a920-7ade912735e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:33:06 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 61e0e19b-f926-4524-82c8-833f804c9b72 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:33:06 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:33:06 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 37d1f284-e5ec-4f47-b819-e8ed8ca793d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:33:06 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:33:06 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:33:06 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Refreshing inventories for resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 01 17:33:06 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Updating ProviderTree inventory for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 01 17:33:06 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Updating inventory in ProviderTree for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 01 17:33:06 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Refreshing aggregate associations for resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9, aggregates: None {{(pid=75745) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 01 17:33:06 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Refreshing trait associations for resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9, traits: COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=75745) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 01 17:33:06 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:33:06 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:33:06 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:33:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.609s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:33:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:33:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:33:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:33:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:33:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:08 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:33:08 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:33:08 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:33:08 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:33:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-61e0e19b-f926-4524-82c8-833f804c9b72" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:33:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-61e0e19b-f926-4524-82c8-833f804c9b72" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:33:08 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:33:09 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Updating instance_info_cache with network_info: [{"id": "7f4c7ce3-3915-4ee1-acea-7a584c6c61b4", "address": "fa:16:3e:7d:a1:da", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4c7ce3-39", "ovs_interfaceid": "7f4c7ce3-3915-4ee1-acea-7a584c6c61b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:33:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-61e0e19b-f926-4524-82c8-833f804c9b72" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:33:09 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:33:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:17 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:17 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:27 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:31 user nova-compute[75745]: INFO nova.compute.manager [None req-1ce39c96-52b9-4aa0-9414-74a2b7637952 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Unrescuing
Dec 01 17:33:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1ce39c96-52b9-4aa0-9414-74a2b7637952 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "refresh_cache-d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:33:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1ce39c96-52b9-4aa0-9414-74a2b7637952 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquired lock "refresh_cache-d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:33:31 user nova-compute[75745]: DEBUG nova.network.neutron [None req-1ce39c96-52b9-4aa0-9414-74a2b7637952 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:33:31 user nova-compute[75745]: DEBUG nova.network.neutron [None req-1ce39c96-52b9-4aa0-9414-74a2b7637952 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Updating instance_info_cache with network_info: [{"id": "a990f44c-7717-43df-978e-beef133804aa", "address": "fa:16:3e:37:53:1d", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa990f44c-77", "ovs_interfaceid": "a990f44c-7717-43df-978e-beef133804aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:33:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1ce39c96-52b9-4aa0-9414-74a2b7637952 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Releasing lock "refresh_cache-d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:33:31 user nova-compute[75745]: DEBUG nova.objects.instance [None req-1ce39c96-52b9-4aa0-9414-74a2b7637952 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lazy-loading 'flavor' on Instance uuid d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:33:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Acquiring lock "3da51c15-816b-40cd-9315-11a48d0f344c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:33:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lock "3da51c15-816b-40cd-9315-11a48d0f344c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:33:32 user nova-compute[75745]: DEBUG nova.compute.manager [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:33:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:32 user nova-compute[75745]: DEBUG nova.compute.manager [req-dc7ac4ce-fe07-4d17-a4c2-cf780bb6e437 req-e2603262-f2c3-4e97-910c-d1dc16ab4873 service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Received event network-vif-unplugged-a990f44c-7717-43df-978e-beef133804aa {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:33:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-dc7ac4ce-fe07-4d17-a4c2-cf780bb6e437 req-e2603262-f2c3-4e97-910c-d1dc16ab4873 service nova] Acquiring lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:33:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-dc7ac4ce-fe07-4d17-a4c2-cf780bb6e437 req-e2603262-f2c3-4e97-910c-d1dc16ab4873 service nova] Lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:33:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-dc7ac4ce-fe07-4d17-a4c2-cf780bb6e437 req-e2603262-f2c3-4e97-910c-d1dc16ab4873 service nova] Lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:33:32 user nova-compute[75745]: DEBUG nova.compute.manager [req-dc7ac4ce-fe07-4d17-a4c2-cf780bb6e437 req-e2603262-f2c3-4e97-910c-d1dc16ab4873 service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] No waiting events found dispatching network-vif-unplugged-a990f44c-7717-43df-978e-beef133804aa {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:33:32 user nova-compute[75745]: WARNING nova.compute.manager [req-dc7ac4ce-fe07-4d17-a4c2-cf780bb6e437 req-e2603262-f2c3-4e97-910c-d1dc16ab4873 service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Received unexpected event network-vif-unplugged-a990f44c-7717-43df-978e-beef133804aa for instance with vm_state rescued and task_state unrescuing.
Dec 01 17:33:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:33:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:33:32 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:33:32 user nova-compute[75745]: INFO nova.compute.claims [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Claim successful on node user
Dec 01 17:33:32 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:33:32 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:33:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.370s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:33:32 user nova-compute[75745]: DEBUG nova.compute.manager [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:33:32 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Instance destroyed successfully.
Dec 01 17:33:32 user nova-compute[75745]: DEBUG nova.compute.manager [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:33:32 user nova-compute[75745]: DEBUG nova.network.neutron [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:33:32 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:33:32 user nova-compute[75745]: DEBUG nova.compute.manager [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:33:32 user nova-compute[75745]: DEBUG nova.policy [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b1debb66002b41749f6e12d5fd9722fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00f4a99c2ae4a5aa9a456c186ea7cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:33:32 user nova-compute[75745]: INFO nova.virt.block_device [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Booting with volume 36817f6c-30a3-4ccb-b262-934a1e29f895 at /dev/vda
Dec 01 17:33:33 user nova-compute[75745]: DEBUG os_brick.utils [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:33:33 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:33:33 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:33:33 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c383f0-8d8b-4715-9c36-746baa2931d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:33:33 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:33:33 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:33:33 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a7240b-6de8-4198-98ec-ff157b9b4763]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:33:33 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:33:33 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:33:33 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6b2682-fa5d-47c9-af8e-2f17b85e7dd3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:33:33 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab7e323-6538-4e37-9f92-ee9e5237cbbd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:33:33 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:33:33 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:33:33 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:33:33 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:33:33 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:33:33 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:33:33 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[874ab857-6053-4afb-bceb-2a460e8d9ca0]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:33:33 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:33:33 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:33:33 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:33:33 user nova-compute[75745]: DEBUG os_brick.utils [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:33:33 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Updating existing volume attachment record: 67aee1ed-803c-459b-b29d-14c5b341e4ba {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:33:33 user nova-compute[75745]: DEBUG nova.network.neutron [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Successfully created port: a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:33:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:34 user nova-compute[75745]: DEBUG nova.network.neutron [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Successfully updated port: a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:33:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Acquiring lock "refresh_cache-3da51c15-816b-40cd-9315-11a48d0f344c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:33:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Acquired lock "refresh_cache-3da51c15-816b-40cd-9315-11a48d0f344c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:33:34 user nova-compute[75745]: DEBUG nova.network.neutron [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:33:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-00fd21f3-da32-44ce-aad8-1a5c630c7521 req-36b21589-e8cb-430a-ae33-a8d3ca606fea service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Received event network-changed-a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:33:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-00fd21f3-da32-44ce-aad8-1a5c630c7521 req-36b21589-e8cb-430a-ae33-a8d3ca606fea service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Refreshing instance network info cache due to event network-changed-a65d94d0-bf0b-4d66-981e-de1b674507a5. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:33:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-00fd21f3-da32-44ce-aad8-1a5c630c7521 req-36b21589-e8cb-430a-ae33-a8d3ca606fea service nova] Acquiring lock "refresh_cache-3da51c15-816b-40cd-9315-11a48d0f344c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:33:34 user nova-compute[75745]: DEBUG nova.network.neutron [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:33:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-a0ed7fe8-a78a-4beb-9f07-de9f1e680ca1 req-6346e1cb-ca0f-46ab-91c8-9f8bc61f4b1f service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Received event network-vif-plugged-a990f44c-7717-43df-978e-beef133804aa {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:33:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a0ed7fe8-a78a-4beb-9f07-de9f1e680ca1 req-6346e1cb-ca0f-46ab-91c8-9f8bc61f4b1f service nova] Acquiring lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:33:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a0ed7fe8-a78a-4beb-9f07-de9f1e680ca1 req-6346e1cb-ca0f-46ab-91c8-9f8bc61f4b1f service nova] Lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:33:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a0ed7fe8-a78a-4beb-9f07-de9f1e680ca1 req-6346e1cb-ca0f-46ab-91c8-9f8bc61f4b1f service nova] Lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:33:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-a0ed7fe8-a78a-4beb-9f07-de9f1e680ca1 req-6346e1cb-ca0f-46ab-91c8-9f8bc61f4b1f service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] No waiting events found dispatching network-vif-plugged-a990f44c-7717-43df-978e-beef133804aa {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:33:34 user nova-compute[75745]: WARNING nova.compute.manager [req-a0ed7fe8-a78a-4beb-9f07-de9f1e680ca1 req-6346e1cb-ca0f-46ab-91c8-9f8bc61f4b1f service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Received unexpected event network-vif-plugged-a990f44c-7717-43df-978e-beef133804aa for instance with vm_state rescued and task_state unrescuing.
Dec 01 17:33:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-a0ed7fe8-a78a-4beb-9f07-de9f1e680ca1 req-6346e1cb-ca0f-46ab-91c8-9f8bc61f4b1f service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Received event network-vif-plugged-a990f44c-7717-43df-978e-beef133804aa {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:33:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a0ed7fe8-a78a-4beb-9f07-de9f1e680ca1 req-6346e1cb-ca0f-46ab-91c8-9f8bc61f4b1f service nova] Acquiring lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:33:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a0ed7fe8-a78a-4beb-9f07-de9f1e680ca1 req-6346e1cb-ca0f-46ab-91c8-9f8bc61f4b1f service nova] Lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:33:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a0ed7fe8-a78a-4beb-9f07-de9f1e680ca1 req-6346e1cb-ca0f-46ab-91c8-9f8bc61f4b1f service nova] Lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:33:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-a0ed7fe8-a78a-4beb-9f07-de9f1e680ca1 req-6346e1cb-ca0f-46ab-91c8-9f8bc61f4b1f service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] No waiting events found dispatching network-vif-plugged-a990f44c-7717-43df-978e-beef133804aa {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:33:34 user nova-compute[75745]: WARNING nova.compute.manager [req-a0ed7fe8-a78a-4beb-9f07-de9f1e680ca1 req-6346e1cb-ca0f-46ab-91c8-9f8bc61f4b1f service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Received unexpected event network-vif-plugged-a990f44c-7717-43df-978e-beef133804aa for instance with vm_state rescued and task_state unrescuing.
Dec 01 17:33:34 user nova-compute[75745]: DEBUG nova.network.neutron [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Updating instance_info_cache with network_info: [{"id": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "address": "fa:16:3e:17:60:43", "network": {"id": "a3a76c7a-2282-4faa-ae5e-0caddf88001d", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146905868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e00f4a99c2ae4a5aa9a456c186ea7cc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65d94d0-bf", "ovs_interfaceid": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:33:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Releasing lock "refresh_cache-3da51c15-816b-40cd-9315-11a48d0f344c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:33:34 user nova-compute[75745]: DEBUG nova.compute.manager [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Instance network_info: |[{"id": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "address": "fa:16:3e:17:60:43", "network": {"id": "a3a76c7a-2282-4faa-ae5e-0caddf88001d", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146905868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e00f4a99c2ae4a5aa9a456c186ea7cc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65d94d0-bf", "ovs_interfaceid": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:33:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-00fd21f3-da32-44ce-aad8-1a5c630c7521 req-36b21589-e8cb-430a-ae33-a8d3ca606fea service nova] Acquired lock "refresh_cache-3da51c15-816b-40cd-9315-11a48d0f344c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:33:34 user nova-compute[75745]: DEBUG nova.network.neutron [req-00fd21f3-da32-44ce-aad8-1a5c630c7521 req-36b21589-e8cb-430a-ae33-a8d3ca606fea service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Refreshing network info cache for port a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:33:35 user nova-compute[75745]: DEBUG nova.network.neutron [req-00fd21f3-da32-44ce-aad8-1a5c630c7521 req-36b21589-e8cb-430a-ae33-a8d3ca606fea service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Updated VIF entry in instance network info cache for port a65d94d0-bf0b-4d66-981e-de1b674507a5. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:33:35 user nova-compute[75745]: DEBUG nova.network.neutron [req-00fd21f3-da32-44ce-aad8-1a5c630c7521 req-36b21589-e8cb-430a-ae33-a8d3ca606fea service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Updating instance_info_cache with network_info: [{"id": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "address": "fa:16:3e:17:60:43", "network": {"id": "a3a76c7a-2282-4faa-ae5e-0caddf88001d", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146905868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e00f4a99c2ae4a5aa9a456c186ea7cc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65d94d0-bf", "ovs_interfaceid": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:33:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-00fd21f3-da32-44ce-aad8-1a5c630c7521 req-36b21589-e8cb-430a-ae33-a8d3ca606fea service nova] Releasing lock "refresh_cache-3da51c15-816b-40cd-9315-11a48d0f344c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:33:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:36 user nova-compute[75745]: DEBUG nova.compute.manager [None req-1ce39c96-52b9-4aa0-9414-74a2b7637952 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:33:36 user nova-compute[75745]: DEBUG nova.compute.manager [req-92ed0832-d094-46d2-94c7-ddd4289af514 req-1bebea64-d937-43e9-813c-c3a8196d1d7e service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Received event network-vif-plugged-a990f44c-7717-43df-978e-beef133804aa {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:33:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-92ed0832-d094-46d2-94c7-ddd4289af514 req-1bebea64-d937-43e9-813c-c3a8196d1d7e service nova] Acquiring lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:33:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-92ed0832-d094-46d2-94c7-ddd4289af514 req-1bebea64-d937-43e9-813c-c3a8196d1d7e service nova] Lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:33:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-92ed0832-d094-46d2-94c7-ddd4289af514 req-1bebea64-d937-43e9-813c-c3a8196d1d7e service nova] Lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:33:36 user nova-compute[75745]: DEBUG nova.compute.manager [req-92ed0832-d094-46d2-94c7-ddd4289af514 req-1bebea64-d937-43e9-813c-c3a8196d1d7e service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] No waiting events found dispatching network-vif-plugged-a990f44c-7717-43df-978e-beef133804aa {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:33:36 user nova-compute[75745]: WARNING nova.compute.manager [req-92ed0832-d094-46d2-94c7-ddd4289af514 req-1bebea64-d937-43e9-813c-c3a8196d1d7e service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Received unexpected event network-vif-plugged-a990f44c-7717-43df-978e-beef133804aa for instance with vm_state active and task_state None.
Dec 01 17:33:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:42 user nova-compute[75745]: DEBUG nova.compute.manager [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:33:42 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:33:42 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Creating image(s)
Dec 01 17:33:42 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Did not create local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 17:33:42 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Ensure instance console log exists: /opt/stack/data/nova/instances/3da51c15-816b-40cd-9315-11a48d0f344c/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:33:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:33:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:33:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:33:42 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Start _get_guest_xml network_info=[{"id": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "address": "fa:16:3e:17:60:43", "network": {"id": "a3a76c7a-2282-4faa-ae5e-0caddf88001d", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146905868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e00f4a99c2ae4a5aa9a456c186ea7cc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65d94d0-bf", "ovs_interfaceid": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': '67aee1ed-803c-459b-b29d-14c5b341e4ba', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NAyzDFru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3da51c15-816b-40cd-9315-11a48d0f344c', 'attached_at': '', 'detached_at': '', 'volume_id': '36817f6c-30a3-4ccb-b262-934a1e29f895', 'serial': '36817f6c-30a3-4ccb-b262-934a1e29f895'}, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:33:42 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:33:42 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:33:42 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:33:42 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:33:42 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:33:42 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:33:42 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:33:42 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:33:42 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:33:42 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:33:42 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:33:42 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:33:42 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:33:42 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:33:42 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:33:42 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:33:42 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:33:42 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:33:42 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:33:42 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NAyzDFru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:33:42 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:33:42 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:33:42 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:33:42 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:33:42 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:33:42 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:33:42 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:33:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c50d50c-b9e1-4033-89c3-eac6cd16717a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:33:43 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b1f457-33d7-465e-890e-76962968c103]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895] added
Dec 01 17:33:43 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b57146f-8962-4f4c-a0e1-5565e3b9f59b]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[709ee6a5-6dde-4a8e-bafd-2fe4a4bb6f3b]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NAyzDFru {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NAyzDFru" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[20022eef-4302-40bc-9b33-0d6b966e35cc]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NAyzDFru'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[77975360-a82e-412e-88ba-1686691a45c3]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[95143379-52a1-4533-8176-bd36b67b248f]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:33:43 user nova-compute[75745]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a (non-flash)
Dec 01 17:33:43 user nova-compute[75745]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50 (non-flash)
Dec 01 17:33:43 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:33:43 user nova-compute[75745]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a (non-flash)
Dec 01 17:33:43 user nova-compute[75745]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50 (non-flash)
Dec 01 17:33:43 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[947d30f0-49b9-469d-bad2-f0f73090e7c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895, portal: 172.16.0.220,3260]
Dec 01 17:33:43 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895, portal: 172.16.0.220,3260] successful.
Dec 01 17:33:43 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12b2b40-770b-460b-8a3b-bb33a42b5ff1]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2261de-5a41-404c-abaa-43db98981c75]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:33:43 user nova-compute[75745]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a (non-flash)
Dec 01 17:33:43 user nova-compute[75745]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50 (non-flash)
Dec 01 17:33:43 user nova-compute[75745]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 (non-flash)
Dec 01 17:33:43 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:33:43 user nova-compute[75745]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a (non-flash)
Dec 01 17:33:43 user nova-compute[75745]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50 (non-flash)
Dec 01 17:33:43 user nova-compute[75745]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 (non-flash)
Dec 01 17:33:43 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] HCTL ('36', '-', '-', 0) found on session 48 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c89b495-a1c0-4486-9e28-7af62cf238e4]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Searching for a device in session 48 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:33:43 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NAyzDFru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:33:44 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:33:44 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23039666466323362', 'path': '/dev/sde'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:33:44 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039666466323362', 'path': '/dev/sde'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:33:44 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:33:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2147236562',display_name='tempest-TestShelveInstance-server-2147236562',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2147236562',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0QLStMb44bOFyJh0Y7JMYnF245PrcTUhwJpczrTbimJc0K8uFLubP1uApKJ+yeuI5wm4aypb+b+Oyww0GNq5rEPIBSe4cmRHCIgIkKkNlqQCQ01utvvYTYd+Z8+6cExw==',key_name='tempest-TestShelveInstance-1392571257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e00f4a99c2ae4a5aa9a456c186ea7cc8',ramdisk_id='',reservation_id='r-ydabfpsw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1224578669',owner_user_name='tempest-TestShelveInstance-1224578669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:33:33Z,user_data=None,user_id='b1debb66002b41749f6e12d5fd9722fc',uuid=3da51c15-816b-40cd-9315-11a48d0f344c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "address": "fa:16:3e:17:60:43", "network": {"id": "a3a76c7a-2282-4faa-ae5e-0caddf88001d", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146905868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e00f4a99c2ae4a5aa9a456c186ea7cc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65d94d0-bf", "ovs_interfaceid": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:33:44 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Converting VIF {"id": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "address": "fa:16:3e:17:60:43", "network": {"id": "a3a76c7a-2282-4faa-ae5e-0caddf88001d", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146905868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e00f4a99c2ae4a5aa9a456c186ea7cc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65d94d0-bf", "ovs_interfaceid": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:33:44 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:60:43,bridge_name='br-int',has_traffic_filtering=True,id=a65d94d0-bf0b-4d66-981e-de1b674507a5,network=Network(a3a76c7a-2282-4faa-ae5e-0caddf88001d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65d94d0-bf') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:33:44 user nova-compute[75745]: DEBUG nova.objects.instance [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lazy-loading 'pci_devices' on Instance uuid 3da51c15-816b-40cd-9315-11a48d0f344c {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:33:44 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:33:44 user nova-compute[75745]:   <uuid>3da51c15-816b-40cd-9315-11a48d0f344c</uuid>
Dec 01 17:33:44 user nova-compute[75745]:   <name>instance-0000002a</name>
Dec 01 17:33:44 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:33:44 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:33:44 user nova-compute[75745]:   <metadata>
Dec 01 17:33:44 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:33:44 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:33:44 user nova-compute[75745]:       <nova:name>tempest-TestShelveInstance-server-2147236562</nova:name>
Dec 01 17:33:44 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:33:42</nova:creationTime>
Dec 01 17:33:44 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:33:44 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:33:44 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:33:44 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:33:44 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:33:44 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:33:44 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:33:44 user nova-compute[75745]:       <nova:owner>
Dec 01 17:33:44 user nova-compute[75745]:         <nova:user uuid="b1debb66002b41749f6e12d5fd9722fc">tempest-TestShelveInstance-1224578669-project-member</nova:user>
Dec 01 17:33:44 user nova-compute[75745]:         <nova:project uuid="e00f4a99c2ae4a5aa9a456c186ea7cc8">tempest-TestShelveInstance-1224578669</nova:project>
Dec 01 17:33:44 user nova-compute[75745]:       </nova:owner>
Dec 01 17:33:44 user nova-compute[75745]:       <nova:ports>
Dec 01 17:33:44 user nova-compute[75745]:         <nova:port uuid="a65d94d0-bf0b-4d66-981e-de1b674507a5">
Dec 01 17:33:44 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 01 17:33:44 user nova-compute[75745]:         </nova:port>
Dec 01 17:33:44 user nova-compute[75745]:       </nova:ports>
Dec 01 17:33:44 user nova-compute[75745]:     </nova:instance>
Dec 01 17:33:44 user nova-compute[75745]:   </metadata>
Dec 01 17:33:44 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:33:44 user nova-compute[75745]:     <system>
Dec 01 17:33:44 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:33:44 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:33:44 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:33:44 user nova-compute[75745]:       <entry name="serial">3da51c15-816b-40cd-9315-11a48d0f344c</entry>
Dec 01 17:33:44 user nova-compute[75745]:       <entry name="uuid">3da51c15-816b-40cd-9315-11a48d0f344c</entry>
Dec 01 17:33:44 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:33:44 user nova-compute[75745]:     </system>
Dec 01 17:33:44 user nova-compute[75745]:   </sysinfo>
Dec 01 17:33:44 user nova-compute[75745]:   <os>
Dec 01 17:33:44 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:33:44 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:33:44 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:33:44 user nova-compute[75745]:   </os>
Dec 01 17:33:44 user nova-compute[75745]:   <features>
Dec 01 17:33:44 user nova-compute[75745]:     <acpi/>
Dec 01 17:33:44 user nova-compute[75745]:     <apic/>
Dec 01 17:33:44 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:33:44 user nova-compute[75745]:   </features>
Dec 01 17:33:44 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:33:44 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:33:44 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:33:44 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:33:44 user nova-compute[75745]:   </clock>
Dec 01 17:33:44 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:33:44 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:33:44 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:33:44 user nova-compute[75745]:   </cpu>
Dec 01 17:33:44 user nova-compute[75745]:   <devices>
Dec 01 17:33:44 user nova-compute[75745]:     <disk type="block" device="disk">
Dec 01 17:33:44 user nova-compute[75745]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:33:44 user nova-compute[75745]:       <source dev="/dev/sde"/>
Dec 01 17:33:44 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:33:44 user nova-compute[75745]:       <serial>36817f6c-30a3-4ccb-b262-934a1e29f895</serial>
Dec 01 17:33:44 user nova-compute[75745]:     </disk>
Dec 01 17:33:44 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:33:44 user nova-compute[75745]:       <mac address="fa:16:3e:17:60:43"/>
Dec 01 17:33:44 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:33:44 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:33:44 user nova-compute[75745]:       <target dev="tapa65d94d0-bf"/>
Dec 01 17:33:44 user nova-compute[75745]:     </interface>
Dec 01 17:33:44 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:33:44 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/3da51c15-816b-40cd-9315-11a48d0f344c/console.log" append="off"/>
Dec 01 17:33:44 user nova-compute[75745]:     </serial>
Dec 01 17:33:44 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:33:44 user nova-compute[75745]:     <video>
Dec 01 17:33:44 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:33:44 user nova-compute[75745]:     </video>
Dec 01 17:33:44 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:33:44 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:33:44 user nova-compute[75745]:     </rng>
Dec 01 17:33:44 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:33:44 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:33:44 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:33:44 user nova-compute[75745]:     </memballoon>
Dec 01 17:33:44 user nova-compute[75745]:   </devices>
Dec 01 17:33:44 user nova-compute[75745]: </domain>
Dec 01 17:33:44 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:33:44 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:33:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2147236562',display_name='tempest-TestShelveInstance-server-2147236562',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2147236562',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0QLStMb44bOFyJh0Y7JMYnF245PrcTUhwJpczrTbimJc0K8uFLubP1uApKJ+yeuI5wm4aypb+b+Oyww0GNq5rEPIBSe4cmRHCIgIkKkNlqQCQ01utvvYTYd+Z8+6cExw==',key_name='tempest-TestShelveInstance-1392571257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e00f4a99c2ae4a5aa9a456c186ea7cc8',ramdisk_id='',reservation_id='r-ydabfpsw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1224578669',owner_user_name='tempest-TestShelveInstance-1224578669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:33:33Z,user_data=None,user_id='b1debb66002b41749f6e12d5fd9722fc',uuid=3da51c15-816b-40cd-9315-11a48d0f344c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "address": "fa:16:3e:17:60:43", "network": {"id": "a3a76c7a-2282-4faa-ae5e-0caddf88001d", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146905868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e00f4a99c2ae4a5aa9a456c186ea7cc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65d94d0-bf", "ovs_interfaceid": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:33:44 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Converting VIF {"id": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "address": "fa:16:3e:17:60:43", "network": {"id": "a3a76c7a-2282-4faa-ae5e-0caddf88001d", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146905868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e00f4a99c2ae4a5aa9a456c186ea7cc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65d94d0-bf", "ovs_interfaceid": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:33:44 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:60:43,bridge_name='br-int',has_traffic_filtering=True,id=a65d94d0-bf0b-4d66-981e-de1b674507a5,network=Network(a3a76c7a-2282-4faa-ae5e-0caddf88001d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65d94d0-bf') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:33:44 user nova-compute[75745]: DEBUG os_vif [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:60:43,bridge_name='br-int',has_traffic_filtering=True,id=a65d94d0-bf0b-4d66-981e-de1b674507a5,network=Network(a3a76c7a-2282-4faa-ae5e-0caddf88001d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65d94d0-bf') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:33:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:33:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:33:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e961dfad-046e-549c-97c0-f262d0d13ccd', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:33:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:33:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa65d94d0-bf, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:33:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa65d94d0-bf, col_values=(('qos', UUID('d8b2c94b-1086-4563-8f84-e8f9b1cf4de9')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:33:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa65d94d0-bf, col_values=(('external_ids', {'iface-id': 'a65d94d0-bf0b-4d66-981e-de1b674507a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:60:43', 'vm-uuid': '3da51c15-816b-40cd-9315-11a48d0f344c'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:33:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:33:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:44 user nova-compute[75745]: INFO os_vif [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:60:43,bridge_name='br-int',has_traffic_filtering=True,id=a65d94d0-bf0b-4d66-981e-de1b674507a5,network=Network(a3a76c7a-2282-4faa-ae5e-0caddf88001d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65d94d0-bf')
Dec 01 17:33:44 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:33:44 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] No VIF found with MAC fa:16:3e:17:60:43, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:33:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:46 user nova-compute[75745]: DEBUG nova.compute.manager [req-7d7e04a6-d8f4-4a95-b482-fdb58410d93b req-1565d9f1-518a-45b3-b34c-e14e2fe21c8c service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Received event network-vif-plugged-a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:33:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7d7e04a6-d8f4-4a95-b482-fdb58410d93b req-1565d9f1-518a-45b3-b34c-e14e2fe21c8c service nova] Acquiring lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:33:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7d7e04a6-d8f4-4a95-b482-fdb58410d93b req-1565d9f1-518a-45b3-b34c-e14e2fe21c8c service nova] Lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:33:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7d7e04a6-d8f4-4a95-b482-fdb58410d93b req-1565d9f1-518a-45b3-b34c-e14e2fe21c8c service nova] Lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:33:46 user nova-compute[75745]: DEBUG nova.compute.manager [req-7d7e04a6-d8f4-4a95-b482-fdb58410d93b req-1565d9f1-518a-45b3-b34c-e14e2fe21c8c service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] No waiting events found dispatching network-vif-plugged-a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:33:46 user nova-compute[75745]: WARNING nova.compute.manager [req-7d7e04a6-d8f4-4a95-b482-fdb58410d93b req-1565d9f1-518a-45b3-b34c-e14e2fe21c8c service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Received unexpected event network-vif-plugged-a65d94d0-bf0b-4d66-981e-de1b674507a5 for instance with vm_state building and task_state spawning.
Dec 01 17:33:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:48 user nova-compute[75745]: DEBUG nova.compute.manager [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:33:48 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:33:48 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Instance spawned successfully.
Dec 01 17:33:48 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:33:48 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:33:48 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:33:48 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:33:48 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:33:48 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:33:48 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:33:48 user nova-compute[75745]: INFO nova.compute.manager [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Took 5.64 seconds to spawn the instance on the hypervisor.
Dec 01 17:33:48 user nova-compute[75745]: DEBUG nova.compute.manager [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:33:48 user nova-compute[75745]: INFO nova.compute.manager [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Took 16.23 seconds to build instance.
Dec 01 17:33:48 user nova-compute[75745]: DEBUG nova.compute.manager [req-c300899f-ad02-4f71-ac7e-f40bc5dcf378 req-b941295e-c4f0-4d8c-82d0-51290757212a service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Received event network-vif-plugged-a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:33:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c300899f-ad02-4f71-ac7e-f40bc5dcf378 req-b941295e-c4f0-4d8c-82d0-51290757212a service nova] Acquiring lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:33:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c300899f-ad02-4f71-ac7e-f40bc5dcf378 req-b941295e-c4f0-4d8c-82d0-51290757212a service nova] Lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:33:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c300899f-ad02-4f71-ac7e-f40bc5dcf378 req-b941295e-c4f0-4d8c-82d0-51290757212a service nova] Lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:33:48 user nova-compute[75745]: DEBUG nova.compute.manager [req-c300899f-ad02-4f71-ac7e-f40bc5dcf378 req-b941295e-c4f0-4d8c-82d0-51290757212a service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] No waiting events found dispatching network-vif-plugged-a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:33:48 user nova-compute[75745]: WARNING nova.compute.manager [req-c300899f-ad02-4f71-ac7e-f40bc5dcf378 req-b941295e-c4f0-4d8c-82d0-51290757212a service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Received unexpected event network-vif-plugged-a65d94d0-bf0b-4d66-981e-de1b674507a5 for instance with vm_state active and task_state None.
Dec 01 17:33:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-fcb62959-8a22-4897-8d7a-8424e14786fe tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lock "3da51c15-816b-40cd-9315-11a48d0f344c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.426s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:33:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-da497aaa-57c7-4ad5-809d-55975ac87765 req-6659fe30-f4e8-419b-a950-5cb61292b7a2 service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Received event network-changed-511358d5-fc8c-4824-9f9e-1c7cda2fbb66 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:33:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-da497aaa-57c7-4ad5-809d-55975ac87765 req-6659fe30-f4e8-419b-a950-5cb61292b7a2 service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Refreshing instance network info cache due to event network-changed-511358d5-fc8c-4824-9f9e-1c7cda2fbb66. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:33:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-da497aaa-57c7-4ad5-809d-55975ac87765 req-6659fe30-f4e8-419b-a950-5cb61292b7a2 service nova] Acquiring lock "refresh_cache-37d1f284-e5ec-4f47-b819-e8ed8ca793d7" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:33:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-da497aaa-57c7-4ad5-809d-55975ac87765 req-6659fe30-f4e8-419b-a950-5cb61292b7a2 service nova] Acquired lock "refresh_cache-37d1f284-e5ec-4f47-b819-e8ed8ca793d7" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:33:58 user nova-compute[75745]: DEBUG nova.network.neutron [req-da497aaa-57c7-4ad5-809d-55975ac87765 req-6659fe30-f4e8-419b-a950-5cb61292b7a2 service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Refreshing network info cache for port 511358d5-fc8c-4824-9f9e-1c7cda2fbb66 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:33:58 user nova-compute[75745]: DEBUG nova.network.neutron [req-da497aaa-57c7-4ad5-809d-55975ac87765 req-6659fe30-f4e8-419b-a950-5cb61292b7a2 service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Updated VIF entry in instance network info cache for port 511358d5-fc8c-4824-9f9e-1c7cda2fbb66. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:33:58 user nova-compute[75745]: DEBUG nova.network.neutron [req-da497aaa-57c7-4ad5-809d-55975ac87765 req-6659fe30-f4e8-419b-a950-5cb61292b7a2 service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Updating instance_info_cache with network_info: [{"id": "511358d5-fc8c-4824-9f9e-1c7cda2fbb66", "address": "fa:16:3e:89:52:37", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511358d5-fc", "ovs_interfaceid": "511358d5-fc8c-4824-9f9e-1c7cda2fbb66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:33:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-da497aaa-57c7-4ad5-809d-55975ac87765 req-6659fe30-f4e8-419b-a950-5cb61292b7a2 service nova] Releasing lock "refresh_cache-37d1f284-e5ec-4f47-b819-e8ed8ca793d7" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:33:59 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:33:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:33:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:33:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:33:59 user nova-compute[75745]: INFO nova.compute.manager [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Detaching volume bcd1f49e-a684-4c68-a762-5475fb913b50
Dec 01 17:33:59 user nova-compute[75745]: INFO nova.virt.block_device [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Attempting to driver detach volume bcd1f49e-a684-4c68-a762-5475fb913b50 from mountpoint /dev/vdb
Dec 01 17:33:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Attempting to detach device vdb from instance 37d1f284-e5ec-4f47-b819-e8ed8ca793d7 from the persistent domain config. {{(pid=75745) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 17:33:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:33:59 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:33:59 user nova-compute[75745]:   <source dev="/dev/sdd"/>
Dec 01 17:33:59 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:33:59 user nova-compute[75745]:   <serial>bcd1f49e-a684-4c68-a762-5475fb913b50</serial>
Dec 01 17:33:59 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 17:33:59 user nova-compute[75745]: </disk>
Dec 01 17:33:59 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:33:59 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Successfully detached device vdb from instance 37d1f284-e5ec-4f47-b819-e8ed8ca793d7 from the persistent domain config.
Dec 01 17:33:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 37d1f284-e5ec-4f47-b819-e8ed8ca793d7 from the live domain config. {{(pid=75745) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 17:33:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:33:59 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:33:59 user nova-compute[75745]:   <source dev="/dev/sdd"/>
Dec 01 17:33:59 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:33:59 user nova-compute[75745]:   <serial>bcd1f49e-a684-4c68-a762-5475fb913b50</serial>
Dec 01 17:33:59 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 17:33:59 user nova-compute[75745]: </disk>
Dec 01 17:33:59 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:34:00 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 37d1f284-e5ec-4f47-b819-e8ed8ca793d7 {{(pid=75745) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 17:34:00 user nova-compute[75745]: DEBUG nova.compute.manager [req-11edb30e-a498-4205-ae9d-383c9bae5382 req-6bfccae8-355a-4e30-a09c-57abbe49f86e service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Received event network-changed-511358d5-fc8c-4824-9f9e-1c7cda2fbb66 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:34:00 user nova-compute[75745]: DEBUG nova.compute.manager [req-11edb30e-a498-4205-ae9d-383c9bae5382 req-6bfccae8-355a-4e30-a09c-57abbe49f86e service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Refreshing instance network info cache due to event network-changed-511358d5-fc8c-4824-9f9e-1c7cda2fbb66. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:34:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-11edb30e-a498-4205-ae9d-383c9bae5382 req-6bfccae8-355a-4e30-a09c-57abbe49f86e service nova] Acquiring lock "refresh_cache-37d1f284-e5ec-4f47-b819-e8ed8ca793d7" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:34:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-11edb30e-a498-4205-ae9d-383c9bae5382 req-6bfccae8-355a-4e30-a09c-57abbe49f86e service nova] Acquired lock "refresh_cache-37d1f284-e5ec-4f47-b819-e8ed8ca793d7" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:34:00 user nova-compute[75745]: DEBUG nova.network.neutron [req-11edb30e-a498-4205-ae9d-383c9bae5382 req-6bfccae8-355a-4e30-a09c-57abbe49f86e service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Refreshing network info cache for port 511358d5-fc8c-4824-9f9e-1c7cda2fbb66 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:34:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:34:00 user nova-compute[75745]: DEBUG nova.network.neutron [req-11edb30e-a498-4205-ae9d-383c9bae5382 req-6bfccae8-355a-4e30-a09c-57abbe49f86e service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Updated VIF entry in instance network info cache for port 511358d5-fc8c-4824-9f9e-1c7cda2fbb66. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:34:00 user nova-compute[75745]: DEBUG nova.network.neutron [req-11edb30e-a498-4205-ae9d-383c9bae5382 req-6bfccae8-355a-4e30-a09c-57abbe49f86e service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Updating instance_info_cache with network_info: [{"id": "511358d5-fc8c-4824-9f9e-1c7cda2fbb66", "address": "fa:16:3e:89:52:37", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511358d5-fc", "ovs_interfaceid": "511358d5-fc8c-4824-9f9e-1c7cda2fbb66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:34:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-11edb30e-a498-4205-ae9d-383c9bae5382 req-6bfccae8-355a-4e30-a09c-57abbe49f86e service nova] Releasing lock "refresh_cache-37d1f284-e5ec-4f47-b819-e8ed8ca793d7" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:34:00 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:34:01 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:34:02 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:34:02 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:34:03 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:34:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:34:04 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:34:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:34:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:34:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:34:04 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:34:05 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:34:05 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:34:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:34:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:34:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:34:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:34:05 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:34:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37d1f284-e5ec-4f47-b819-e8ed8ca793d7/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:34:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:34:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37d1f284-e5ec-4f47-b819-e8ed8ca793d7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:34:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37d1f284-e5ec-4f47-b819-e8ed8ca793d7/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:34:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37d1f284-e5ec-4f47-b819-e8ed8ca793d7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:34:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:34:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:34:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:34:06 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:34:06 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:34:06 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:34:06 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=8291MB free_disk=24.97092056274414GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:34:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:34:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:34:06 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 5e631ac3-8122-46a3-a54f-2395c0f7cf7c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:34:06 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 5aee52eb-78e3-4f60-a920-7ade912735e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:34:06 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 61e0e19b-f926-4524-82c8-833f804c9b72 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:34:06 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:34:06 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 37d1f284-e5ec-4f47-b819-e8ed8ca793d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:34:06 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 3da51c15-816b-40cd-9315-11a48d0f344c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:34:06 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:34:06 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:34:06 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:34:06 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:34:06 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:34:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.361s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:34:07 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:34:07 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:34:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:34:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:34:10 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:34:10 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:34:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:34:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:34:10 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:34:11 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Updating instance_info_cache with network_info: [{"id": "a990f44c-7717-43df-978e-beef133804aa", "address": "fa:16:3e:37:53:1d", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa990f44c-77", "ovs_interfaceid": "a990f44c-7717-43df-978e-beef133804aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:34:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:34:11 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:34:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:34:15 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:34:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:34:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:34:20 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 37d1f284-e5ec-4f47-b819-e8ed8ca793d7 is timed out.
Dec 01 17:34:20 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Successfully detached device vdb from instance 37d1f284-e5ec-4f47-b819-e8ed8ca793d7 from the live domain config.
Dec 01 17:34:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uqQykrKi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:34:20 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:34:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3206a06-fb02-46a0-842f-eb556c0df837]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:34:20 user nova-compute[75745]: No targets found.
Dec 01 17:34:20 user nova-compute[75745]: iSNS:
Dec 01 17:34:20 user nova-compute[75745]: No targets found.
Dec 01 17:34:20 user nova-compute[75745]: STATIC:
Dec 01 17:34:20 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0
Dec 01 17:34:20 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:34:20 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:34:20 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a
Dec 01 17:34:20 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:34:20 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:34:20 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895
Dec 01 17:34:20 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:34:20 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:34:20 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50
Dec 01 17:34:20 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:34:20 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:34:20 user nova-compute[75745]: FIRMWARE:
Dec 01 17:34:20 user nova-compute[75745]: No targets found.
Dec 01 17:34:20 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:34:20 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:34:20 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21f4ca2-2aad-44b8-8037-cf81dff3fd77]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e87031-785c-4167-831f-f63e8703521e]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:34:20 user nova-compute[75745]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a (non-flash)
Dec 01 17:34:20 user nova-compute[75745]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50 (non-flash)
Dec 01 17:34:20 user nova-compute[75745]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 (non-flash)
Dec 01 17:34:20 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:34:20 user nova-compute[75745]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a (non-flash)
Dec 01 17:34:20 user nova-compute[75745]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50 (non-flash)
Dec 01 17:34:20 user nova-compute[75745]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 (non-flash)
Dec 01 17:34:20 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b81d8c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50'): ({'sdd'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Removing single pathed devices sdd {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9459fb-b3e1-44a0-b656-d4ce47cd717d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[41aa77ac-1882-49fc-8db1-17095705656b]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Flushing IO for device /dev/sdd {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3042c2a-7d39-4125-92a6-0a9f5c8363ed]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.032s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c2781c-969e-4a7e-8e80-a3a36bd94508]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] SCSI volumes sdd have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7462cea0-5d66-4325-930d-235d44e46cfb]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18fb5c3-1d42-443d-9820-90f933b34102]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50, portal: 172.16.0.220,3260]
Dec 01 17:34:20 user nova-compute[75745]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50, portal: 172.16.0.220,3260] successful.
Dec 01 17:34:20 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd1f49e-a684-4c68-a762-5475fb913b50 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b61737-a088-4a13-a2ba-5ec238e30fb1]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] <== disconnect_volume: return (296ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:34:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:34:21 user nova-compute[75745]: DEBUG nova.objects.instance [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lazy-loading 'flavor' on Instance uuid 37d1f284-e5ec-4f47-b819-e8ed8ca793d7 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:34:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-5725a9b6-a505-4085-914f-fea305b0140f tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.873s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:34:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:34:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:34:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:34:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:34:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:34:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:34:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:34:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:34:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:34:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:34:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:34:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-eb2d912c-1d24-42a4-9e94-25b56edac80e tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:34:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-eb2d912c-1d24-42a4-9e94-25b56edac80e tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:34:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-eb2d912c-1d24-42a4-9e94-25b56edac80e tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:34:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-eb2d912c-1d24-42a4-9e94-25b56edac80e tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:34:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-eb2d912c-1d24-42a4-9e94-25b56edac80e tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:34:54 user nova-compute[75745]: INFO nova.compute.manager [None req-eb2d912c-1d24-42a4-9e94-25b56edac80e tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Terminating instance
Dec 01 17:34:54 user nova-compute[75745]: DEBUG nova.compute.manager [None req-eb2d912c-1d24-42a4-9e94-25b56edac80e tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:34:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:34:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:34:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:34:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:34:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:34:54 user nova-compute[75745]: DEBUG nova.compute.manager [req-dae2919d-8de3-4da5-9579-81685fe7c210 req-fe832775-1961-4ccb-aa60-018269fb886c service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Received event network-vif-unplugged-511358d5-fc8c-4824-9f9e-1c7cda2fbb66 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:34:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-dae2919d-8de3-4da5-9579-81685fe7c210 req-fe832775-1961-4ccb-aa60-018269fb886c service nova] Acquiring lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:34:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-dae2919d-8de3-4da5-9579-81685fe7c210 req-fe832775-1961-4ccb-aa60-018269fb886c service nova] Lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:34:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-dae2919d-8de3-4da5-9579-81685fe7c210 req-fe832775-1961-4ccb-aa60-018269fb886c service nova] Lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:34:54 user nova-compute[75745]: DEBUG nova.compute.manager [req-dae2919d-8de3-4da5-9579-81685fe7c210 req-fe832775-1961-4ccb-aa60-018269fb886c service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] No waiting events found dispatching network-vif-unplugged-511358d5-fc8c-4824-9f9e-1c7cda2fbb66 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:34:54 user nova-compute[75745]: DEBUG nova.compute.manager [req-dae2919d-8de3-4da5-9579-81685fe7c210 req-fe832775-1961-4ccb-aa60-018269fb886c service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Received event network-vif-unplugged-511358d5-fc8c-4824-9f9e-1c7cda2fbb66 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:34:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:34:55 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Instance destroyed successfully.
Dec 01 17:34:55 user nova-compute[75745]: DEBUG nova.objects.instance [None req-eb2d912c-1d24-42a4-9e94-25b56edac80e tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lazy-loading 'resources' on Instance uuid 37d1f284-e5ec-4f47-b819-e8ed8ca793d7 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:34:55 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-eb2d912c-1d24-42a4-9e94-25b56edac80e tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:29:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2116842336',display_name='tempest-TestMinimumBasicScenario-server-2116842336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2116842336',id=41,image_ref='affe1df3-19c1-458a-9ea6-a248b53c0c02',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYI9OAeaPOMbOyq2tDbp4piZfifdWO4vL2uVJa61KkZCE4V1M1c/pCraShGJLc0bUEbxaGHc+vGZgIA0wGJjwv2ttR3ywRee1Bp1AAIAY5cAMO7QZfuaoRjdvqxLdqn5w==',key_name='tempest-TestMinimumBasicScenario-132590777',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:30:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c3088641ea74a31a80ade2623f85d91',ramdisk_id='',reservation_id='r-7funols1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='affe1df3-19c1-458a-9ea6-a248b53c0c02',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-865236074',owner_user_name='tempest-TestMinimumBasicScenario-865236074-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:32:14Z,user_data=None,user_id='f75082346bbd4b2ebfc585a25a897f81',uuid=37d1f284-e5ec-4f47-b819-e8ed8ca793d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "511358d5-fc8c-4824-9f9e-1c7cda2fbb66", "address": "fa:16:3e:89:52:37", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511358d5-fc", "ovs_interfaceid": "511358d5-fc8c-4824-9f9e-1c7cda2fbb66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:34:55 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-eb2d912c-1d24-42a4-9e94-25b56edac80e tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Converting VIF {"id": "511358d5-fc8c-4824-9f9e-1c7cda2fbb66", "address": "fa:16:3e:89:52:37", "network": {"id": "bfcf7108-b710-4459-bcd7-fbfd464ee6a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-109117430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3088641ea74a31a80ade2623f85d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511358d5-fc", "ovs_interfaceid": "511358d5-fc8c-4824-9f9e-1c7cda2fbb66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:34:55 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-eb2d912c-1d24-42a4-9e94-25b56edac80e tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:52:37,bridge_name='br-int',has_traffic_filtering=True,id=511358d5-fc8c-4824-9f9e-1c7cda2fbb66,network=Network(bfcf7108-b710-4459-bcd7-fbfd464ee6a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511358d5-fc') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:34:55 user nova-compute[75745]: DEBUG os_vif [None req-eb2d912c-1d24-42a4-9e94-25b56edac80e tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:52:37,bridge_name='br-int',has_traffic_filtering=True,id=511358d5-fc8c-4824-9f9e-1c7cda2fbb66,network=Network(bfcf7108-b710-4459-bcd7-fbfd464ee6a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511358d5-fc') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:34:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:34:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap511358d5-fc, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:34:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:34:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:34:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:34:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2dec405b-feb5-4a5a-b61f-e4e38086d4b3) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:34:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:34:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:34:55 user nova-compute[75745]: INFO os_vif [None req-eb2d912c-1d24-42a4-9e94-25b56edac80e tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:52:37,bridge_name='br-int',has_traffic_filtering=True,id=511358d5-fc8c-4824-9f9e-1c7cda2fbb66,network=Network(bfcf7108-b710-4459-bcd7-fbfd464ee6a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511358d5-fc')
Dec 01 17:34:55 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-eb2d912c-1d24-42a4-9e94-25b56edac80e tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Deleting instance files /opt/stack/data/nova/instances/37d1f284-e5ec-4f47-b819-e8ed8ca793d7_del
Dec 01 17:34:55 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-eb2d912c-1d24-42a4-9e94-25b56edac80e tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Deletion of /opt/stack/data/nova/instances/37d1f284-e5ec-4f47-b819-e8ed8ca793d7_del complete
Dec 01 17:34:55 user nova-compute[75745]: INFO nova.compute.manager [None req-eb2d912c-1d24-42a4-9e94-25b56edac80e tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Took 0.88 seconds to destroy the instance on the hypervisor.
Dec 01 17:34:55 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-eb2d912c-1d24-42a4-9e94-25b56edac80e tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:34:55 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:34:55 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:34:55 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:34:55 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Took 0.58 seconds to deallocate network for instance.
Dec 01 17:34:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-eb2d912c-1d24-42a4-9e94-25b56edac80e tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:34:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-eb2d912c-1d24-42a4-9e94-25b56edac80e tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:34:55 user nova-compute[75745]: DEBUG nova.compute.manager [req-d989b18a-fa9f-4d6e-97ef-3f12a9e3fa27 req-f1bd4515-395e-480a-8970-2f311d296841 service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Received event network-vif-deleted-511358d5-fc8c-4824-9f9e-1c7cda2fbb66 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:34:55 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-eb2d912c-1d24-42a4-9e94-25b56edac80e tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:34:56 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-eb2d912c-1d24-42a4-9e94-25b56edac80e tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:34:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-eb2d912c-1d24-42a4-9e94-25b56edac80e tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:34:56 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-eb2d912c-1d24-42a4-9e94-25b56edac80e tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Deleted allocations for instance 37d1f284-e5ec-4f47-b819-e8ed8ca793d7
Dec 01 17:34:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-eb2d912c-1d24-42a4-9e94-25b56edac80e tempest-TestMinimumBasicScenario-865236074 tempest-TestMinimumBasicScenario-865236074-project-member] Lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.925s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:34:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-8a9897ba-c88f-4093-ac0a-703e4cb734a6 req-ccdd787e-4357-4a95-b0e2-764ad9bc94ac service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Received event network-vif-plugged-511358d5-fc8c-4824-9f9e-1c7cda2fbb66 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:34:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8a9897ba-c88f-4093-ac0a-703e4cb734a6 req-ccdd787e-4357-4a95-b0e2-764ad9bc94ac service nova] Acquiring lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:34:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8a9897ba-c88f-4093-ac0a-703e4cb734a6 req-ccdd787e-4357-4a95-b0e2-764ad9bc94ac service nova] Lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:34:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8a9897ba-c88f-4093-ac0a-703e4cb734a6 req-ccdd787e-4357-4a95-b0e2-764ad9bc94ac service nova] Lock "37d1f284-e5ec-4f47-b819-e8ed8ca793d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:34:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-8a9897ba-c88f-4093-ac0a-703e4cb734a6 req-ccdd787e-4357-4a95-b0e2-764ad9bc94ac service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] No waiting events found dispatching network-vif-plugged-511358d5-fc8c-4824-9f9e-1c7cda2fbb66 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:34:56 user nova-compute[75745]: WARNING nova.compute.manager [req-8a9897ba-c88f-4093-ac0a-703e4cb734a6 req-ccdd787e-4357-4a95-b0e2-764ad9bc94ac service nova] [instance: 37d1f284-e5ec-4f47-b819-e8ed8ca793d7] Received unexpected event network-vif-plugged-511358d5-fc8c-4824-9f9e-1c7cda2fbb66 for instance with vm_state deleted and task_state None.
Dec 01 17:34:58 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:35:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:35:00 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:35:03 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:35:03 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:35:03 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:35:04 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:35:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:35:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:35:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:35:04 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:35:05 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:35:05 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:35:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:35:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:35:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:35:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:35:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:35:05 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:35:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:35:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:35:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:35:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:35:06 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:35:06 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:35:06 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=8503MB free_disk=24.997211456298828GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:35:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:35:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:35:06 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 5e631ac3-8122-46a3-a54f-2395c0f7cf7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:35:06 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 5aee52eb-78e3-4f60-a920-7ade912735e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:35:06 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 61e0e19b-f926-4524-82c8-833f804c9b72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:35:06 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:35:06 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 3da51c15-816b-40cd-9315-11a48d0f344c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:35:06 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:35:06 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:35:06 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:35:06 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:35:06 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:35:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.342s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:35:07 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:35:07 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:35:08 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:35:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:35:11 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:35:11 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:35:11 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Didn't find any instances for network info cache update. {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 17:35:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:35:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:35:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:35:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:35:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:35:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:35:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:35:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:35:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:35:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:35:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:35:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:35:22 user nova-compute[75745]: INFO nova.compute.manager [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Terminating instance
Dec 01 17:35:22 user nova-compute[75745]: DEBUG nova.compute.manager [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:35:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:35:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:35:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:35:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG nova.compute.manager [req-c2336b1e-f4a2-4c3c-84aa-0b11f435f57a req-7c72fd08-48ce-4cff-afcf-8533d41764bd service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Received event network-vif-unplugged-a990f44c-7717-43df-978e-beef133804aa {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c2336b1e-f4a2-4c3c-84aa-0b11f435f57a req-7c72fd08-48ce-4cff-afcf-8533d41764bd service nova] Acquiring lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c2336b1e-f4a2-4c3c-84aa-0b11f435f57a req-7c72fd08-48ce-4cff-afcf-8533d41764bd service nova] Lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c2336b1e-f4a2-4c3c-84aa-0b11f435f57a req-7c72fd08-48ce-4cff-afcf-8533d41764bd service nova] Lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG nova.compute.manager [req-c2336b1e-f4a2-4c3c-84aa-0b11f435f57a req-7c72fd08-48ce-4cff-afcf-8533d41764bd service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] No waiting events found dispatching network-vif-unplugged-a990f44c-7717-43df-978e-beef133804aa {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG nova.compute.manager [req-c2336b1e-f4a2-4c3c-84aa-0b11f435f57a req-7c72fd08-48ce-4cff-afcf-8533d41764bd service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Received event network-vif-unplugged-a990f44c-7717-43df-978e-beef133804aa for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:35:23 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Instance destroyed successfully.
Dec 01 17:35:23 user nova-compute[75745]: DEBUG nova.objects.instance [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lazy-loading 'resources' on Instance uuid d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:29:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-371241425',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-371241425',id=40,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:31:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='adb3ba16695543cab6f10932fd6b2d2d',ramdisk_id='',reservation_id='r-aiu251ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-90723689',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:33:36Z,user_data=None,user_id='b319a47b86c04affa1858e1c2359876b',uuid=d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a990f44c-7717-43df-978e-beef133804aa", "address": "fa:16:3e:37:53:1d", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa990f44c-77", "ovs_interfaceid": "a990f44c-7717-43df-978e-beef133804aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Converting VIF {"id": "a990f44c-7717-43df-978e-beef133804aa", "address": "fa:16:3e:37:53:1d", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa990f44c-77", "ovs_interfaceid": "a990f44c-7717-43df-978e-beef133804aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:53:1d,bridge_name='br-int',has_traffic_filtering=True,id=a990f44c-7717-43df-978e-beef133804aa,network=Network(bf1db63d-d427-41c2-ac82-6fab9483a423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa990f44c-77') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG os_vif [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:53:1d,bridge_name='br-int',has_traffic_filtering=True,id=a990f44c-7717-43df-978e-beef133804aa,network=Network(bf1db63d-d427-41c2-ac82-6fab9483a423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa990f44c-77') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa990f44c-77, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2e09a981-7116-44dc-b717-733ec3bacfaa) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:35:23 user nova-compute[75745]: INFO os_vif [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:53:1d,bridge_name='br-int',has_traffic_filtering=True,id=a990f44c-7717-43df-978e-beef133804aa,network=Network(bf1db63d-d427-41c2-ac82-6fab9483a423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa990f44c-77')
Dec 01 17:35:23 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zcMiHqma', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:35:23 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:35:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eed4fa1-e63d-45aa-bd0f-901cd824488f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:35:23 user nova-compute[75745]: No targets found.
Dec 01 17:35:23 user nova-compute[75745]: iSNS:
Dec 01 17:35:23 user nova-compute[75745]: No targets found.
Dec 01 17:35:23 user nova-compute[75745]: STATIC:
Dec 01 17:35:23 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0
Dec 01 17:35:23 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:35:23 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:35:23 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a
Dec 01 17:35:23 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:35:23 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:35:23 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895
Dec 01 17:35:23 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:35:23 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:35:23 user nova-compute[75745]: FIRMWARE:
Dec 01 17:35:23 user nova-compute[75745]: No targets found.
Dec 01 17:35:23 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:35:23 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:35:23 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbc1584-652a-43da-9a38-f5cb071e48eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f86f2bb-2718-4828-b168-e656c7eb0eee]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:35:23 user nova-compute[75745]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a (non-flash)
Dec 01 17:35:23 user nova-compute[75745]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 (non-flash)
Dec 01 17:35:23 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:35:23 user nova-compute[75745]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a (non-flash)
Dec 01 17:35:23 user nova-compute[75745]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 (non-flash)
Dec 01 17:35:23 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b8502680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a'): ({'sdc'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Removing single pathed devices sdc {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8111a254-2ab7-4393-987e-91350fc25f46]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbb3a3c-a7c2-49b6-8abd-4c37b8b67147]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Flushing IO for device /dev/sdc {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef668493-5063-41da-bd62-53a25e0e4d7e]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e915c4dc-4c83-4b73-8842-950f80ffb945]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] SCSI volumes sdc have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO7574e7de-37b615b2eabec4a3', '/dev/disk/by-id/scsi-23337623631356232', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7574e7de') {{(pid=86714) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 01 17:35:23 user nova-compute[75745]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO7574e7de-37b615b2eabec4a3
Dec 01 17:35:23 user nova-compute[75745]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23337623631356232
Dec 01 17:35:23 user nova-compute[75745]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_7574e7de
Dec 01 17:35:23 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba1384d-61e8-4715-9c22-25ab3ed963c3]: (4, None) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9293b7-1bee-4b57-9fc4-ed2fee371622]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[596d4f90-33ab-40ba-9253-ff192a35b270]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a, portal: 172.16.0.220,3260]
Dec 01 17:35:23 user nova-compute[75745]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a, portal: 172.16.0.220,3260] successful.
Dec 01 17:35:23 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522008c2-67f6-409f-ab67-f7d85f0c7c7a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8f7516-864e-40a0-a7e3-d082622508ca]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] <== disconnect_volume: return (303ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:35:23 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Deleting instance files /opt/stack/data/nova/instances/d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3_del
Dec 01 17:35:23 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Deletion of /opt/stack/data/nova/instances/d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3_del complete
Dec 01 17:35:23 user nova-compute[75745]: INFO nova.compute.manager [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Took 1.39 seconds to destroy the instance on the hypervisor.
Dec 01 17:35:23 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:35:23 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:35:24 user nova-compute[75745]: DEBUG nova.compute.manager [req-e40d7d14-12a2-4672-915a-2afc97b6c934 req-eb8b5f46-d5e8-4691-bc9c-3dff30c9087f service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Received event network-vif-deleted-a990f44c-7717-43df-978e-beef133804aa {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:35:24 user nova-compute[75745]: INFO nova.compute.manager [req-e40d7d14-12a2-4672-915a-2afc97b6c934 req-eb8b5f46-d5e8-4691-bc9c-3dff30c9087f service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Neutron deleted interface a990f44c-7717-43df-978e-beef133804aa; detaching it from the instance and deleting it from the info cache
Dec 01 17:35:24 user nova-compute[75745]: DEBUG nova.network.neutron [req-e40d7d14-12a2-4672-915a-2afc97b6c934 req-eb8b5f46-d5e8-4691-bc9c-3dff30c9087f service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:35:24 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:35:24 user nova-compute[75745]: DEBUG nova.compute.manager [req-e40d7d14-12a2-4672-915a-2afc97b6c934 req-eb8b5f46-d5e8-4691-bc9c-3dff30c9087f service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Detach interface failed, port_id=a990f44c-7717-43df-978e-beef133804aa, reason: Instance d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3 could not be found. {{(pid=75745) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 17:35:24 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Took 0.54 seconds to deallocate network for instance.
Dec 01 17:35:25 user nova-compute[75745]: DEBUG nova.compute.manager [req-28bec06a-b27c-4a68-b03b-d95d66d4b868 req-eca763fd-f3fa-4a10-9ed5-686f8f6d318d service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Received event network-vif-plugged-a990f44c-7717-43df-978e-beef133804aa {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:35:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-28bec06a-b27c-4a68-b03b-d95d66d4b868 req-eca763fd-f3fa-4a10-9ed5-686f8f6d318d service nova] Acquiring lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:35:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-28bec06a-b27c-4a68-b03b-d95d66d4b868 req-eca763fd-f3fa-4a10-9ed5-686f8f6d318d service nova] Lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:35:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-28bec06a-b27c-4a68-b03b-d95d66d4b868 req-eca763fd-f3fa-4a10-9ed5-686f8f6d318d service nova] Lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:35:25 user nova-compute[75745]: DEBUG nova.compute.manager [req-28bec06a-b27c-4a68-b03b-d95d66d4b868 req-eca763fd-f3fa-4a10-9ed5-686f8f6d318d service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] No waiting events found dispatching network-vif-plugged-a990f44c-7717-43df-978e-beef133804aa {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:35:25 user nova-compute[75745]: WARNING nova.compute.manager [req-28bec06a-b27c-4a68-b03b-d95d66d4b868 req-eca763fd-f3fa-4a10-9ed5-686f8f6d318d service nova] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Received unexpected event network-vif-plugged-a990f44c-7717-43df-978e-beef133804aa for instance with vm_state active and task_state deleting.
Dec 01 17:35:25 user nova-compute[75745]: DEBUG nova.compute.manager [req-28bec06a-b27c-4a68-b03b-d95d66d4b868 req-eca763fd-f3fa-4a10-9ed5-686f8f6d318d service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Received event network-changed-a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:35:25 user nova-compute[75745]: DEBUG nova.compute.manager [req-28bec06a-b27c-4a68-b03b-d95d66d4b868 req-eca763fd-f3fa-4a10-9ed5-686f8f6d318d service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Refreshing instance network info cache due to event network-changed-a65d94d0-bf0b-4d66-981e-de1b674507a5. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:35:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-28bec06a-b27c-4a68-b03b-d95d66d4b868 req-eca763fd-f3fa-4a10-9ed5-686f8f6d318d service nova] Acquiring lock "refresh_cache-3da51c15-816b-40cd-9315-11a48d0f344c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:35:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-28bec06a-b27c-4a68-b03b-d95d66d4b868 req-eca763fd-f3fa-4a10-9ed5-686f8f6d318d service nova] Acquired lock "refresh_cache-3da51c15-816b-40cd-9315-11a48d0f344c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:35:25 user nova-compute[75745]: DEBUG nova.network.neutron [req-28bec06a-b27c-4a68-b03b-d95d66d4b868 req-eca763fd-f3fa-4a10-9ed5-686f8f6d318d service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Refreshing network info cache for port a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:35:25 user nova-compute[75745]: INFO nova.compute.manager [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3] Took 0.79 seconds to detach 1 volumes for instance.
Dec 01 17:35:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:35:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:35:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:35:25 user nova-compute[75745]: DEBUG nova.network.neutron [req-28bec06a-b27c-4a68-b03b-d95d66d4b868 req-eca763fd-f3fa-4a10-9ed5-686f8f6d318d service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Updated VIF entry in instance network info cache for port a65d94d0-bf0b-4d66-981e-de1b674507a5. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:35:25 user nova-compute[75745]: DEBUG nova.network.neutron [req-28bec06a-b27c-4a68-b03b-d95d66d4b868 req-eca763fd-f3fa-4a10-9ed5-686f8f6d318d service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Updating instance_info_cache with network_info: [{"id": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "address": "fa:16:3e:17:60:43", "network": {"id": "a3a76c7a-2282-4faa-ae5e-0caddf88001d", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146905868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e00f4a99c2ae4a5aa9a456c186ea7cc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65d94d0-bf", "ovs_interfaceid": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:35:25 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:35:25 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:35:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-28bec06a-b27c-4a68-b03b-d95d66d4b868 req-eca763fd-f3fa-4a10-9ed5-686f8f6d318d service nova] Releasing lock "refresh_cache-3da51c15-816b-40cd-9315-11a48d0f344c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:35:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.250s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:35:25 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Deleted allocations for instance d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3
Dec 01 17:35:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0b8bbf5d-5c56-43ea-9f88-9c1e6c290ec5 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "d5256bf0-54eb-4e09-af0c-d6a9ec0ef2f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.167s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:35:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Acquiring lock "3da51c15-816b-40cd-9315-11a48d0f344c" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:35:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lock "3da51c15-816b-40cd-9315-11a48d0f344c" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:35:26 user nova-compute[75745]: INFO nova.compute.manager [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Shelve offloading
Dec 01 17:35:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:35:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:35:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:35:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:35:26 user nova-compute[75745]: DEBUG nova.compute.manager [req-5ba8b62c-ce4a-4da2-ba65-4721e199afac req-dfb57231-471c-4e48-89f3-2dfc60b2e73c service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Received event network-vif-unplugged-a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:35:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5ba8b62c-ce4a-4da2-ba65-4721e199afac req-dfb57231-471c-4e48-89f3-2dfc60b2e73c service nova] Acquiring lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:35:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5ba8b62c-ce4a-4da2-ba65-4721e199afac req-dfb57231-471c-4e48-89f3-2dfc60b2e73c service nova] Lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:35:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5ba8b62c-ce4a-4da2-ba65-4721e199afac req-dfb57231-471c-4e48-89f3-2dfc60b2e73c service nova] Lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:35:26 user nova-compute[75745]: DEBUG nova.compute.manager [req-5ba8b62c-ce4a-4da2-ba65-4721e199afac req-dfb57231-471c-4e48-89f3-2dfc60b2e73c service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] No waiting events found dispatching network-vif-unplugged-a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:35:26 user nova-compute[75745]: WARNING nova.compute.manager [req-5ba8b62c-ce4a-4da2-ba65-4721e199afac req-dfb57231-471c-4e48-89f3-2dfc60b2e73c service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Received unexpected event network-vif-unplugged-a65d94d0-bf0b-4d66-981e-de1b674507a5 for instance with vm_state active and task_state shelving.
Dec 01 17:35:26 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Instance destroyed successfully.
Dec 01 17:35:26 user nova-compute[75745]: DEBUG nova.compute.manager [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:35:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Acquiring lock "refresh_cache-3da51c15-816b-40cd-9315-11a48d0f344c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:35:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Acquired lock "refresh_cache-3da51c15-816b-40cd-9315-11a48d0f344c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:35:26 user nova-compute[75745]: DEBUG nova.network.neutron [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG nova.network.neutron [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Updating instance_info_cache with network_info: [{"id": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "address": "fa:16:3e:17:60:43", "network": {"id": "a3a76c7a-2282-4faa-ae5e-0caddf88001d", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146905868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e00f4a99c2ae4a5aa9a456c186ea7cc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65d94d0-bf", "ovs_interfaceid": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Releasing lock "refresh_cache-3da51c15-816b-40cd-9315-11a48d0f344c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:35:27 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Instance destroyed successfully.
Dec 01 17:35:27 user nova-compute[75745]: DEBUG nova.objects.instance [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lazy-loading 'resources' on Instance uuid 3da51c15-816b-40cd-9315-11a48d0f344c {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:33:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2147236562',display_name='tempest-TestShelveInstance-server-2147236562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2147236562',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0QLStMb44bOFyJh0Y7JMYnF245PrcTUhwJpczrTbimJc0K8uFLubP1uApKJ+yeuI5wm4aypb+b+Oyww0GNq5rEPIBSe4cmRHCIgIkKkNlqQCQ01utvvYTYd+Z8+6cExw==',key_name='tempest-TestShelveInstance-1392571257',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:33:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e00f4a99c2ae4a5aa9a456c186ea7cc8',ramdisk_id='',reservation_id='r-ydabfpsw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1224578669',owner_user_name='tempest-TestShelveInstance-1224578669-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:33:49Z,user_data=None,user_id='b1debb66002b41749f6e12d5fd9722fc',uuid=3da51c15-816b-40cd-9315-11a48d0f344c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "address": "fa:16:3e:17:60:43", "network": {"id": "a3a76c7a-2282-4faa-ae5e-0caddf88001d", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146905868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e00f4a99c2ae4a5aa9a456c186ea7cc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65d94d0-bf", "ovs_interfaceid": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Converting VIF {"id": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "address": "fa:16:3e:17:60:43", "network": {"id": "a3a76c7a-2282-4faa-ae5e-0caddf88001d", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146905868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e00f4a99c2ae4a5aa9a456c186ea7cc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65d94d0-bf", "ovs_interfaceid": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:60:43,bridge_name='br-int',has_traffic_filtering=True,id=a65d94d0-bf0b-4d66-981e-de1b674507a5,network=Network(a3a76c7a-2282-4faa-ae5e-0caddf88001d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65d94d0-bf') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG os_vif [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:60:43,bridge_name='br-int',has_traffic_filtering=True,id=a65d94d0-bf0b-4d66-981e-de1b674507a5,network=Network(a3a76c7a-2282-4faa-ae5e-0caddf88001d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65d94d0-bf') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa65d94d0-bf, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8b2c94b-1086-4563-8f84-e8f9b1cf4de9) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG nova.compute.manager [req-f0707264-4398-4b6f-a639-49fa049ccaa1 req-a234efe5-a54c-431d-bcdb-1f5ae3f0b227 service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Received event network-changed-a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG nova.compute.manager [req-f0707264-4398-4b6f-a639-49fa049ccaa1 req-a234efe5-a54c-431d-bcdb-1f5ae3f0b227 service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Refreshing instance network info cache due to event network-changed-a65d94d0-bf0b-4d66-981e-de1b674507a5. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-f0707264-4398-4b6f-a639-49fa049ccaa1 req-a234efe5-a54c-431d-bcdb-1f5ae3f0b227 service nova] Acquiring lock "refresh_cache-3da51c15-816b-40cd-9315-11a48d0f344c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-f0707264-4398-4b6f-a639-49fa049ccaa1 req-a234efe5-a54c-431d-bcdb-1f5ae3f0b227 service nova] Acquired lock "refresh_cache-3da51c15-816b-40cd-9315-11a48d0f344c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG nova.network.neutron [req-f0707264-4398-4b6f-a639-49fa049ccaa1 req-a234efe5-a54c-431d-bcdb-1f5ae3f0b227 service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Refreshing network info cache for port a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:35:27 user nova-compute[75745]: INFO os_vif [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:60:43,bridge_name='br-int',has_traffic_filtering=True,id=a65d94d0-bf0b-4d66-981e-de1b674507a5,network=Network(a3a76c7a-2282-4faa-ae5e-0caddf88001d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65d94d0-bf')
Dec 01 17:35:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NAyzDFru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:35:27 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:35:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d6f3fa-6ab2-4cf3-822e-1bca8b549a27]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:35:27 user nova-compute[75745]: No targets found.
Dec 01 17:35:27 user nova-compute[75745]: iSNS:
Dec 01 17:35:27 user nova-compute[75745]: No targets found.
Dec 01 17:35:27 user nova-compute[75745]: STATIC:
Dec 01 17:35:27 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0
Dec 01 17:35:27 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:35:27 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:35:27 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895
Dec 01 17:35:27 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:35:27 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:35:27 user nova-compute[75745]: FIRMWARE:
Dec 01 17:35:27 user nova-compute[75745]: No targets found.
Dec 01 17:35:27 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:35:27 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:35:27 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[851e048e-269e-4c55-9ea8-449050abb4ba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4319117-2e65-4a63-ae6d-b0b1194a52b4]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:35:27 user nova-compute[75745]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 (non-flash)
Dec 01 17:35:27 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:35:27 user nova-compute[75745]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 (non-flash)
Dec 01 17:35:27 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24e5825750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895'): ({'sde'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Removing single pathed devices sde {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fa3b44-15ad-4916-a7e7-4449adacf05d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c962d644-9136-40ad-9852-d4d988075cbd]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Flushing IO for device /dev/sde {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[83eaed87-2b01-4a35-a9da-5d2cccc26248]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c278b8f5-cbc8-41dc-97ad-0319e2cfe26f]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] SCSI volumes sde have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae18a6f-a362-4f0b-8fd2-1e2e33125003]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:35:27 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:35:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:35:28 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e70d23-bb7c-41c5-9b70-78afe7db1d97]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:35:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895, portal: 172.16.0.220,3260]
Dec 01 17:35:28 user nova-compute[75745]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895, portal: 172.16.0.220,3260] successful.
Dec 01 17:35:28 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:35:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:35:28 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:35:28 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af5a08c-dcdb-4d67-a817-6cbcfe7be247]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:35:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:35:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:35:28 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] <== disconnect_volume: return (297ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:35:28 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:35:28 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Deleting instance files /opt/stack/data/nova/instances/3da51c15-816b-40cd-9315-11a48d0f344c_del
Dec 01 17:35:28 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Deletion of /opt/stack/data/nova/instances/3da51c15-816b-40cd-9315-11a48d0f344c_del complete
Dec 01 17:35:28 user nova-compute[75745]: DEBUG nova.network.neutron [req-f0707264-4398-4b6f-a639-49fa049ccaa1 req-a234efe5-a54c-431d-bcdb-1f5ae3f0b227 service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Updated VIF entry in instance network info cache for port a65d94d0-bf0b-4d66-981e-de1b674507a5. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:35:28 user nova-compute[75745]: DEBUG nova.network.neutron [req-f0707264-4398-4b6f-a639-49fa049ccaa1 req-a234efe5-a54c-431d-bcdb-1f5ae3f0b227 service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Updating instance_info_cache with network_info: [{"id": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "address": "fa:16:3e:17:60:43", "network": {"id": "a3a76c7a-2282-4faa-ae5e-0caddf88001d", "bridge": null, "label": "tempest-TestShelveInstance-2146905868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e00f4a99c2ae4a5aa9a456c186ea7cc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapa65d94d0-bf", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:35:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-f0707264-4398-4b6f-a639-49fa049ccaa1 req-a234efe5-a54c-431d-bcdb-1f5ae3f0b227 service nova] Releasing lock "refresh_cache-3da51c15-816b-40cd-9315-11a48d0f344c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:35:28 user nova-compute[75745]: DEBUG nova.compute.manager [req-85274018-2514-4ce9-ba80-94db1962fae1 req-c86b2398-a9d2-4824-84a1-90f005e01902 service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Received event network-vif-plugged-a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:35:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-85274018-2514-4ce9-ba80-94db1962fae1 req-c86b2398-a9d2-4824-84a1-90f005e01902 service nova] Acquiring lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:35:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-85274018-2514-4ce9-ba80-94db1962fae1 req-c86b2398-a9d2-4824-84a1-90f005e01902 service nova] Lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:35:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-85274018-2514-4ce9-ba80-94db1962fae1 req-c86b2398-a9d2-4824-84a1-90f005e01902 service nova] Lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:35:28 user nova-compute[75745]: DEBUG nova.compute.manager [req-85274018-2514-4ce9-ba80-94db1962fae1 req-c86b2398-a9d2-4824-84a1-90f005e01902 service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] No waiting events found dispatching network-vif-plugged-a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:35:28 user nova-compute[75745]: WARNING nova.compute.manager [req-85274018-2514-4ce9-ba80-94db1962fae1 req-c86b2398-a9d2-4824-84a1-90f005e01902 service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Received unexpected event network-vif-plugged-a65d94d0-bf0b-4d66-981e-de1b674507a5 for instance with vm_state active and task_state shelving.
Dec 01 17:35:29 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Deleted allocations for instance 3da51c15-816b-40cd-9315-11a48d0f344c
Dec 01 17:35:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:35:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:35:29 user nova-compute[75745]: DEBUG nova.objects.instance [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lazy-loading 'numa_topology' on Instance uuid 3da51c15-816b-40cd-9315-11a48d0f344c {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:35:29 user nova-compute[75745]: DEBUG nova.objects.base [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Object Instance<3da51c15-816b-40cd-9315-11a48d0f344c> lazy-loaded attributes: resources,numa_topology {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:35:29 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:35:29 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:35:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.165s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:35:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a79c7f0e-86ca-4cef-aaae-eeba22ca94be tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lock "3da51c15-816b-40cd-9315-11a48d0f344c" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.396s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:35:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:35:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:35:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:35:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:35:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:35:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:35:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:35:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:35:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:35:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:35:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:35:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:35:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:35:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:35:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:35:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:35:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:35:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:35:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:35:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:35:59 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:36:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:01 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:36:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:03 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:36:03 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:36:03 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:36:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:04 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:36:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:36:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:36:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:36:04 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:36:05 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:36:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:36:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:36:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:36:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:36:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:36:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:36:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:36:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:36:06 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:36:06 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:36:06 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=8788MB free_disk=25.02663803100586GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:36:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:36:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:36:06 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 5e631ac3-8122-46a3-a54f-2395c0f7cf7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:36:06 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 5aee52eb-78e3-4f60-a920-7ade912735e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:36:06 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 61e0e19b-f926-4524-82c8-833f804c9b72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:36:06 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:36:06 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:36:06 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:36:06 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:36:06 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:36:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.277s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:36:07 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:36:07 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:36:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Acquiring lock "3c990a0a-188a-4973-846a-d09c98918500" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:36:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "3c990a0a-188a-4973-846a-d09c98918500" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:36:07 user nova-compute[75745]: DEBUG nova.compute.manager [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:36:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:36:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:36:07 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:36:07 user nova-compute[75745]: INFO nova.compute.claims [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Claim successful on node user
Dec 01 17:36:08 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:36:08 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:36:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.256s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:36:08 user nova-compute[75745]: DEBUG nova.compute.manager [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:36:08 user nova-compute[75745]: DEBUG nova.compute.manager [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:36:08 user nova-compute[75745]: DEBUG nova.network.neutron [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:36:08 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:36:08 user nova-compute[75745]: DEBUG nova.compute.manager [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:36:08 user nova-compute[75745]: DEBUG nova.policy [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2507209df93a48f1b17652da89646e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aff17da1db4afbb8563237035d13f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:36:08 user nova-compute[75745]: DEBUG nova.compute.manager [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:36:08 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:36:08 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Creating image(s)
Dec 01 17:36:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Acquiring lock "/opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:36:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "/opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:36:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "/opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:36:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:36:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.177s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:36:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:36:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:36:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:36:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.173s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:36:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:36:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk 1073741824" returned: 0 in 0.051s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:36:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:36:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:36:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.175s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:36:09 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:36:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:36:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:36:09 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Cannot resize image /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:36:09 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:36:09 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Ensure instance console log exists: /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:36:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:36:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:36:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:36:09 user nova-compute[75745]: DEBUG nova.network.neutron [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Successfully created port: 964bbd9c-d6ac-462c-8342-f565c3ab2934 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:36:09 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG nova.network.neutron [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Successfully updated port: 964bbd9c-d6ac-462c-8342-f565c3ab2934 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Acquiring lock "refresh_cache-3c990a0a-188a-4973-846a-d09c98918500" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Acquired lock "refresh_cache-3c990a0a-188a-4973-846a-d09c98918500" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG nova.network.neutron [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG nova.compute.manager [req-9afe2d30-7330-444c-b9ae-c2c1a2da70ba req-f56c5baf-eea9-4f14-b1a6-4195c030a352 service nova] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Received event network-changed-964bbd9c-d6ac-462c-8342-f565c3ab2934 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG nova.compute.manager [req-9afe2d30-7330-444c-b9ae-c2c1a2da70ba req-f56c5baf-eea9-4f14-b1a6-4195c030a352 service nova] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Refreshing instance network info cache due to event network-changed-964bbd9c-d6ac-462c-8342-f565c3ab2934. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-9afe2d30-7330-444c-b9ae-c2c1a2da70ba req-f56c5baf-eea9-4f14-b1a6-4195c030a352 service nova] Acquiring lock "refresh_cache-3c990a0a-188a-4973-846a-d09c98918500" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG nova.network.neutron [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG nova.network.neutron [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Updating instance_info_cache with network_info: [{"id": "964bbd9c-d6ac-462c-8342-f565c3ab2934", "address": "fa:16:3e:4a:af:e3", "network": {"id": "ab165176-5fd5-4df3-97fc-464c4a6891d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2005430003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0aff17da1db4afbb8563237035d13f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap964bbd9c-d6", "ovs_interfaceid": "964bbd9c-d6ac-462c-8342-f565c3ab2934", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Releasing lock "refresh_cache-3c990a0a-188a-4973-846a-d09c98918500" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG nova.compute.manager [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Instance network_info: |[{"id": "964bbd9c-d6ac-462c-8342-f565c3ab2934", "address": "fa:16:3e:4a:af:e3", "network": {"id": "ab165176-5fd5-4df3-97fc-464c4a6891d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2005430003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0aff17da1db4afbb8563237035d13f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap964bbd9c-d6", "ovs_interfaceid": "964bbd9c-d6ac-462c-8342-f565c3ab2934", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-9afe2d30-7330-444c-b9ae-c2c1a2da70ba req-f56c5baf-eea9-4f14-b1a6-4195c030a352 service nova] Acquired lock "refresh_cache-3c990a0a-188a-4973-846a-d09c98918500" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG nova.network.neutron [req-9afe2d30-7330-444c-b9ae-c2c1a2da70ba req-f56c5baf-eea9-4f14-b1a6-4195c030a352 service nova] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Refreshing network info cache for port 964bbd9c-d6ac-462c-8342-f565c3ab2934 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Start _get_guest_xml network_info=[{"id": "964bbd9c-d6ac-462c-8342-f565c3ab2934", "address": "fa:16:3e:4a:af:e3", "network": {"id": "ab165176-5fd5-4df3-97fc-464c4a6891d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2005430003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0aff17da1db4afbb8563237035d13f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap964bbd9c-d6", "ovs_interfaceid": "964bbd9c-d6ac-462c-8342-f565c3ab2934", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:36:10 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:36:10 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:36:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:36:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1281729636',display_name='tempest-TestStampPattern-server-1281729636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1281729636',id=43,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGNrLA5bKvG55GGS8MBbWt09LoTtS2gvVG2BKmrPsKsEdhegbzNdpBAYjEqY7P16s1fTayXnvtFgTmvCamKaUfjqCdJv5fIccc9eDKhtquF0DkT05mxPdPEaU8Xc/LdjA==',key_name='tempest-TestStampPattern-115018569',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0aff17da1db4afbb8563237035d13f5',ramdisk_id='',reservation_id='r-08uxyfmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-885997284',owner_user_name='tempest-TestStampPattern-885997284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:36:08Z,user_data=None,user_id='2507209df93a48f1b17652da89646e14',uuid=3c990a0a-188a-4973-846a-d09c98918500,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "964bbd9c-d6ac-462c-8342-f565c3ab2934", "address": "fa:16:3e:4a:af:e3", "network": {"id": "ab165176-5fd5-4df3-97fc-464c4a6891d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2005430003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0aff17da1db4afbb8563237035d13f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap964bbd9c-d6", "ovs_interfaceid": "964bbd9c-d6ac-462c-8342-f565c3ab2934", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Converting VIF {"id": "964bbd9c-d6ac-462c-8342-f565c3ab2934", "address": "fa:16:3e:4a:af:e3", "network": {"id": "ab165176-5fd5-4df3-97fc-464c4a6891d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2005430003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0aff17da1db4afbb8563237035d13f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap964bbd9c-d6", "ovs_interfaceid": "964bbd9c-d6ac-462c-8342-f565c3ab2934", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:af:e3,bridge_name='br-int',has_traffic_filtering=True,id=964bbd9c-d6ac-462c-8342-f565c3ab2934,network=Network(ab165176-5fd5-4df3-97fc-464c4a6891d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap964bbd9c-d6') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG nova.objects.instance [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c990a0a-188a-4973-846a-d09c98918500 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:36:10 user nova-compute[75745]:   <uuid>3c990a0a-188a-4973-846a-d09c98918500</uuid>
Dec 01 17:36:10 user nova-compute[75745]:   <name>instance-0000002b</name>
Dec 01 17:36:10 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:36:10 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:36:10 user nova-compute[75745]:   <metadata>
Dec 01 17:36:10 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:36:10 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:36:10 user nova-compute[75745]:       <nova:name>tempest-TestStampPattern-server-1281729636</nova:name>
Dec 01 17:36:10 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:36:10</nova:creationTime>
Dec 01 17:36:10 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:36:10 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:36:10 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:36:10 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:36:10 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:36:10 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:36:10 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:36:10 user nova-compute[75745]:       <nova:owner>
Dec 01 17:36:10 user nova-compute[75745]:         <nova:user uuid="2507209df93a48f1b17652da89646e14">tempest-TestStampPattern-885997284-project-member</nova:user>
Dec 01 17:36:10 user nova-compute[75745]:         <nova:project uuid="e0aff17da1db4afbb8563237035d13f5">tempest-TestStampPattern-885997284</nova:project>
Dec 01 17:36:10 user nova-compute[75745]:       </nova:owner>
Dec 01 17:36:10 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:36:10 user nova-compute[75745]:       <nova:ports>
Dec 01 17:36:10 user nova-compute[75745]:         <nova:port uuid="964bbd9c-d6ac-462c-8342-f565c3ab2934">
Dec 01 17:36:10 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 01 17:36:10 user nova-compute[75745]:         </nova:port>
Dec 01 17:36:10 user nova-compute[75745]:       </nova:ports>
Dec 01 17:36:10 user nova-compute[75745]:     </nova:instance>
Dec 01 17:36:10 user nova-compute[75745]:   </metadata>
Dec 01 17:36:10 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:36:10 user nova-compute[75745]:     <system>
Dec 01 17:36:10 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:36:10 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:36:10 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:36:10 user nova-compute[75745]:       <entry name="serial">3c990a0a-188a-4973-846a-d09c98918500</entry>
Dec 01 17:36:10 user nova-compute[75745]:       <entry name="uuid">3c990a0a-188a-4973-846a-d09c98918500</entry>
Dec 01 17:36:10 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:36:10 user nova-compute[75745]:     </system>
Dec 01 17:36:10 user nova-compute[75745]:   </sysinfo>
Dec 01 17:36:10 user nova-compute[75745]:   <os>
Dec 01 17:36:10 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:36:10 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:36:10 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:36:10 user nova-compute[75745]:   </os>
Dec 01 17:36:10 user nova-compute[75745]:   <features>
Dec 01 17:36:10 user nova-compute[75745]:     <acpi/>
Dec 01 17:36:10 user nova-compute[75745]:     <apic/>
Dec 01 17:36:10 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:36:10 user nova-compute[75745]:   </features>
Dec 01 17:36:10 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:36:10 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:36:10 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:36:10 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:36:10 user nova-compute[75745]:   </clock>
Dec 01 17:36:10 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:36:10 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:36:10 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:36:10 user nova-compute[75745]:   </cpu>
Dec 01 17:36:10 user nova-compute[75745]:   <devices>
Dec 01 17:36:10 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:36:10 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:36:10 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk"/>
Dec 01 17:36:10 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:36:10 user nova-compute[75745]:     </disk>
Dec 01 17:36:10 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:36:10 user nova-compute[75745]:       <mac address="fa:16:3e:4a:af:e3"/>
Dec 01 17:36:10 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:36:10 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:36:10 user nova-compute[75745]:       <target dev="tap964bbd9c-d6"/>
Dec 01 17:36:10 user nova-compute[75745]:     </interface>
Dec 01 17:36:10 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:36:10 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/console.log" append="off"/>
Dec 01 17:36:10 user nova-compute[75745]:     </serial>
Dec 01 17:36:10 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:36:10 user nova-compute[75745]:     <video>
Dec 01 17:36:10 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:36:10 user nova-compute[75745]:     </video>
Dec 01 17:36:10 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:36:10 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:36:10 user nova-compute[75745]:     </rng>
Dec 01 17:36:10 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:36:10 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:36:10 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:36:10 user nova-compute[75745]:     </memballoon>
Dec 01 17:36:10 user nova-compute[75745]:   </devices>
Dec 01 17:36:10 user nova-compute[75745]: </domain>
Dec 01 17:36:10 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:36:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1281729636',display_name='tempest-TestStampPattern-server-1281729636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1281729636',id=43,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGNrLA5bKvG55GGS8MBbWt09LoTtS2gvVG2BKmrPsKsEdhegbzNdpBAYjEqY7P16s1fTayXnvtFgTmvCamKaUfjqCdJv5fIccc9eDKhtquF0DkT05mxPdPEaU8Xc/LdjA==',key_name='tempest-TestStampPattern-115018569',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0aff17da1db4afbb8563237035d13f5',ramdisk_id='',reservation_id='r-08uxyfmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-885997284',owner_user_name='tempest-TestStampPattern-885997284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:36:08Z,user_data=None,user_id='2507209df93a48f1b17652da89646e14',uuid=3c990a0a-188a-4973-846a-d09c98918500,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "964bbd9c-d6ac-462c-8342-f565c3ab2934", "address": "fa:16:3e:4a:af:e3", "network": {"id": "ab165176-5fd5-4df3-97fc-464c4a6891d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2005430003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0aff17da1db4afbb8563237035d13f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap964bbd9c-d6", "ovs_interfaceid": "964bbd9c-d6ac-462c-8342-f565c3ab2934", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Converting VIF {"id": "964bbd9c-d6ac-462c-8342-f565c3ab2934", "address": "fa:16:3e:4a:af:e3", "network": {"id": "ab165176-5fd5-4df3-97fc-464c4a6891d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2005430003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0aff17da1db4afbb8563237035d13f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap964bbd9c-d6", "ovs_interfaceid": "964bbd9c-d6ac-462c-8342-f565c3ab2934", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:af:e3,bridge_name='br-int',has_traffic_filtering=True,id=964bbd9c-d6ac-462c-8342-f565c3ab2934,network=Network(ab165176-5fd5-4df3-97fc-464c4a6891d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap964bbd9c-d6') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG os_vif [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:af:e3,bridge_name='br-int',has_traffic_filtering=True,id=964bbd9c-d6ac-462c-8342-f565c3ab2934,network=Network(ab165176-5fd5-4df3-97fc-464c4a6891d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap964bbd9c-d6') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ae2628d7-c191-5415-9545-add59ac9e94b', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap964bbd9c-d6, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap964bbd9c-d6, col_values=(('qos', UUID('ccc45b53-3e81-4548-9d56-e2e7ba59e4ce')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap964bbd9c-d6, col_values=(('external_ids', {'iface-id': '964bbd9c-d6ac-462c-8342-f565c3ab2934', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:af:e3', 'vm-uuid': '3c990a0a-188a-4973-846a-d09c98918500'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:10 user nova-compute[75745]: INFO os_vif [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:af:e3,bridge_name='br-int',has_traffic_filtering=True,id=964bbd9c-d6ac-462c-8342-f565c3ab2934,network=Network(ab165176-5fd5-4df3-97fc-464c4a6891d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap964bbd9c-d6')
Dec 01 17:36:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:36:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] No VIF found with MAC fa:16:3e:4a:af:e3, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:36:11 user nova-compute[75745]: DEBUG nova.network.neutron [req-9afe2d30-7330-444c-b9ae-c2c1a2da70ba req-f56c5baf-eea9-4f14-b1a6-4195c030a352 service nova] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Updated VIF entry in instance network info cache for port 964bbd9c-d6ac-462c-8342-f565c3ab2934. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:36:11 user nova-compute[75745]: DEBUG nova.network.neutron [req-9afe2d30-7330-444c-b9ae-c2c1a2da70ba req-f56c5baf-eea9-4f14-b1a6-4195c030a352 service nova] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Updating instance_info_cache with network_info: [{"id": "964bbd9c-d6ac-462c-8342-f565c3ab2934", "address": "fa:16:3e:4a:af:e3", "network": {"id": "ab165176-5fd5-4df3-97fc-464c4a6891d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2005430003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0aff17da1db4afbb8563237035d13f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap964bbd9c-d6", "ovs_interfaceid": "964bbd9c-d6ac-462c-8342-f565c3ab2934", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:36:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-9afe2d30-7330-444c-b9ae-c2c1a2da70ba req-f56c5baf-eea9-4f14-b1a6-4195c030a352 service nova] Releasing lock "refresh_cache-3c990a0a-188a-4973-846a-d09c98918500" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:36:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:12 user nova-compute[75745]: DEBUG nova.compute.manager [req-f5284fb7-45ba-4b64-8efa-5ce35c800aa0 req-4bb8aabe-0a05-445c-be03-8a1da9ffe3b0 service nova] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Received event network-vif-plugged-964bbd9c-d6ac-462c-8342-f565c3ab2934 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:36:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-f5284fb7-45ba-4b64-8efa-5ce35c800aa0 req-4bb8aabe-0a05-445c-be03-8a1da9ffe3b0 service nova] Acquiring lock "3c990a0a-188a-4973-846a-d09c98918500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:36:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-f5284fb7-45ba-4b64-8efa-5ce35c800aa0 req-4bb8aabe-0a05-445c-be03-8a1da9ffe3b0 service nova] Lock "3c990a0a-188a-4973-846a-d09c98918500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:36:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-f5284fb7-45ba-4b64-8efa-5ce35c800aa0 req-4bb8aabe-0a05-445c-be03-8a1da9ffe3b0 service nova] Lock "3c990a0a-188a-4973-846a-d09c98918500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:36:12 user nova-compute[75745]: DEBUG nova.compute.manager [req-f5284fb7-45ba-4b64-8efa-5ce35c800aa0 req-4bb8aabe-0a05-445c-be03-8a1da9ffe3b0 service nova] [instance: 3c990a0a-188a-4973-846a-d09c98918500] No waiting events found dispatching network-vif-plugged-964bbd9c-d6ac-462c-8342-f565c3ab2934 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:36:12 user nova-compute[75745]: WARNING nova.compute.manager [req-f5284fb7-45ba-4b64-8efa-5ce35c800aa0 req-4bb8aabe-0a05-445c-be03-8a1da9ffe3b0 service nova] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Received unexpected event network-vif-plugged-964bbd9c-d6ac-462c-8342-f565c3ab2934 for instance with vm_state building and task_state spawning.
Dec 01 17:36:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:12 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:36:12 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:36:12 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Rebuilding the list of instances to heal {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 17:36:12 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Skipping network cache update for instance because it is Building. {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Dec 01 17:36:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-5e631ac3-8122-46a3-a54f-2395c0f7cf7c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:36:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-5e631ac3-8122-46a3-a54f-2395c0f7cf7c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:36:12 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:36:12 user nova-compute[75745]: DEBUG nova.objects.instance [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lazy-loading 'info_cache' on Instance uuid 5e631ac3-8122-46a3-a54f-2395c0f7cf7c {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:36:13 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Updating instance_info_cache with network_info: [{"id": "7239781d-a3ed-42f7-a30b-d8e5410bc622", "address": "fa:16:3e:0a:8d:a9", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7239781d-a3", "ovs_interfaceid": "7239781d-a3ed-42f7-a30b-d8e5410bc622", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:36:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a323dcca-8c71-4f52-9fcc-33cab4db7347 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "61e0e19b-f926-4524-82c8-833f804c9b72" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:36:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a323dcca-8c71-4f52-9fcc-33cab4db7347 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "61e0e19b-f926-4524-82c8-833f804c9b72" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:36:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a323dcca-8c71-4f52-9fcc-33cab4db7347 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "61e0e19b-f926-4524-82c8-833f804c9b72-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:36:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a323dcca-8c71-4f52-9fcc-33cab4db7347 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "61e0e19b-f926-4524-82c8-833f804c9b72-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:36:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a323dcca-8c71-4f52-9fcc-33cab4db7347 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "61e0e19b-f926-4524-82c8-833f804c9b72-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:36:13 user nova-compute[75745]: INFO nova.compute.manager [None req-a323dcca-8c71-4f52-9fcc-33cab4db7347 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Terminating instance
Dec 01 17:36:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-5e631ac3-8122-46a3-a54f-2395c0f7cf7c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:36:13 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:36:13 user nova-compute[75745]: DEBUG nova.compute.manager [None req-a323dcca-8c71-4f52-9fcc-33cab4db7347 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:36:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:13 user nova-compute[75745]: DEBUG nova.compute.manager [req-173d4312-38e7-487a-ac3e-0c3e0492abd7 req-c04d2ffd-9026-46dd-b6ab-2345aedd0d17 service nova] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Received event network-vif-unplugged-7f4c7ce3-3915-4ee1-acea-7a584c6c61b4 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:36:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-173d4312-38e7-487a-ac3e-0c3e0492abd7 req-c04d2ffd-9026-46dd-b6ab-2345aedd0d17 service nova] Acquiring lock "61e0e19b-f926-4524-82c8-833f804c9b72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:36:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-173d4312-38e7-487a-ac3e-0c3e0492abd7 req-c04d2ffd-9026-46dd-b6ab-2345aedd0d17 service nova] Lock "61e0e19b-f926-4524-82c8-833f804c9b72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:36:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-173d4312-38e7-487a-ac3e-0c3e0492abd7 req-c04d2ffd-9026-46dd-b6ab-2345aedd0d17 service nova] Lock "61e0e19b-f926-4524-82c8-833f804c9b72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:36:13 user nova-compute[75745]: DEBUG nova.compute.manager [req-173d4312-38e7-487a-ac3e-0c3e0492abd7 req-c04d2ffd-9026-46dd-b6ab-2345aedd0d17 service nova] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] No waiting events found dispatching network-vif-unplugged-7f4c7ce3-3915-4ee1-acea-7a584c6c61b4 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:36:13 user nova-compute[75745]: DEBUG nova.compute.manager [req-173d4312-38e7-487a-ac3e-0c3e0492abd7 req-c04d2ffd-9026-46dd-b6ab-2345aedd0d17 service nova] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Received event network-vif-unplugged-7f4c7ce3-3915-4ee1-acea-7a584c6c61b4 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:36:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:13 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Instance destroyed successfully.
Dec 01 17:36:13 user nova-compute[75745]: DEBUG nova.objects.instance [None req-a323dcca-8c71-4f52-9fcc-33cab4db7347 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lazy-loading 'resources' on Instance uuid 61e0e19b-f926-4524-82c8-833f804c9b72 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:36:13 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-a323dcca-8c71-4f52-9fcc-33cab4db7347 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:26:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1553169510',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1553169510',id=38,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:26:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='adb3ba16695543cab6f10932fd6b2d2d',ramdisk_id='',reservation_id='r-z0gpr54l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-90723689',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:28:48Z,user_data=None,user_id='b319a47b86c04affa1858e1c2359876b',uuid=61e0e19b-f926-4524-82c8-833f804c9b72,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f4c7ce3-3915-4ee1-acea-7a584c6c61b4", "address": "fa:16:3e:7d:a1:da", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4c7ce3-39", "ovs_interfaceid": "7f4c7ce3-3915-4ee1-acea-7a584c6c61b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:36:13 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-a323dcca-8c71-4f52-9fcc-33cab4db7347 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Converting VIF {"id": "7f4c7ce3-3915-4ee1-acea-7a584c6c61b4", "address": "fa:16:3e:7d:a1:da", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4c7ce3-39", "ovs_interfaceid": "7f4c7ce3-3915-4ee1-acea-7a584c6c61b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:36:13 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-a323dcca-8c71-4f52-9fcc-33cab4db7347 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:a1:da,bridge_name='br-int',has_traffic_filtering=True,id=7f4c7ce3-3915-4ee1-acea-7a584c6c61b4,network=Network(bf1db63d-d427-41c2-ac82-6fab9483a423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f4c7ce3-39') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:36:13 user nova-compute[75745]: DEBUG os_vif [None req-a323dcca-8c71-4f52-9fcc-33cab4db7347 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:a1:da,bridge_name='br-int',has_traffic_filtering=True,id=7f4c7ce3-3915-4ee1-acea-7a584c6c61b4,network=Network(bf1db63d-d427-41c2-ac82-6fab9483a423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f4c7ce3-39') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:36:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f4c7ce3-39, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:36:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6090922f-8b04-4c43-bfc0-4a34b2442e9d) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:36:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:14 user nova-compute[75745]: INFO os_vif [None req-a323dcca-8c71-4f52-9fcc-33cab4db7347 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:a1:da,bridge_name='br-int',has_traffic_filtering=True,id=7f4c7ce3-3915-4ee1-acea-7a584c6c61b4,network=Network(bf1db63d-d427-41c2-ac82-6fab9483a423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f4c7ce3-39')
Dec 01 17:36:14 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-a323dcca-8c71-4f52-9fcc-33cab4db7347 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Deleting instance files /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72_del
Dec 01 17:36:14 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-a323dcca-8c71-4f52-9fcc-33cab4db7347 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Deletion of /opt/stack/data/nova/instances/61e0e19b-f926-4524-82c8-833f804c9b72_del complete
Dec 01 17:36:14 user nova-compute[75745]: INFO nova.compute.manager [None req-a323dcca-8c71-4f52-9fcc-33cab4db7347 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Took 0.66 seconds to destroy the instance on the hypervisor.
Dec 01 17:36:14 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-a323dcca-8c71-4f52-9fcc-33cab4db7347 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:36:14 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:36:14 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:36:14 user nova-compute[75745]: DEBUG nova.compute.manager [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:36:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:36:14 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Instance spawned successfully.
Dec 01 17:36:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:36:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:36:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:36:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:36:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:36:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:36:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:36:14 user nova-compute[75745]: DEBUG nova.compute.manager [req-7fc52c5d-aeb3-4460-bde6-d4006f0648c6 req-540c9c0f-f8a0-45d8-8c2e-e2e7b360cc47 service nova] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Received event network-vif-plugged-964bbd9c-d6ac-462c-8342-f565c3ab2934 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:36:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7fc52c5d-aeb3-4460-bde6-d4006f0648c6 req-540c9c0f-f8a0-45d8-8c2e-e2e7b360cc47 service nova] Acquiring lock "3c990a0a-188a-4973-846a-d09c98918500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:36:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7fc52c5d-aeb3-4460-bde6-d4006f0648c6 req-540c9c0f-f8a0-45d8-8c2e-e2e7b360cc47 service nova] Lock "3c990a0a-188a-4973-846a-d09c98918500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:36:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7fc52c5d-aeb3-4460-bde6-d4006f0648c6 req-540c9c0f-f8a0-45d8-8c2e-e2e7b360cc47 service nova] Lock "3c990a0a-188a-4973-846a-d09c98918500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:36:14 user nova-compute[75745]: DEBUG nova.compute.manager [req-7fc52c5d-aeb3-4460-bde6-d4006f0648c6 req-540c9c0f-f8a0-45d8-8c2e-e2e7b360cc47 service nova] [instance: 3c990a0a-188a-4973-846a-d09c98918500] No waiting events found dispatching network-vif-plugged-964bbd9c-d6ac-462c-8342-f565c3ab2934 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:36:14 user nova-compute[75745]: WARNING nova.compute.manager [req-7fc52c5d-aeb3-4460-bde6-d4006f0648c6 req-540c9c0f-f8a0-45d8-8c2e-e2e7b360cc47 service nova] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Received unexpected event network-vif-plugged-964bbd9c-d6ac-462c-8342-f565c3ab2934 for instance with vm_state building and task_state spawning.
Dec 01 17:36:14 user nova-compute[75745]: INFO nova.compute.manager [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Took 6.06 seconds to spawn the instance on the hypervisor.
Dec 01 17:36:14 user nova-compute[75745]: DEBUG nova.compute.manager [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:36:14 user nova-compute[75745]: INFO nova.compute.manager [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Took 6.66 seconds to build instance.
Dec 01 17:36:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-7ba508ef-817a-40f4-a9f9-09b38558bd83 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "3c990a0a-188a-4973-846a-d09c98918500" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.790s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:36:14 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:36:14 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Took 0.50 seconds to deallocate network for instance.
Dec 01 17:36:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a323dcca-8c71-4f52-9fcc-33cab4db7347 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:36:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a323dcca-8c71-4f52-9fcc-33cab4db7347 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:36:14 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-a323dcca-8c71-4f52-9fcc-33cab4db7347 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:36:14 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-a323dcca-8c71-4f52-9fcc-33cab4db7347 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:36:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a323dcca-8c71-4f52-9fcc-33cab4db7347 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:36:14 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-a323dcca-8c71-4f52-9fcc-33cab4db7347 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Deleted allocations for instance 61e0e19b-f926-4524-82c8-833f804c9b72
Dec 01 17:36:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-a323dcca-8c71-4f52-9fcc-33cab4db7347 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "61e0e19b-f926-4524-82c8-833f804c9b72" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.508s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:36:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:15 user nova-compute[75745]: DEBUG nova.compute.manager [req-17bad1f7-d290-4599-82c5-25c5e05b6d2d req-7f1e3b68-c943-40f2-a4da-97840b985580 service nova] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Received event network-vif-plugged-7f4c7ce3-3915-4ee1-acea-7a584c6c61b4 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:36:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-17bad1f7-d290-4599-82c5-25c5e05b6d2d req-7f1e3b68-c943-40f2-a4da-97840b985580 service nova] Acquiring lock "61e0e19b-f926-4524-82c8-833f804c9b72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:36:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-17bad1f7-d290-4599-82c5-25c5e05b6d2d req-7f1e3b68-c943-40f2-a4da-97840b985580 service nova] Lock "61e0e19b-f926-4524-82c8-833f804c9b72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:36:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-17bad1f7-d290-4599-82c5-25c5e05b6d2d req-7f1e3b68-c943-40f2-a4da-97840b985580 service nova] Lock "61e0e19b-f926-4524-82c8-833f804c9b72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:36:15 user nova-compute[75745]: DEBUG nova.compute.manager [req-17bad1f7-d290-4599-82c5-25c5e05b6d2d req-7f1e3b68-c943-40f2-a4da-97840b985580 service nova] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] No waiting events found dispatching network-vif-plugged-7f4c7ce3-3915-4ee1-acea-7a584c6c61b4 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:36:15 user nova-compute[75745]: WARNING nova.compute.manager [req-17bad1f7-d290-4599-82c5-25c5e05b6d2d req-7f1e3b68-c943-40f2-a4da-97840b985580 service nova] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Received unexpected event network-vif-plugged-7f4c7ce3-3915-4ee1-acea-7a584c6c61b4 for instance with vm_state deleted and task_state None.
Dec 01 17:36:15 user nova-compute[75745]: DEBUG nova.compute.manager [req-17bad1f7-d290-4599-82c5-25c5e05b6d2d req-7f1e3b68-c943-40f2-a4da-97840b985580 service nova] [instance: 61e0e19b-f926-4524-82c8-833f804c9b72] Received event network-vif-deleted-7f4c7ce3-3915-4ee1-acea-7a584c6c61b4 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:36:16 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:36:18 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:36:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:36:58 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:36:58 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Cleaning up deleted instances {{(pid=75745) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 01 17:36:58 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] There are 0 instances to clean {{(pid=75745) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 01 17:36:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:37:01 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:37:01 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:37:02 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:37:03 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:37:03 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:37:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "5aee52eb-78e3-4f60-a920-7ade912735e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:37:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "5aee52eb-78e3-4f60-a920-7ade912735e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:37:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:37:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:37:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:37:03 user nova-compute[75745]: INFO nova.compute.manager [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Terminating instance
Dec 01 17:37:03 user nova-compute[75745]: DEBUG nova.compute.manager [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:37:03 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:03 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG nova.compute.manager [req-92cd7d4e-afc1-4bbc-89be-110de5e6efff req-2ec8a387-da54-460b-b79a-75f36139ea2a service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Received event network-vif-unplugged-7c69901c-a94e-47f8-8a4a-1654ed728b83 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-92cd7d4e-afc1-4bbc-89be-110de5e6efff req-2ec8a387-da54-460b-b79a-75f36139ea2a service nova] Acquiring lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-92cd7d4e-afc1-4bbc-89be-110de5e6efff req-2ec8a387-da54-460b-b79a-75f36139ea2a service nova] Lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-92cd7d4e-afc1-4bbc-89be-110de5e6efff req-2ec8a387-da54-460b-b79a-75f36139ea2a service nova] Lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG nova.compute.manager [req-92cd7d4e-afc1-4bbc-89be-110de5e6efff req-2ec8a387-da54-460b-b79a-75f36139ea2a service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] No waiting events found dispatching network-vif-unplugged-7c69901c-a94e-47f8-8a4a-1654ed728b83 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG nova.compute.manager [req-92cd7d4e-afc1-4bbc-89be-110de5e6efff req-2ec8a387-da54-460b-b79a-75f36139ea2a service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Received event network-vif-unplugged-7c69901c-a94e-47f8-8a4a-1654ed728b83 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:04 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Instance destroyed successfully.
Dec 01 17:37:04 user nova-compute[75745]: DEBUG nova.objects.instance [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lazy-loading 'resources' on Instance uuid 5aee52eb-78e3-4f60-a920-7ade912735e8 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-957931660',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-957931660',id=32,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:23:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='adb3ba16695543cab6f10932fd6b2d2d',ramdisk_id='',reservation_id='r-ehd8ztzo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-90723689',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:25:04Z,user_data=None,user_id='b319a47b86c04affa1858e1c2359876b',uuid=5aee52eb-78e3-4f60-a920-7ade912735e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c69901c-a94e-47f8-8a4a-1654ed728b83", "address": "fa:16:3e:2e:86:ec", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c69901c-a9", "ovs_interfaceid": "7c69901c-a94e-47f8-8a4a-1654ed728b83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Converting VIF {"id": "7c69901c-a94e-47f8-8a4a-1654ed728b83", "address": "fa:16:3e:2e:86:ec", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c69901c-a9", "ovs_interfaceid": "7c69901c-a94e-47f8-8a4a-1654ed728b83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:86:ec,bridge_name='br-int',has_traffic_filtering=True,id=7c69901c-a94e-47f8-8a4a-1654ed728b83,network=Network(bf1db63d-d427-41c2-ac82-6fab9483a423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c69901c-a9') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG os_vif [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:86:ec,bridge_name='br-int',has_traffic_filtering=True,id=7c69901c-a94e-47f8-8a4a-1654ed728b83,network=Network(bf1db63d-d427-41c2-ac82-6fab9483a423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c69901c-a9') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c69901c-a9, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5cc4f4cc-a175-451d-b4bd-499876e80828) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:37:04 user nova-compute[75745]: INFO os_vif [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:86:ec,bridge_name='br-int',has_traffic_filtering=True,id=7c69901c-a94e-47f8-8a4a-1654ed728b83,network=Network(bf1db63d-d427-41c2-ac82-6fab9483a423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c69901c-a9')
Dec 01 17:37:04 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yjLwTGef', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:37:04 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:37:04 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7ad765-0a7a-4fa4-aa9f-c18f99ffe854]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:37:04 user nova-compute[75745]: No targets found.
Dec 01 17:37:04 user nova-compute[75745]: iSNS:
Dec 01 17:37:04 user nova-compute[75745]: No targets found.
Dec 01 17:37:04 user nova-compute[75745]: STATIC:
Dec 01 17:37:04 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0
Dec 01 17:37:04 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:37:04 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:37:04 user nova-compute[75745]: FIRMWARE:
Dec 01 17:37:04 user nova-compute[75745]: No targets found.
Dec 01 17:37:04 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:37:04 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:37:04 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ca08b2-272c-47a7-ae05-826e54167115]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0774489d-f770-4236-8193-f1cfc8a5c7e8]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:37:04 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 (non-flash)
Dec 01 17:37:04 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f249850e0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0'): ({'sdb'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Removing single pathed devices sdb {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e826a5b-bd36-463a-b48b-5c1b8982c524]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d702c8ba-f483-4540-8b19-ff28b1948468]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Flushing IO for device /dev/sdb {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c3bec8-402c-4950-b8a7-eeb3edab058f]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[035a575d-6304-42d0-b861-0cf2b4c3934c]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] SCSI volumes sdb have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bf98e0-6923-418a-87c9-8c7d1501ea46]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a2f52e-ab85-4982-a66a-c119a34418f6]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0, portal: 172.16.0.220,3260]
Dec 01 17:37:04 user nova-compute[75745]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0, portal: 172.16.0.220,3260] successful.
Dec 01 17:37:04 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b58c9fd5-87ee-40e5-9f9b-5ab59cc378b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ecad4d-edba-47ed-b3ba-1ade3baccfd6]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] <== disconnect_volume: return (273ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:37:04 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:37:04 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Deleting instance files /opt/stack/data/nova/instances/5aee52eb-78e3-4f60-a920-7ade912735e8_del
Dec 01 17:37:04 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Deletion of /opt/stack/data/nova/instances/5aee52eb-78e3-4f60-a920-7ade912735e8_del complete
Dec 01 17:37:05 user nova-compute[75745]: INFO nova.compute.manager [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Took 1.09 seconds to destroy the instance on the hypervisor.
Dec 01 17:37:05 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:37:05 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:37:05 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:37:05 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:37:05 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Took 0.46 seconds to deallocate network for instance.
Dec 01 17:37:05 user nova-compute[75745]: DEBUG nova.compute.manager [req-7ec61655-ef32-4303-baba-448f11f8ef90 req-ff530629-a1fb-40e2-b856-6aad2ee46666 service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Received event network-vif-deleted-7c69901c-a94e-47f8-8a4a-1654ed728b83 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:37:05 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:37:05 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:37:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:37:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:37:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:37:05 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:37:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:37:06 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:37:06 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:37:06 user nova-compute[75745]: INFO nova.compute.manager [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Took 0.77 seconds to detach 1 volumes for instance.
Dec 01 17:37:06 user nova-compute[75745]: DEBUG nova.compute.manager [req-99152927-7f77-409d-a359-8583dd030d24 req-83edd171-07f7-418a-bb6e-4d990043e627 service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Received event network-vif-plugged-7c69901c-a94e-47f8-8a4a-1654ed728b83 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:37:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-99152927-7f77-409d-a359-8583dd030d24 req-83edd171-07f7-418a-bb6e-4d990043e627 service nova] Acquiring lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:37:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-99152927-7f77-409d-a359-8583dd030d24 req-83edd171-07f7-418a-bb6e-4d990043e627 service nova] Lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:37:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-99152927-7f77-409d-a359-8583dd030d24 req-83edd171-07f7-418a-bb6e-4d990043e627 service nova] Lock "5aee52eb-78e3-4f60-a920-7ade912735e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:37:06 user nova-compute[75745]: DEBUG nova.compute.manager [req-99152927-7f77-409d-a359-8583dd030d24 req-83edd171-07f7-418a-bb6e-4d990043e627 service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] No waiting events found dispatching network-vif-plugged-7c69901c-a94e-47f8-8a4a-1654ed728b83 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:37:06 user nova-compute[75745]: WARNING nova.compute.manager [req-99152927-7f77-409d-a359-8583dd030d24 req-83edd171-07f7-418a-bb6e-4d990043e627 service nova] [instance: 5aee52eb-78e3-4f60-a920-7ade912735e8] Received unexpected event network-vif-plugged-7c69901c-a94e-47f8-8a4a-1654ed728b83 for instance with vm_state active and task_state deleting.
Dec 01 17:37:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:37:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:37:06 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:37:06 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:37:06 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:37:06 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:37:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.213s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:37:06 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Deleted allocations for instance 5aee52eb-78e3-4f60-a920-7ade912735e8
Dec 01 17:37:06 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:37:06 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:37:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e51a1b90-9259-4ef3-b1d5-4ce816c1d814 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "5aee52eb-78e3-4f60-a920-7ade912735e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.780s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:37:06 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:37:07 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:37:07 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:37:07 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=8787MB free_disk=25.122013092041016GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:37:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:37:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:37:07 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 5e631ac3-8122-46a3-a54f-2395c0f7cf7c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:37:07 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 3c990a0a-188a-4973-846a-d09c98918500 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:37:07 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:37:07 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:37:07 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:37:07 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:37:07 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:37:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:37:08 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:37:08 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:37:08 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:37:08 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75745) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 01 17:37:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:09 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:37:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:37:14 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:37:14 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:37:14 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Didn't find any instances for network info cache update. {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 17:37:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Acquiring lock "3da51c15-816b-40cd-9315-11a48d0f344c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:37:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lock "3da51c15-816b-40cd-9315-11a48d0f344c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:37:17 user nova-compute[75745]: INFO nova.compute.manager [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Unshelving
Dec 01 17:37:17 user nova-compute[75745]: INFO nova.virt.block_device [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Booting with volume 36817f6c-30a3-4ccb-b262-934a1e29f895 at /dev/vda
Dec 01 17:37:17 user nova-compute[75745]: DEBUG os_brick.utils [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:37:17 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:37:17 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:37:17 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef1613a-2aa1-475b-b8f5-9595f035c85f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:37:17 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:37:17 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:37:17 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0ba49c-78d9-40fa-95b6-afd924fd0a12]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:37:17 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:37:17 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:37:17 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f935a4a4-987b-4d8f-ad40-59cae71af51d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:37:17 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[892d061a-4512-486b-9fe8-25fda24a5d99]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:37:17 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:37:17 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:37:17 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:37:17 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:37:17 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:37:17 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:37:17 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cd8b69-3f51-4104-b02d-88e00d70ef5a]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:37:17 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:37:17 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:37:17 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:37:17 user nova-compute[75745]: DEBUG os_brick.utils [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:37:17 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Updating existing volume attachment record: 563b1280-90ee-4b21-af33-348739332521 {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:37:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:37:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:37:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:37:29 user nova-compute[75745]: DEBUG nova.objects.instance [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lazy-loading 'pci_requests' on Instance uuid 3da51c15-816b-40cd-9315-11a48d0f344c {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:37:29 user nova-compute[75745]: DEBUG nova.objects.instance [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lazy-loading 'numa_topology' on Instance uuid 3da51c15-816b-40cd-9315-11a48d0f344c {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:37:29 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:37:29 user nova-compute[75745]: INFO nova.compute.claims [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Claim successful on node user
Dec 01 17:37:30 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:37:30 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:37:30 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.286s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:37:30 user nova-compute[75745]: INFO nova.network.neutron [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Updating port a65d94d0-bf0b-4d66-981e-de1b674507a5 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Dec 01 17:37:30 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Acquiring lock "refresh_cache-3da51c15-816b-40cd-9315-11a48d0f344c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:37:30 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Acquired lock "refresh_cache-3da51c15-816b-40cd-9315-11a48d0f344c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:37:30 user nova-compute[75745]: DEBUG nova.network.neutron [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:37:30 user nova-compute[75745]: DEBUG nova.compute.manager [req-745df35b-919f-4713-9cfb-c73f74b65ad1 req-6305c937-e4e6-41cb-b088-7bbd077f167e service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Received event network-changed-a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:37:30 user nova-compute[75745]: DEBUG nova.compute.manager [req-745df35b-919f-4713-9cfb-c73f74b65ad1 req-6305c937-e4e6-41cb-b088-7bbd077f167e service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Refreshing instance network info cache due to event network-changed-a65d94d0-bf0b-4d66-981e-de1b674507a5. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:37:30 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-745df35b-919f-4713-9cfb-c73f74b65ad1 req-6305c937-e4e6-41cb-b088-7bbd077f167e service nova] Acquiring lock "refresh_cache-3da51c15-816b-40cd-9315-11a48d0f344c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG nova.network.neutron [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Updating instance_info_cache with network_info: [{"id": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "address": "fa:16:3e:17:60:43", "network": {"id": "a3a76c7a-2282-4faa-ae5e-0caddf88001d", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146905868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e00f4a99c2ae4a5aa9a456c186ea7cc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65d94d0-bf", "ovs_interfaceid": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Releasing lock "refresh_cache-3da51c15-816b-40cd-9315-11a48d0f344c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:37:31 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Creating image(s)
Dec 01 17:37:31 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Did not create local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Ensure instance console log exists: /opt/stack/data/nova/instances/3da51c15-816b-40cd-9315-11a48d0f344c/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Start _get_guest_xml network_info=[{"id": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "address": "fa:16:3e:17:60:43", "network": {"id": "a3a76c7a-2282-4faa-ae5e-0caddf88001d", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146905868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e00f4a99c2ae4a5aa9a456c186ea7cc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65d94d0-bf", "ovs_interfaceid": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': '563b1280-90ee-4b21-af33-348739332521', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NAyzDFru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3da51c15-816b-40cd-9315-11a48d0f344c', 'attached_at': '', 'detached_at': '', 'volume_id': '36817f6c-30a3-4ccb-b262-934a1e29f895', 'serial': '36817f6c-30a3-4ccb-b262-934a1e29f895'}, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-745df35b-919f-4713-9cfb-c73f74b65ad1 req-6305c937-e4e6-41cb-b088-7bbd077f167e service nova] Acquired lock "refresh_cache-3da51c15-816b-40cd-9315-11a48d0f344c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG nova.network.neutron [req-745df35b-919f-4713-9cfb-c73f74b65ad1 req-6305c937-e4e6-41cb-b088-7bbd077f167e service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Refreshing network info cache for port a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:37:31 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:37:31 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:37:31 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG nova.objects.instance [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3da51c15-816b-40cd-9315-11a48d0f344c {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG nova.objects.base [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Object Instance<3da51c15-816b-40cd-9315-11a48d0f344c> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NAyzDFru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:37:31 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:37:31 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:37:31 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:37:31 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:37:31 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[95dc6c6c-cf74-4f86-90a1-11f285355eef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:37:31 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[092a3099-435d-4ce8-b4d5-e84adee9206a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895] added
Dec 01 17:37:31 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ec27d7-4f8c-4dfb-957e-061ce9e40b95]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a9a06b-cfdb-40e2-a659-75e64bc57b42]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NAyzDFru {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NAyzDFru" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb86c563-7855-4d23-87d8-b3a26605cb6f]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NAyzDFru'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd9ebca-5f37-49a8-8d6f-57045e27dce9]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8b415d-cf71-4c1b-a40d-6f0215ae61a1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 01 17:37:31 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 01 17:37:31 user nova-compute[75745]:  {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:37:31 user nova-compute[75745]: WARNING os_brick.initiator.connectors.iscsi [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 01 17:37:31 user nova-compute[75745]: 
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04da004-3926-41bb-b7bc-fd8d05bb3d66]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895, portal: 172.16.0.220,3260]
Dec 01 17:37:31 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895, portal: 172.16.0.220,3260] successful.
Dec 01 17:37:31 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[10151fac-ceef-40f1-9dfc-a60c929d30ad]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc98afa2-9e12-48a9-a055-d5de7f11d382]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 (non-flash)
Dec 01 17:37:31 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 (non-flash)
Dec 01 17:37:31 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23ed001-3a9d-4205-8b7a-bc8ef675b8ef]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NAyzDFru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG nova.network.neutron [req-745df35b-919f-4713-9cfb-c73f74b65ad1 req-6305c937-e4e6-41cb-b088-7bbd077f167e service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Updated VIF entry in instance network info cache for port a65d94d0-bf0b-4d66-981e-de1b674507a5. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG nova.network.neutron [req-745df35b-919f-4713-9cfb-c73f74b65ad1 req-6305c937-e4e6-41cb-b088-7bbd077f167e service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Updating instance_info_cache with network_info: [{"id": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "address": "fa:16:3e:17:60:43", "network": {"id": "a3a76c7a-2282-4faa-ae5e-0caddf88001d", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146905868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e00f4a99c2ae4a5aa9a456c186ea7cc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65d94d0-bf", "ovs_interfaceid": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:37:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-745df35b-919f-4713-9cfb-c73f74b65ad1 req-6305c937-e4e6-41cb-b088-7bbd077f167e service nova] Releasing lock "refresh_cache-3da51c15-816b-40cd-9315-11a48d0f344c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:37:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:37:32 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23039666466323362', 'path': '/dev/sdb'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:37:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039666466323362', 'path': '/dev/sdb'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:37:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T17:33:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2147236562',display_name='tempest-TestShelveInstance-server-2147236562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2147236562',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1392571257',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:33:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e00f4a99c2ae4a5aa9a456c186ea7cc8',ramdisk_id='',reservation_id='r-ydabfpsw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1224578669',owner_user_name='tempest-TestShelveInstance-1224578669-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:37:18Z,user_data=None,user_id='b1debb66002b41749f6e12d5fd9722fc',uuid=3da51c15-816b-40cd-9315-11a48d0f344c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "address": "fa:16:3e:17:60:43", "network": {"id": "a3a76c7a-2282-4faa-ae5e-0caddf88001d", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146905868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e00f4a99c2ae4a5aa9a456c186ea7cc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65d94d0-bf", "ovs_interfaceid": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:37:32 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Converting VIF {"id": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "address": "fa:16:3e:17:60:43", "network": {"id": "a3a76c7a-2282-4faa-ae5e-0caddf88001d", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146905868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e00f4a99c2ae4a5aa9a456c186ea7cc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65d94d0-bf", "ovs_interfaceid": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:37:32 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:60:43,bridge_name='br-int',has_traffic_filtering=True,id=a65d94d0-bf0b-4d66-981e-de1b674507a5,network=Network(a3a76c7a-2282-4faa-ae5e-0caddf88001d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65d94d0-bf') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:37:32 user nova-compute[75745]: DEBUG nova.objects.instance [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lazy-loading 'pci_devices' on Instance uuid 3da51c15-816b-40cd-9315-11a48d0f344c {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:37:32 user nova-compute[75745]: DEBUG nova.objects.base [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Object Instance<3da51c15-816b-40cd-9315-11a48d0f344c> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:37:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:37:32 user nova-compute[75745]:   <uuid>3da51c15-816b-40cd-9315-11a48d0f344c</uuid>
Dec 01 17:37:32 user nova-compute[75745]:   <name>instance-0000002a</name>
Dec 01 17:37:32 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:37:32 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:37:32 user nova-compute[75745]:   <metadata>
Dec 01 17:37:32 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:37:32 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:37:32 user nova-compute[75745]:       <nova:name>tempest-TestShelveInstance-server-2147236562</nova:name>
Dec 01 17:37:32 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:37:31</nova:creationTime>
Dec 01 17:37:32 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:37:32 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:37:32 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:37:32 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:37:32 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:37:32 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:37:32 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:37:32 user nova-compute[75745]:       <nova:owner>
Dec 01 17:37:32 user nova-compute[75745]:         <nova:user uuid="b1debb66002b41749f6e12d5fd9722fc">tempest-TestShelveInstance-1224578669-project-member</nova:user>
Dec 01 17:37:32 user nova-compute[75745]:         <nova:project uuid="e00f4a99c2ae4a5aa9a456c186ea7cc8">tempest-TestShelveInstance-1224578669</nova:project>
Dec 01 17:37:32 user nova-compute[75745]:       </nova:owner>
Dec 01 17:37:32 user nova-compute[75745]:       <nova:ports>
Dec 01 17:37:32 user nova-compute[75745]:         <nova:port uuid="a65d94d0-bf0b-4d66-981e-de1b674507a5">
Dec 01 17:37:32 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 01 17:37:32 user nova-compute[75745]:         </nova:port>
Dec 01 17:37:32 user nova-compute[75745]:       </nova:ports>
Dec 01 17:37:32 user nova-compute[75745]:     </nova:instance>
Dec 01 17:37:32 user nova-compute[75745]:   </metadata>
Dec 01 17:37:32 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:37:32 user nova-compute[75745]:     <system>
Dec 01 17:37:32 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:37:32 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:37:32 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:37:32 user nova-compute[75745]:       <entry name="serial">3da51c15-816b-40cd-9315-11a48d0f344c</entry>
Dec 01 17:37:32 user nova-compute[75745]:       <entry name="uuid">3da51c15-816b-40cd-9315-11a48d0f344c</entry>
Dec 01 17:37:32 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:37:32 user nova-compute[75745]:     </system>
Dec 01 17:37:32 user nova-compute[75745]:   </sysinfo>
Dec 01 17:37:32 user nova-compute[75745]:   <os>
Dec 01 17:37:32 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:37:32 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:37:32 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:37:32 user nova-compute[75745]:   </os>
Dec 01 17:37:32 user nova-compute[75745]:   <features>
Dec 01 17:37:32 user nova-compute[75745]:     <acpi/>
Dec 01 17:37:32 user nova-compute[75745]:     <apic/>
Dec 01 17:37:32 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:37:32 user nova-compute[75745]:   </features>
Dec 01 17:37:32 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:37:32 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:37:32 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:37:32 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:37:32 user nova-compute[75745]:   </clock>
Dec 01 17:37:32 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:37:32 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:37:32 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:37:32 user nova-compute[75745]:   </cpu>
Dec 01 17:37:32 user nova-compute[75745]:   <devices>
Dec 01 17:37:32 user nova-compute[75745]:     <disk type="block" device="disk">
Dec 01 17:37:32 user nova-compute[75745]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:37:32 user nova-compute[75745]:       <source dev="/dev/sdb"/>
Dec 01 17:37:32 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:37:32 user nova-compute[75745]:       <serial>36817f6c-30a3-4ccb-b262-934a1e29f895</serial>
Dec 01 17:37:32 user nova-compute[75745]:     </disk>
Dec 01 17:37:32 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:37:32 user nova-compute[75745]:       <mac address="fa:16:3e:17:60:43"/>
Dec 01 17:37:32 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:37:32 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:37:32 user nova-compute[75745]:       <target dev="tapa65d94d0-bf"/>
Dec 01 17:37:32 user nova-compute[75745]:     </interface>
Dec 01 17:37:32 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:37:32 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/3da51c15-816b-40cd-9315-11a48d0f344c/console.log" append="off"/>
Dec 01 17:37:32 user nova-compute[75745]:     </serial>
Dec 01 17:37:32 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:37:32 user nova-compute[75745]:     <video>
Dec 01 17:37:32 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:37:32 user nova-compute[75745]:     </video>
Dec 01 17:37:32 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:37:32 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:37:32 user nova-compute[75745]:     </rng>
Dec 01 17:37:32 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:37:32 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:37:32 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:37:32 user nova-compute[75745]:     </memballoon>
Dec 01 17:37:32 user nova-compute[75745]:   </devices>
Dec 01 17:37:32 user nova-compute[75745]: </domain>
Dec 01 17:37:32 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:37:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T17:33:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2147236562',display_name='tempest-TestShelveInstance-server-2147236562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2147236562',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1392571257',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:33:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e00f4a99c2ae4a5aa9a456c186ea7cc8',ramdisk_id='',reservation_id='r-ydabfpsw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1224578669',owner_user_name='tempest-TestShelveInstance-1224578669-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:37:18Z,user_data=None,user_id='b1debb66002b41749f6e12d5fd9722fc',uuid=3da51c15-816b-40cd-9315-11a48d0f344c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "address": "fa:16:3e:17:60:43", "network": {"id": "a3a76c7a-2282-4faa-ae5e-0caddf88001d", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146905868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e00f4a99c2ae4a5aa9a456c186ea7cc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65d94d0-bf", "ovs_interfaceid": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:37:32 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Converting VIF {"id": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "address": "fa:16:3e:17:60:43", "network": {"id": "a3a76c7a-2282-4faa-ae5e-0caddf88001d", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146905868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e00f4a99c2ae4a5aa9a456c186ea7cc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65d94d0-bf", "ovs_interfaceid": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:37:32 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:60:43,bridge_name='br-int',has_traffic_filtering=True,id=a65d94d0-bf0b-4d66-981e-de1b674507a5,network=Network(a3a76c7a-2282-4faa-ae5e-0caddf88001d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65d94d0-bf') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:37:32 user nova-compute[75745]: DEBUG os_vif [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:60:43,bridge_name='br-int',has_traffic_filtering=True,id=a65d94d0-bf0b-4d66-981e-de1b674507a5,network=Network(a3a76c7a-2282-4faa-ae5e-0caddf88001d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65d94d0-bf') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:37:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:37:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:37:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e961dfad-046e-549c-97c0-f262d0d13ccd', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:37:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:37:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa65d94d0-bf, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:37:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa65d94d0-bf, col_values=(('qos', UUID('a1e979b9-655a-4be8-ac8a-f9df85b87889')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:37:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa65d94d0-bf, col_values=(('external_ids', {'iface-id': 'a65d94d0-bf0b-4d66-981e-de1b674507a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:60:43', 'vm-uuid': '3da51c15-816b-40cd-9315-11a48d0f344c'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:37:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:37:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:32 user nova-compute[75745]: INFO os_vif [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:60:43,bridge_name='br-int',has_traffic_filtering=True,id=a65d94d0-bf0b-4d66-981e-de1b674507a5,network=Network(a3a76c7a-2282-4faa-ae5e-0caddf88001d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65d94d0-bf')
Dec 01 17:37:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:37:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] No VIF found with MAC fa:16:3e:17:60:43, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:37:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:33 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-02d0c393-68ab-4458-8c27-5fb179429429 req-f5d53065-8053-4c5a-bef7-e7e07eb0168f service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Received event network-vif-plugged-a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:37:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-02d0c393-68ab-4458-8c27-5fb179429429 req-f5d53065-8053-4c5a-bef7-e7e07eb0168f service nova] Acquiring lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:37:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-02d0c393-68ab-4458-8c27-5fb179429429 req-f5d53065-8053-4c5a-bef7-e7e07eb0168f service nova] Lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:37:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-02d0c393-68ab-4458-8c27-5fb179429429 req-f5d53065-8053-4c5a-bef7-e7e07eb0168f service nova] Lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:37:34 user nova-compute[75745]: DEBUG nova.compute.manager [req-02d0c393-68ab-4458-8c27-5fb179429429 req-f5d53065-8053-4c5a-bef7-e7e07eb0168f service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] No waiting events found dispatching network-vif-plugged-a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:37:34 user nova-compute[75745]: WARNING nova.compute.manager [req-02d0c393-68ab-4458-8c27-5fb179429429 req-f5d53065-8053-4c5a-bef7-e7e07eb0168f service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Received unexpected event network-vif-plugged-a65d94d0-bf0b-4d66-981e-de1b674507a5 for instance with vm_state shelved_offloaded and task_state spawning.
Dec 01 17:37:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:36 user nova-compute[75745]: DEBUG nova.compute.manager [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:37:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:37:36 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Instance spawned successfully.
Dec 01 17:37:36 user nova-compute[75745]: DEBUG nova.compute.manager [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:37:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-ed6e5271-d4f1-4cd3-b8c9-5cf9662ec83d tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lock "3da51c15-816b-40cd-9315-11a48d0f344c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.412s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:37:36 user nova-compute[75745]: DEBUG nova.compute.manager [req-3db1b2fa-e7de-4de3-8fa8-aa4820b93c16 req-97fdf176-c153-4e4e-bfc1-407ef96ec0da service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Received event network-vif-plugged-a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:37:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3db1b2fa-e7de-4de3-8fa8-aa4820b93c16 req-97fdf176-c153-4e4e-bfc1-407ef96ec0da service nova] Acquiring lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:37:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3db1b2fa-e7de-4de3-8fa8-aa4820b93c16 req-97fdf176-c153-4e4e-bfc1-407ef96ec0da service nova] Lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:37:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3db1b2fa-e7de-4de3-8fa8-aa4820b93c16 req-97fdf176-c153-4e4e-bfc1-407ef96ec0da service nova] Lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:37:36 user nova-compute[75745]: DEBUG nova.compute.manager [req-3db1b2fa-e7de-4de3-8fa8-aa4820b93c16 req-97fdf176-c153-4e4e-bfc1-407ef96ec0da service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] No waiting events found dispatching network-vif-plugged-a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:37:36 user nova-compute[75745]: WARNING nova.compute.manager [req-3db1b2fa-e7de-4de3-8fa8-aa4820b93c16 req-97fdf176-c153-4e4e-bfc1-407ef96ec0da service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Received unexpected event network-vif-plugged-a65d94d0-bf0b-4d66-981e-de1b674507a5 for instance with vm_state active and task_state None.
Dec 01 17:37:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:37:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:37:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:37:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:37:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:37:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b7e42250-150d-4b17-8804-097151beb242 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "5e631ac3-8122-46a3-a54f-2395c0f7cf7c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:37:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b7e42250-150d-4b17-8804-097151beb242 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "5e631ac3-8122-46a3-a54f-2395c0f7cf7c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:37:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b7e42250-150d-4b17-8804-097151beb242 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "5e631ac3-8122-46a3-a54f-2395c0f7cf7c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:37:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b7e42250-150d-4b17-8804-097151beb242 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "5e631ac3-8122-46a3-a54f-2395c0f7cf7c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:37:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b7e42250-150d-4b17-8804-097151beb242 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "5e631ac3-8122-46a3-a54f-2395c0f7cf7c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:37:54 user nova-compute[75745]: INFO nova.compute.manager [None req-b7e42250-150d-4b17-8804-097151beb242 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Terminating instance
Dec 01 17:37:54 user nova-compute[75745]: DEBUG nova.compute.manager [None req-b7e42250-150d-4b17-8804-097151beb242 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:37:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:55 user nova-compute[75745]: DEBUG nova.compute.manager [req-fb6c8555-bc79-460b-a3a3-d94aec7fad50 req-a67b119f-0d35-45c9-8b1d-c322f3b4e0c2 service nova] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Received event network-vif-unplugged-7239781d-a3ed-42f7-a30b-d8e5410bc622 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:37:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fb6c8555-bc79-460b-a3a3-d94aec7fad50 req-a67b119f-0d35-45c9-8b1d-c322f3b4e0c2 service nova] Acquiring lock "5e631ac3-8122-46a3-a54f-2395c0f7cf7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:37:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fb6c8555-bc79-460b-a3a3-d94aec7fad50 req-a67b119f-0d35-45c9-8b1d-c322f3b4e0c2 service nova] Lock "5e631ac3-8122-46a3-a54f-2395c0f7cf7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:37:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fb6c8555-bc79-460b-a3a3-d94aec7fad50 req-a67b119f-0d35-45c9-8b1d-c322f3b4e0c2 service nova] Lock "5e631ac3-8122-46a3-a54f-2395c0f7cf7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:37:55 user nova-compute[75745]: DEBUG nova.compute.manager [req-fb6c8555-bc79-460b-a3a3-d94aec7fad50 req-a67b119f-0d35-45c9-8b1d-c322f3b4e0c2 service nova] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] No waiting events found dispatching network-vif-unplugged-7239781d-a3ed-42f7-a30b-d8e5410bc622 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:37:55 user nova-compute[75745]: DEBUG nova.compute.manager [req-fb6c8555-bc79-460b-a3a3-d94aec7fad50 req-a67b119f-0d35-45c9-8b1d-c322f3b4e0c2 service nova] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Received event network-vif-unplugged-7239781d-a3ed-42f7-a30b-d8e5410bc622 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:37:55 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Instance destroyed successfully.
Dec 01 17:37:55 user nova-compute[75745]: DEBUG nova.objects.instance [None req-b7e42250-150d-4b17-8804-097151beb242 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lazy-loading 'resources' on Instance uuid 5e631ac3-8122-46a3-a54f-2395c0f7cf7c {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:37:55 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-b7e42250-150d-4b17-8804-097151beb242 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1743880248',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1743880248',id=30,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:18:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='adb3ba16695543cab6f10932fd6b2d2d',ramdisk_id='',reservation_id='r-709b8qsw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-90723689',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:20:14Z,user_data=None,user_id='b319a47b86c04affa1858e1c2359876b',uuid=5e631ac3-8122-46a3-a54f-2395c0f7cf7c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7239781d-a3ed-42f7-a30b-d8e5410bc622", "address": "fa:16:3e:0a:8d:a9", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7239781d-a3", "ovs_interfaceid": "7239781d-a3ed-42f7-a30b-d8e5410bc622", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:37:55 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-b7e42250-150d-4b17-8804-097151beb242 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Converting VIF {"id": "7239781d-a3ed-42f7-a30b-d8e5410bc622", "address": "fa:16:3e:0a:8d:a9", "network": {"id": "bf1db63d-d427-41c2-ac82-6fab9483a423", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2011798092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb3ba16695543cab6f10932fd6b2d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7239781d-a3", "ovs_interfaceid": "7239781d-a3ed-42f7-a30b-d8e5410bc622", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:37:55 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-b7e42250-150d-4b17-8804-097151beb242 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:8d:a9,bridge_name='br-int',has_traffic_filtering=True,id=7239781d-a3ed-42f7-a30b-d8e5410bc622,network=Network(bf1db63d-d427-41c2-ac82-6fab9483a423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7239781d-a3') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:37:55 user nova-compute[75745]: DEBUG os_vif [None req-b7e42250-150d-4b17-8804-097151beb242 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:8d:a9,bridge_name='br-int',has_traffic_filtering=True,id=7239781d-a3ed-42f7-a30b-d8e5410bc622,network=Network(bf1db63d-d427-41c2-ac82-6fab9483a423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7239781d-a3') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:37:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7239781d-a3, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:37:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:37:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=710e210f-f769-4750-b816-cc27499f4210) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:37:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:37:55 user nova-compute[75745]: INFO os_vif [None req-b7e42250-150d-4b17-8804-097151beb242 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:8d:a9,bridge_name='br-int',has_traffic_filtering=True,id=7239781d-a3ed-42f7-a30b-d8e5410bc622,network=Network(bf1db63d-d427-41c2-ac82-6fab9483a423),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7239781d-a3')
Dec 01 17:37:55 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-b7e42250-150d-4b17-8804-097151beb242 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Deleting instance files /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c_del
Dec 01 17:37:55 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-b7e42250-150d-4b17-8804-097151beb242 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Deletion of /opt/stack/data/nova/instances/5e631ac3-8122-46a3-a54f-2395c0f7cf7c_del complete
Dec 01 17:37:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:37:55 user nova-compute[75745]: INFO nova.compute.manager [None req-b7e42250-150d-4b17-8804-097151beb242 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Took 0.88 seconds to destroy the instance on the hypervisor.
Dec 01 17:37:55 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-b7e42250-150d-4b17-8804-097151beb242 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:37:55 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:37:55 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:37:56 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:37:56 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Took 0.52 seconds to deallocate network for instance.
Dec 01 17:37:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-9d7bf5ac-0384-47e6-a2ba-1c3fcf891925 req-6d79deb4-9b57-4680-8dbe-01fa1803e6e0 service nova] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Received event network-vif-deleted-7239781d-a3ed-42f7-a30b-d8e5410bc622 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:37:56 user nova-compute[75745]: INFO nova.compute.manager [req-9d7bf5ac-0384-47e6-a2ba-1c3fcf891925 req-6d79deb4-9b57-4680-8dbe-01fa1803e6e0 service nova] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Neutron deleted interface 7239781d-a3ed-42f7-a30b-d8e5410bc622; detaching it from the instance and deleting it from the info cache
Dec 01 17:37:56 user nova-compute[75745]: DEBUG nova.network.neutron [req-9d7bf5ac-0384-47e6-a2ba-1c3fcf891925 req-6d79deb4-9b57-4680-8dbe-01fa1803e6e0 service nova] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:37:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-9d7bf5ac-0384-47e6-a2ba-1c3fcf891925 req-6d79deb4-9b57-4680-8dbe-01fa1803e6e0 service nova] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Detach interface failed, port_id=7239781d-a3ed-42f7-a30b-d8e5410bc622, reason: Instance 5e631ac3-8122-46a3-a54f-2395c0f7cf7c could not be found. {{(pid=75745) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 17:37:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b7e42250-150d-4b17-8804-097151beb242 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:37:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b7e42250-150d-4b17-8804-097151beb242 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:37:56 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-b7e42250-150d-4b17-8804-097151beb242 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:37:56 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-b7e42250-150d-4b17-8804-097151beb242 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:37:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b7e42250-150d-4b17-8804-097151beb242 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:37:56 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-b7e42250-150d-4b17-8804-097151beb242 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Deleted allocations for instance 5e631ac3-8122-46a3-a54f-2395c0f7cf7c
Dec 01 17:37:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b7e42250-150d-4b17-8804-097151beb242 tempest-ServerBootFromVolumeStableRescueTest-90723689 tempest-ServerBootFromVolumeStableRescueTest-90723689-project-member] Lock "5e631ac3-8122-46a3-a54f-2395c0f7cf7c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.780s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:37:57 user nova-compute[75745]: DEBUG nova.compute.manager [req-1bc7da58-9e80-4e74-9b80-de743e3f9a03 req-61024459-b669-46c8-b0b8-fde4f2709d1d service nova] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Received event network-vif-plugged-7239781d-a3ed-42f7-a30b-d8e5410bc622 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:37:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1bc7da58-9e80-4e74-9b80-de743e3f9a03 req-61024459-b669-46c8-b0b8-fde4f2709d1d service nova] Acquiring lock "5e631ac3-8122-46a3-a54f-2395c0f7cf7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:37:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1bc7da58-9e80-4e74-9b80-de743e3f9a03 req-61024459-b669-46c8-b0b8-fde4f2709d1d service nova] Lock "5e631ac3-8122-46a3-a54f-2395c0f7cf7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:37:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1bc7da58-9e80-4e74-9b80-de743e3f9a03 req-61024459-b669-46c8-b0b8-fde4f2709d1d service nova] Lock "5e631ac3-8122-46a3-a54f-2395c0f7cf7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:37:57 user nova-compute[75745]: DEBUG nova.compute.manager [req-1bc7da58-9e80-4e74-9b80-de743e3f9a03 req-61024459-b669-46c8-b0b8-fde4f2709d1d service nova] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] No waiting events found dispatching network-vif-plugged-7239781d-a3ed-42f7-a30b-d8e5410bc622 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:37:57 user nova-compute[75745]: WARNING nova.compute.manager [req-1bc7da58-9e80-4e74-9b80-de743e3f9a03 req-61024459-b669-46c8-b0b8-fde4f2709d1d service nova] [instance: 5e631ac3-8122-46a3-a54f-2395c0f7cf7c] Received unexpected event network-vif-plugged-7239781d-a3ed-42f7-a30b-d8e5410bc622 for instance with vm_state deleted and task_state None.
Dec 01 17:37:59 user nova-compute[75745]: DEBUG nova.compute.manager [req-458e73ae-3724-4a88-9346-2a21e0dd6a78 req-bc4b84e8-4f78-4f1e-b691-b9e1f39ef6bb service nova] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Received event network-changed-964bbd9c-d6ac-462c-8342-f565c3ab2934 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:37:59 user nova-compute[75745]: DEBUG nova.compute.manager [req-458e73ae-3724-4a88-9346-2a21e0dd6a78 req-bc4b84e8-4f78-4f1e-b691-b9e1f39ef6bb service nova] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Refreshing instance network info cache due to event network-changed-964bbd9c-d6ac-462c-8342-f565c3ab2934. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:37:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-458e73ae-3724-4a88-9346-2a21e0dd6a78 req-bc4b84e8-4f78-4f1e-b691-b9e1f39ef6bb service nova] Acquiring lock "refresh_cache-3c990a0a-188a-4973-846a-d09c98918500" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:37:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-458e73ae-3724-4a88-9346-2a21e0dd6a78 req-bc4b84e8-4f78-4f1e-b691-b9e1f39ef6bb service nova] Acquired lock "refresh_cache-3c990a0a-188a-4973-846a-d09c98918500" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:37:59 user nova-compute[75745]: DEBUG nova.network.neutron [req-458e73ae-3724-4a88-9346-2a21e0dd6a78 req-bc4b84e8-4f78-4f1e-b691-b9e1f39ef6bb service nova] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Refreshing network info cache for port 964bbd9c-d6ac-462c-8342-f565c3ab2934 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:37:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Acquiring lock "3c990a0a-188a-4973-846a-d09c98918500" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:37:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "3c990a0a-188a-4973-846a-d09c98918500" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:37:59 user nova-compute[75745]: DEBUG nova.network.neutron [req-458e73ae-3724-4a88-9346-2a21e0dd6a78 req-bc4b84e8-4f78-4f1e-b691-b9e1f39ef6bb service nova] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Updated VIF entry in instance network info cache for port 964bbd9c-d6ac-462c-8342-f565c3ab2934. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:37:59 user nova-compute[75745]: DEBUG nova.network.neutron [req-458e73ae-3724-4a88-9346-2a21e0dd6a78 req-bc4b84e8-4f78-4f1e-b691-b9e1f39ef6bb service nova] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Updating instance_info_cache with network_info: [{"id": "964bbd9c-d6ac-462c-8342-f565c3ab2934", "address": "fa:16:3e:4a:af:e3", "network": {"id": "ab165176-5fd5-4df3-97fc-464c4a6891d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2005430003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0aff17da1db4afbb8563237035d13f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap964bbd9c-d6", "ovs_interfaceid": "964bbd9c-d6ac-462c-8342-f565c3ab2934", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:37:59 user nova-compute[75745]: DEBUG nova.objects.instance [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lazy-loading 'flavor' on Instance uuid 3c990a0a-188a-4973-846a-d09c98918500 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:37:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-458e73ae-3724-4a88-9346-2a21e0dd6a78 req-bc4b84e8-4f78-4f1e-b691-b9e1f39ef6bb service nova] Releasing lock "refresh_cache-3c990a0a-188a-4973-846a-d09c98918500" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:37:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "3c990a0a-188a-4973-846a-d09c98918500" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:38:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Acquiring lock "3c990a0a-188a-4973-846a-d09c98918500" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:38:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "3c990a0a-188a-4973-846a-d09c98918500" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:38:00 user nova-compute[75745]: INFO nova.compute.manager [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Attaching volume 33ae4695-05fe-411e-a8fd-3507486706fd to /dev/vdb
Dec 01 17:38:00 user nova-compute[75745]: DEBUG os_brick.utils [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:38:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:38:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:38:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[622924ef-e9a7-4359-9414-14a70a8220f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:38:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:38:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:38:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0100989-30f6-4532-bad2-88521cfef843]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:38:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:38:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:38:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceda4aff-ead1-418f-8437-45dac1721aa9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:38:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[16460556-417d-4b91-922c-2e0741ec8935]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:38:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:38:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:38:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:38:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:38:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:38:00 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:38:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc701479-f7ae-4515-a56f-fa3f490a4ee7]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:38:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:38:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:38:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:38:00 user nova-compute[75745]: DEBUG os_brick.utils [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:38:00 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Updating existing volume attachment record: 30a02b45-d5f3-454e-a81d-921d1269760a {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:38:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:38:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:38:03 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:38:04 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:38:04 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:38:04 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:38:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:38:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:38:05 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:38:06 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:38:07 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:38:07 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:38:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:38:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:38:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:38:07 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:38:08 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:38:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:38:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:38:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:38:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:38:08 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:38:08 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:38:08 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=8746MB free_disk=25.245349884033203GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:38:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:38:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:38:08 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 3c990a0a-188a-4973-846a-d09c98918500 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:38:08 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 3da51c15-816b-40cd-9315-11a48d0f344c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:38:08 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:38:08 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:38:08 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Refreshing inventories for resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Updating ProviderTree inventory for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Updating inventory in ProviderTree for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Refreshing aggregate associations for resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9, aggregates: None {{(pid=75745) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Refreshing trait associations for resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9, traits: COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=75745) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.482s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KnJvYhwX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:38:09 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:38:09 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:38:09 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:38:09 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:38:09 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:38:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cd5ff7-2235-4220-823d-75ae27bef873]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:38:09 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[421b5c6f-8135-46da-a1ab-2b62a726fc0b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd] added
Dec 01 17:38:09 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bbb9f6-02b2-43ff-8ddf-ba4d865d7d94]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9836687b-58f5-4bdb-ac32-d2d1a64ba2d5]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KnJvYhwX {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KnJvYhwX" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1ac2fb-aeca-4a67-b4f0-9a78966ee821]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KnJvYhwX'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8685f79e-793a-4228-8fea-4a7467aad894]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b532495-9e95-40a3-8841-b6742f1f5e07]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 (non-flash)
Dec 01 17:38:09 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 (non-flash)
Dec 01 17:38:09 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbcec55-d170-4e16-949d-48038392740e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd, portal: 172.16.0.220,3260]
Dec 01 17:38:09 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd, portal: 172.16.0.220,3260] successful.
Dec 01 17:38:09 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d834260-9ccb-4eff-96e4-82d99975a936]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ed0a08-d41c-4ded-bc58-7ca25a5bf4d5]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 (non-flash)
Dec 01 17:38:09 user nova-compute[75745]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd (non-flash)
Dec 01 17:38:09 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 (non-flash)
Dec 01 17:38:09 user nova-compute[75745]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd (non-flash)
Dec 01 17:38:09 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a7c402-3f50-4838-8c82-827dd97e2f40]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:38:09 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: None {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:38:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:38:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:38:10 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:38:10 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KnJvYhwX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:38:10 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:38:10 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26632343465356234', 'path': '/dev/sdc'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:38:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632343465356234', 'path': '/dev/sdc'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:38:10 user nova-compute[75745]: DEBUG nova.objects.instance [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lazy-loading 'flavor' on Instance uuid 3c990a0a-188a-4973-846a-d09c98918500 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:38:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 17:38:10 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:38:10 user nova-compute[75745]:   <source dev="/dev/sdc"/>
Dec 01 17:38:10 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:38:10 user nova-compute[75745]:   <serial>33ae4695-05fe-411e-a8fd-3507486706fd</serial>
Dec 01 17:38:10 user nova-compute[75745]: </disk>
Dec 01 17:38:10 user nova-compute[75745]:  {{(pid=75745) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 17:38:11 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:38:11 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:38:11 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] No VIF found with MAC fa:16:3e:4a:af:e3, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:38:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-55d411ea-f35b-45fc-9a3f-26be0b8ac4d4 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "3c990a0a-188a-4973-846a-d09c98918500" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.209s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:38:12 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:38:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Acquiring lock "3c990a0a-188a-4973-846a-d09c98918500" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:38:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "3c990a0a-188a-4973-846a-d09c98918500" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:38:13 user nova-compute[75745]: INFO nova.compute.manager [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Detaching volume 33ae4695-05fe-411e-a8fd-3507486706fd
Dec 01 17:38:13 user nova-compute[75745]: INFO nova.virt.block_device [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Attempting to driver detach volume 33ae4695-05fe-411e-a8fd-3507486706fd from mountpoint /dev/vdb
Dec 01 17:38:13 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Attempting to detach device vdb from instance 3c990a0a-188a-4973-846a-d09c98918500 from the persistent domain config. {{(pid=75745) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 17:38:13 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:38:13 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:38:13 user nova-compute[75745]:   <source dev="/dev/sdc"/>
Dec 01 17:38:13 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:38:13 user nova-compute[75745]:   <serial>33ae4695-05fe-411e-a8fd-3507486706fd</serial>
Dec 01 17:38:13 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 17:38:13 user nova-compute[75745]: </disk>
Dec 01 17:38:13 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:38:13 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Successfully detached device vdb from instance 3c990a0a-188a-4973-846a-d09c98918500 from the persistent domain config.
Dec 01 17:38:13 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3c990a0a-188a-4973-846a-d09c98918500 from the live domain config. {{(pid=75745) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 17:38:13 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:38:13 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:38:13 user nova-compute[75745]:   <source dev="/dev/sdc"/>
Dec 01 17:38:13 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:38:13 user nova-compute[75745]:   <serial>33ae4695-05fe-411e-a8fd-3507486706fd</serial>
Dec 01 17:38:13 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 17:38:13 user nova-compute[75745]: </disk>
Dec 01 17:38:13 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:38:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3c990a0a-188a-4973-846a-d09c98918500 {{(pid=75745) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 17:38:14 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:38:14 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:38:14 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Rebuilding the list of instances to heal {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 17:38:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-3c990a0a-188a-4973-846a-d09c98918500" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:38:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-3c990a0a-188a-4973-846a-d09c98918500" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:38:14 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:38:14 user nova-compute[75745]: DEBUG nova.objects.instance [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lazy-loading 'info_cache' on Instance uuid 3c990a0a-188a-4973-846a-d09c98918500 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:38:15 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Updating instance_info_cache with network_info: [{"id": "964bbd9c-d6ac-462c-8342-f565c3ab2934", "address": "fa:16:3e:4a:af:e3", "network": {"id": "ab165176-5fd5-4df3-97fc-464c4a6891d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2005430003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0aff17da1db4afbb8563237035d13f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap964bbd9c-d6", "ovs_interfaceid": "964bbd9c-d6ac-462c-8342-f565c3ab2934", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:38:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-3c990a0a-188a-4973-846a-d09c98918500" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:38:15 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:38:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:38:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:38:20 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:38:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:38:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:38:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:38:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:38:34 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3c990a0a-188a-4973-846a-d09c98918500 is timed out.
Dec 01 17:38:34 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Successfully detached device vdb from instance 3c990a0a-188a-4973-846a-d09c98918500 from the live domain config.
Dec 01 17:38:34 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KnJvYhwX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:38:34 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:38:34 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2929dc40-34a0-40f8-a4d9-a392d574fcc6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:38:34 user nova-compute[75745]: No targets found.
Dec 01 17:38:34 user nova-compute[75745]: iSNS:
Dec 01 17:38:34 user nova-compute[75745]: No targets found.
Dec 01 17:38:34 user nova-compute[75745]: STATIC:
Dec 01 17:38:34 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd
Dec 01 17:38:34 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:38:34 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:38:34 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895
Dec 01 17:38:34 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:38:34 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:38:34 user nova-compute[75745]: FIRMWARE:
Dec 01 17:38:34 user nova-compute[75745]: No targets found.
Dec 01 17:38:34 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:38:34 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:38:34 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7ed68e-f9ba-407b-8968-682773319796]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd504ca2-5dac-4921-83de-6528e9bf04c4]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 (non-flash)
Dec 01 17:38:34 user nova-compute[75745]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd (non-flash)
Dec 01 17:38:34 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 (non-flash)
Dec 01 17:38:34 user nova-compute[75745]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd (non-flash)
Dec 01 17:38:34 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24dbd6b910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd'): ({'sdc'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Removing single pathed devices sdc {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1a5d50-04a4-4a20-9842-784d23f39c8e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac4b6ab-25a4-49ab-8be2-321740da7dbb]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Flushing IO for device /dev/sdc {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4dfc96-3fba-46b2-a1a9-069abc6fb3bb]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2451fe-7131-43ef-851d-2a289b62cc40]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] SCSI volumes sdc have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0880cee-680b-455a-853c-b6662248d037]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5972d5a4-a59f-4cb7-b184-1f192048a59b]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd, portal: 172.16.0.220,3260]
Dec 01 17:38:34 user nova-compute[75745]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd, portal: 172.16.0.220,3260] successful.
Dec 01 17:38:34 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ae4695-05fe-411e-a8fd-3507486706fd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4778fa-180b-4726-bca2-b5d464619e9b]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] <== disconnect_volume: return (313ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:38:34 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:38:35 user nova-compute[75745]: DEBUG nova.objects.instance [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lazy-loading 'flavor' on Instance uuid 3c990a0a-188a-4973-846a-d09c98918500 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:38:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-58319f47-efbf-43f8-9981-acb8cf124433 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "3c990a0a-188a-4973-846a-d09c98918500" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.658s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:38:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:38:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:38:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:38:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:38:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:38:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:38:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:38:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:38:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:38:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:38:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "3793542a-2aeb-48a8-98c9-a05755aa708e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:38:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "3793542a-2aeb-48a8-98c9-a05755aa708e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:38:57 user nova-compute[75745]: DEBUG nova.compute.manager [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:38:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:38:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:38:57 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:38:57 user nova-compute[75745]: INFO nova.compute.claims [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Claim successful on node user
Dec 01 17:38:57 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:38:57 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:38:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.240s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:38:57 user nova-compute[75745]: DEBUG nova.compute.manager [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:38:57 user nova-compute[75745]: DEBUG nova.compute.manager [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:38:57 user nova-compute[75745]: DEBUG nova.network.neutron [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:38:57 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:38:57 user nova-compute[75745]: DEBUG nova.compute.manager [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:38:58 user nova-compute[75745]: DEBUG nova.policy [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f78365cc1e11444db345efc5fe3cc502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1e7099305f4571804612f3a3d8befb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:38:58 user nova-compute[75745]: DEBUG nova.compute.manager [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:38:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:38:58 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Creating image(s)
Dec 01 17:38:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "/opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:38:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "/opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:38:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "/opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:38:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:38:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.177s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:38:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:38:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:38:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:38:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.167s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:38:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:38:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk 1073741824" returned: 0 in 0.052s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:38:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:38:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:38:58 user nova-compute[75745]: DEBUG nova.network.neutron [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Successfully created port: 6e0b2dc1-93ba-4f89-9059-51d908bd03c8 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:38:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.202s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:38:58 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:38:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:38:58 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:38:58 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Cannot resize image /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:38:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:38:58 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Ensure instance console log exists: /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:38:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:38:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:38:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.network.neutron [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Successfully updated port: 6e0b2dc1-93ba-4f89-9059-51d908bd03c8 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "refresh_cache-3793542a-2aeb-48a8-98c9-a05755aa708e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquired lock "refresh_cache-3793542a-2aeb-48a8-98c9-a05755aa708e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.network.neutron [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.network.neutron [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.compute.manager [req-e5dbd777-667f-42a5-a1a7-580ea4e70473 req-9cd1b983-b400-48db-82f7-bbaca359e353 service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Received event network-changed-6e0b2dc1-93ba-4f89-9059-51d908bd03c8 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.compute.manager [req-e5dbd777-667f-42a5-a1a7-580ea4e70473 req-9cd1b983-b400-48db-82f7-bbaca359e353 service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Refreshing instance network info cache due to event network-changed-6e0b2dc1-93ba-4f89-9059-51d908bd03c8. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e5dbd777-667f-42a5-a1a7-580ea4e70473 req-9cd1b983-b400-48db-82f7-bbaca359e353 service nova] Acquiring lock "refresh_cache-3793542a-2aeb-48a8-98c9-a05755aa708e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.network.neutron [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Updating instance_info_cache with network_info: [{"id": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "address": "fa:16:3e:08:eb:e0", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0b2dc1-93", "ovs_interfaceid": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Releasing lock "refresh_cache-3793542a-2aeb-48a8-98c9-a05755aa708e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.compute.manager [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Instance network_info: |[{"id": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "address": "fa:16:3e:08:eb:e0", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0b2dc1-93", "ovs_interfaceid": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e5dbd777-667f-42a5-a1a7-580ea4e70473 req-9cd1b983-b400-48db-82f7-bbaca359e353 service nova] Acquired lock "refresh_cache-3793542a-2aeb-48a8-98c9-a05755aa708e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.network.neutron [req-e5dbd777-667f-42a5-a1a7-580ea4e70473 req-9cd1b983-b400-48db-82f7-bbaca359e353 service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Refreshing network info cache for port 6e0b2dc1-93ba-4f89-9059-51d908bd03c8 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Start _get_guest_xml network_info=[{"id": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "address": "fa:16:3e:08:eb:e0", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0b2dc1-93", "ovs_interfaceid": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:38:59 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:38:59 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:38:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1003279284',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1003279284',id=44,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcQCSrwD4JtgfCYf4reZFDST8WTEo0dhy0owtKX6n8CWePIMWjMZaIRxx+5eriy40cQVQD7h7D5FYpkS/0KzeAes/NVzOnzK3FmwcemVryPyyRJbeWzwkcZhpDEIthh5w==',key_name='tempest-keypair-186142728',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b1e7099305f4571804612f3a3d8befb',ramdisk_id='',reservation_id='r-ngh0576r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1555393357',owner_user_name='tempest-AttachVolumeShelveTestJSON-1555393357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:38:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f78365cc1e11444db345efc5fe3cc502',uuid=3793542a-2aeb-48a8-98c9-a05755aa708e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "address": "fa:16:3e:08:eb:e0", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0b2dc1-93", "ovs_interfaceid": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Converting VIF {"id": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "address": "fa:16:3e:08:eb:e0", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0b2dc1-93", "ovs_interfaceid": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:eb:e0,bridge_name='br-int',has_traffic_filtering=True,id=6e0b2dc1-93ba-4f89-9059-51d908bd03c8,network=Network(773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e0b2dc1-93') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.objects.instance [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lazy-loading 'pci_devices' on Instance uuid 3793542a-2aeb-48a8-98c9-a05755aa708e {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:38:59 user nova-compute[75745]:   <uuid>3793542a-2aeb-48a8-98c9-a05755aa708e</uuid>
Dec 01 17:38:59 user nova-compute[75745]:   <name>instance-0000002c</name>
Dec 01 17:38:59 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:38:59 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:38:59 user nova-compute[75745]:   <metadata>
Dec 01 17:38:59 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:38:59 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:38:59 user nova-compute[75745]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1003279284</nova:name>
Dec 01 17:38:59 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:38:59</nova:creationTime>
Dec 01 17:38:59 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:38:59 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:38:59 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:38:59 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:38:59 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:38:59 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:38:59 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:38:59 user nova-compute[75745]:       <nova:owner>
Dec 01 17:38:59 user nova-compute[75745]:         <nova:user uuid="f78365cc1e11444db345efc5fe3cc502">tempest-AttachVolumeShelveTestJSON-1555393357-project-member</nova:user>
Dec 01 17:38:59 user nova-compute[75745]:         <nova:project uuid="2b1e7099305f4571804612f3a3d8befb">tempest-AttachVolumeShelveTestJSON-1555393357</nova:project>
Dec 01 17:38:59 user nova-compute[75745]:       </nova:owner>
Dec 01 17:38:59 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:38:59 user nova-compute[75745]:       <nova:ports>
Dec 01 17:38:59 user nova-compute[75745]:         <nova:port uuid="6e0b2dc1-93ba-4f89-9059-51d908bd03c8">
Dec 01 17:38:59 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 01 17:38:59 user nova-compute[75745]:         </nova:port>
Dec 01 17:38:59 user nova-compute[75745]:       </nova:ports>
Dec 01 17:38:59 user nova-compute[75745]:     </nova:instance>
Dec 01 17:38:59 user nova-compute[75745]:   </metadata>
Dec 01 17:38:59 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:38:59 user nova-compute[75745]:     <system>
Dec 01 17:38:59 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:38:59 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:38:59 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:38:59 user nova-compute[75745]:       <entry name="serial">3793542a-2aeb-48a8-98c9-a05755aa708e</entry>
Dec 01 17:38:59 user nova-compute[75745]:       <entry name="uuid">3793542a-2aeb-48a8-98c9-a05755aa708e</entry>
Dec 01 17:38:59 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:38:59 user nova-compute[75745]:     </system>
Dec 01 17:38:59 user nova-compute[75745]:   </sysinfo>
Dec 01 17:38:59 user nova-compute[75745]:   <os>
Dec 01 17:38:59 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:38:59 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:38:59 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:38:59 user nova-compute[75745]:   </os>
Dec 01 17:38:59 user nova-compute[75745]:   <features>
Dec 01 17:38:59 user nova-compute[75745]:     <acpi/>
Dec 01 17:38:59 user nova-compute[75745]:     <apic/>
Dec 01 17:38:59 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:38:59 user nova-compute[75745]:   </features>
Dec 01 17:38:59 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:38:59 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:38:59 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:38:59 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:38:59 user nova-compute[75745]:   </clock>
Dec 01 17:38:59 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:38:59 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:38:59 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:38:59 user nova-compute[75745]:   </cpu>
Dec 01 17:38:59 user nova-compute[75745]:   <devices>
Dec 01 17:38:59 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:38:59 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:38:59 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk"/>
Dec 01 17:38:59 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:38:59 user nova-compute[75745]:     </disk>
Dec 01 17:38:59 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:38:59 user nova-compute[75745]:       <mac address="fa:16:3e:08:eb:e0"/>
Dec 01 17:38:59 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:38:59 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:38:59 user nova-compute[75745]:       <target dev="tap6e0b2dc1-93"/>
Dec 01 17:38:59 user nova-compute[75745]:     </interface>
Dec 01 17:38:59 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:38:59 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/console.log" append="off"/>
Dec 01 17:38:59 user nova-compute[75745]:     </serial>
Dec 01 17:38:59 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:38:59 user nova-compute[75745]:     <video>
Dec 01 17:38:59 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:38:59 user nova-compute[75745]:     </video>
Dec 01 17:38:59 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:38:59 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:38:59 user nova-compute[75745]:     </rng>
Dec 01 17:38:59 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:38:59 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:38:59 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:38:59 user nova-compute[75745]:     </memballoon>
Dec 01 17:38:59 user nova-compute[75745]:   </devices>
Dec 01 17:38:59 user nova-compute[75745]: </domain>
Dec 01 17:38:59 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:38:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1003279284',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1003279284',id=44,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcQCSrwD4JtgfCYf4reZFDST8WTEo0dhy0owtKX6n8CWePIMWjMZaIRxx+5eriy40cQVQD7h7D5FYpkS/0KzeAes/NVzOnzK3FmwcemVryPyyRJbeWzwkcZhpDEIthh5w==',key_name='tempest-keypair-186142728',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b1e7099305f4571804612f3a3d8befb',ramdisk_id='',reservation_id='r-ngh0576r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1555393357',owner_user_name='tempest-AttachVolumeShelveTestJSON-1555393357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:38:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f78365cc1e11444db345efc5fe3cc502',uuid=3793542a-2aeb-48a8-98c9-a05755aa708e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "address": "fa:16:3e:08:eb:e0", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0b2dc1-93", "ovs_interfaceid": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Converting VIF {"id": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "address": "fa:16:3e:08:eb:e0", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0b2dc1-93", "ovs_interfaceid": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:eb:e0,bridge_name='br-int',has_traffic_filtering=True,id=6e0b2dc1-93ba-4f89-9059-51d908bd03c8,network=Network(773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e0b2dc1-93') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG os_vif [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:eb:e0,bridge_name='br-int',has_traffic_filtering=True,id=6e0b2dc1-93ba-4f89-9059-51d908bd03c8,network=Network(773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e0b2dc1-93') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '90ed5ac9-16da-56c7-95d7-ceb4b715421f', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e0b2dc1-93, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e0b2dc1-93, col_values=(('qos', UUID('7b50ba5d-a0c9-45df-a408-d608e2c164d0')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e0b2dc1-93, col_values=(('external_ids', {'iface-id': '6e0b2dc1-93ba-4f89-9059-51d908bd03c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:eb:e0', 'vm-uuid': '3793542a-2aeb-48a8-98c9-a05755aa708e'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:38:59 user nova-compute[75745]: INFO os_vif [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:eb:e0,bridge_name='br-int',has_traffic_filtering=True,id=6e0b2dc1-93ba-4f89-9059-51d908bd03c8,network=Network(773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e0b2dc1-93')
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] No VIF found with MAC fa:16:3e:08:eb:e0, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.network.neutron [req-e5dbd777-667f-42a5-a1a7-580ea4e70473 req-9cd1b983-b400-48db-82f7-bbaca359e353 service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Updated VIF entry in instance network info cache for port 6e0b2dc1-93ba-4f89-9059-51d908bd03c8. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:38:59 user nova-compute[75745]: DEBUG nova.network.neutron [req-e5dbd777-667f-42a5-a1a7-580ea4e70473 req-9cd1b983-b400-48db-82f7-bbaca359e353 service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Updating instance_info_cache with network_info: [{"id": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "address": "fa:16:3e:08:eb:e0", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0b2dc1-93", "ovs_interfaceid": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:39:00 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e5dbd777-667f-42a5-a1a7-580ea4e70473 req-9cd1b983-b400-48db-82f7-bbaca359e353 service nova] Releasing lock "refresh_cache-3793542a-2aeb-48a8-98c9-a05755aa708e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:39:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:01 user nova-compute[75745]: DEBUG nova.compute.manager [req-036b8aad-127b-4c98-b775-7fbf9ef859c3 req-98f15118-2ef1-4e01-b2c8-9a26607b2b0f service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Received event network-vif-plugged-6e0b2dc1-93ba-4f89-9059-51d908bd03c8 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:39:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-036b8aad-127b-4c98-b775-7fbf9ef859c3 req-98f15118-2ef1-4e01-b2c8-9a26607b2b0f service nova] Acquiring lock "3793542a-2aeb-48a8-98c9-a05755aa708e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:39:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-036b8aad-127b-4c98-b775-7fbf9ef859c3 req-98f15118-2ef1-4e01-b2c8-9a26607b2b0f service nova] Lock "3793542a-2aeb-48a8-98c9-a05755aa708e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:39:01 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-036b8aad-127b-4c98-b775-7fbf9ef859c3 req-98f15118-2ef1-4e01-b2c8-9a26607b2b0f service nova] Lock "3793542a-2aeb-48a8-98c9-a05755aa708e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:39:01 user nova-compute[75745]: DEBUG nova.compute.manager [req-036b8aad-127b-4c98-b775-7fbf9ef859c3 req-98f15118-2ef1-4e01-b2c8-9a26607b2b0f service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] No waiting events found dispatching network-vif-plugged-6e0b2dc1-93ba-4f89-9059-51d908bd03c8 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:39:01 user nova-compute[75745]: WARNING nova.compute.manager [req-036b8aad-127b-4c98-b775-7fbf9ef859c3 req-98f15118-2ef1-4e01-b2c8-9a26607b2b0f service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Received unexpected event network-vif-plugged-6e0b2dc1-93ba-4f89-9059-51d908bd03c8 for instance with vm_state building and task_state spawning.
Dec 01 17:39:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:03 user nova-compute[75745]: DEBUG nova.compute.manager [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:39:03 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:39:03 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Instance spawned successfully.
Dec 01 17:39:03 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:39:03 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:39:03 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:39:03 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:39:03 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:39:03 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:39:03 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:39:03 user nova-compute[75745]: DEBUG nova.compute.manager [req-ba3417c8-08e3-49f5-bc70-ad40e1fd3bed req-71c43126-a27e-49e9-8d49-c788a9b52f17 service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Received event network-vif-plugged-6e0b2dc1-93ba-4f89-9059-51d908bd03c8 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:39:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ba3417c8-08e3-49f5-bc70-ad40e1fd3bed req-71c43126-a27e-49e9-8d49-c788a9b52f17 service nova] Acquiring lock "3793542a-2aeb-48a8-98c9-a05755aa708e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:39:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ba3417c8-08e3-49f5-bc70-ad40e1fd3bed req-71c43126-a27e-49e9-8d49-c788a9b52f17 service nova] Lock "3793542a-2aeb-48a8-98c9-a05755aa708e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:39:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-ba3417c8-08e3-49f5-bc70-ad40e1fd3bed req-71c43126-a27e-49e9-8d49-c788a9b52f17 service nova] Lock "3793542a-2aeb-48a8-98c9-a05755aa708e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:39:03 user nova-compute[75745]: DEBUG nova.compute.manager [req-ba3417c8-08e3-49f5-bc70-ad40e1fd3bed req-71c43126-a27e-49e9-8d49-c788a9b52f17 service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] No waiting events found dispatching network-vif-plugged-6e0b2dc1-93ba-4f89-9059-51d908bd03c8 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:39:03 user nova-compute[75745]: WARNING nova.compute.manager [req-ba3417c8-08e3-49f5-bc70-ad40e1fd3bed req-71c43126-a27e-49e9-8d49-c788a9b52f17 service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Received unexpected event network-vif-plugged-6e0b2dc1-93ba-4f89-9059-51d908bd03c8 for instance with vm_state building and task_state spawning.
Dec 01 17:39:03 user nova-compute[75745]: INFO nova.compute.manager [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Took 5.26 seconds to spawn the instance on the hypervisor.
Dec 01 17:39:03 user nova-compute[75745]: DEBUG nova.compute.manager [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:39:03 user nova-compute[75745]: INFO nova.compute.manager [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Took 5.83 seconds to build instance.
Dec 01 17:39:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6886f564-eff1-4014-b1ac-76a6f80a9ab6 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "3793542a-2aeb-48a8-98c9-a05755aa708e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.929s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:39:03 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:39:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:05 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:39:05 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:39:05 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:39:05 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:39:07 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:39:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:39:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:39:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:39:07 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:39:08 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:39:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:39:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:39:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:39:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:39:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:39:08 user nova-compute[75745]: DEBUG nova.compute.manager [req-b27d9c0b-6a4c-47e8-a093-04b5a7ae24d8 req-facf7d89-4281-4046-ab46-9aa745408eee service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Received event network-changed-a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:39:08 user nova-compute[75745]: DEBUG nova.compute.manager [req-b27d9c0b-6a4c-47e8-a093-04b5a7ae24d8 req-facf7d89-4281-4046-ab46-9aa745408eee service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Refreshing instance network info cache due to event network-changed-a65d94d0-bf0b-4d66-981e-de1b674507a5. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:39:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b27d9c0b-6a4c-47e8-a093-04b5a7ae24d8 req-facf7d89-4281-4046-ab46-9aa745408eee service nova] Acquiring lock "refresh_cache-3da51c15-816b-40cd-9315-11a48d0f344c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:39:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b27d9c0b-6a4c-47e8-a093-04b5a7ae24d8 req-facf7d89-4281-4046-ab46-9aa745408eee service nova] Acquired lock "refresh_cache-3da51c15-816b-40cd-9315-11a48d0f344c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:39:08 user nova-compute[75745]: DEBUG nova.network.neutron [req-b27d9c0b-6a4c-47e8-a093-04b5a7ae24d8 req-facf7d89-4281-4046-ab46-9aa745408eee service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Refreshing network info cache for port a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:39:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Acquiring lock "3da51c15-816b-40cd-9315-11a48d0f344c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:39:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lock "3da51c15-816b-40cd-9315-11a48d0f344c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:39:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Acquiring lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:39:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:39:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:39:08 user nova-compute[75745]: INFO nova.compute.manager [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Terminating instance
Dec 01 17:39:08 user nova-compute[75745]: DEBUG nova.compute.manager [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:39:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:39:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:39:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:08 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG nova.compute.manager [req-dddb6d6b-bb62-4359-a96a-8610229a8bc7 req-d1f8ff2a-9770-46f3-a476-f28adf4a2b83 service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Received event network-vif-unplugged-a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-dddb6d6b-bb62-4359-a96a-8610229a8bc7 req-d1f8ff2a-9770-46f3-a476-f28adf4a2b83 service nova] Acquiring lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-dddb6d6b-bb62-4359-a96a-8610229a8bc7 req-d1f8ff2a-9770-46f3-a476-f28adf4a2b83 service nova] Lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-dddb6d6b-bb62-4359-a96a-8610229a8bc7 req-d1f8ff2a-9770-46f3-a476-f28adf4a2b83 service nova] Lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG nova.compute.manager [req-dddb6d6b-bb62-4359-a96a-8610229a8bc7 req-d1f8ff2a-9770-46f3-a476-f28adf4a2b83 service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] No waiting events found dispatching network-vif-unplugged-a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG nova.compute.manager [req-dddb6d6b-bb62-4359-a96a-8610229a8bc7 req-d1f8ff2a-9770-46f3-a476-f28adf4a2b83 service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Received event network-vif-unplugged-a65d94d0-bf0b-4d66-981e-de1b674507a5 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:39:09 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:39:09 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:39:09 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=8732MB free_disk=25.242618560791016GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:39:09 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Instance destroyed successfully.
Dec 01 17:39:09 user nova-compute[75745]: DEBUG nova.objects.instance [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lazy-loading 'resources' on Instance uuid 3da51c15-816b-40cd-9315-11a48d0f344c {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T17:33:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2147236562',display_name='tempest-TestShelveInstance-server-2147236562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2147236562',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0QLStMb44bOFyJh0Y7JMYnF245PrcTUhwJpczrTbimJc0K8uFLubP1uApKJ+yeuI5wm4aypb+b+Oyww0GNq5rEPIBSe4cmRHCIgIkKkNlqQCQ01utvvYTYd+Z8+6cExw==',key_name='tempest-TestShelveInstance-1392571257',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:37:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e00f4a99c2ae4a5aa9a456c186ea7cc8',ramdisk_id='',reservation_id='r-ydabfpsw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1224578669',owner_user_name='tempest-TestShelveInstance-1224578669-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:37:36Z,user_data=None,user_id='b1debb66002b41749f6e12d5fd9722fc',uuid=3da51c15-816b-40cd-9315-11a48d0f344c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "address": "fa:16:3e:17:60:43", "network": {"id": "a3a76c7a-2282-4faa-ae5e-0caddf88001d", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146905868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e00f4a99c2ae4a5aa9a456c186ea7cc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65d94d0-bf", "ovs_interfaceid": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Converting VIF {"id": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "address": "fa:16:3e:17:60:43", "network": {"id": "a3a76c7a-2282-4faa-ae5e-0caddf88001d", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146905868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e00f4a99c2ae4a5aa9a456c186ea7cc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65d94d0-bf", "ovs_interfaceid": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:60:43,bridge_name='br-int',has_traffic_filtering=True,id=a65d94d0-bf0b-4d66-981e-de1b674507a5,network=Network(a3a76c7a-2282-4faa-ae5e-0caddf88001d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65d94d0-bf') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG os_vif [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:60:43,bridge_name='br-int',has_traffic_filtering=True,id=a65d94d0-bf0b-4d66-981e-de1b674507a5,network=Network(a3a76c7a-2282-4faa-ae5e-0caddf88001d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65d94d0-bf') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa65d94d0-bf, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a1e979b9-655a-4be8-ac8a-f9df85b87889) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:39:09 user nova-compute[75745]: INFO os_vif [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:60:43,bridge_name='br-int',has_traffic_filtering=True,id=a65d94d0-bf0b-4d66-981e-de1b674507a5,network=Network(a3a76c7a-2282-4faa-ae5e-0caddf88001d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa65d94d0-bf')
Dec 01 17:39:09 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NAyzDFru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:39:09 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:39:09 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8471cb8-b936-43fb-abbd-0b209500b309]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:39:09 user nova-compute[75745]: No targets found.
Dec 01 17:39:09 user nova-compute[75745]: iSNS:
Dec 01 17:39:09 user nova-compute[75745]: No targets found.
Dec 01 17:39:09 user nova-compute[75745]: STATIC:
Dec 01 17:39:09 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895
Dec 01 17:39:09 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:39:09 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:39:09 user nova-compute[75745]: FIRMWARE:
Dec 01 17:39:09 user nova-compute[75745]: No targets found.
Dec 01 17:39:09 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:39:09 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:39:09 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG nova.compute.manager [None req-89e5a805-a4ec-4eb9-834d-1cd9c652291a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG nova.network.neutron [req-b27d9c0b-6a4c-47e8-a093-04b5a7ae24d8 req-facf7d89-4281-4046-ab46-9aa745408eee service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Updated VIF entry in instance network info cache for port a65d94d0-bf0b-4d66-981e-de1b674507a5. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG nova.network.neutron [req-b27d9c0b-6a4c-47e8-a093-04b5a7ae24d8 req-facf7d89-4281-4046-ab46-9aa745408eee service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Updating instance_info_cache with network_info: [{"id": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "address": "fa:16:3e:17:60:43", "network": {"id": "a3a76c7a-2282-4faa-ae5e-0caddf88001d", "bridge": "br-int", "label": "tempest-TestShelveInstance-2146905868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e00f4a99c2ae4a5aa9a456c186ea7cc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa65d94d0-bf", "ovs_interfaceid": "a65d94d0-bf0b-4d66-981e-de1b674507a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b27d9c0b-6a4c-47e8-a093-04b5a7ae24d8 req-facf7d89-4281-4046-ab46-9aa745408eee service nova] Releasing lock "refresh_cache-3da51c15-816b-40cd-9315-11a48d0f344c" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6248bb5-9881-4e14-a371-f1919aff9b21]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 3c990a0a-188a-4973-846a-d09c98918500 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 3da51c15-816b-40cd-9315-11a48d0f344c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 3793542a-2aeb-48a8-98c9-a05755aa708e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:39:09 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[167b501b-53ee-4689-a545-13e291911283]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 (non-flash)
Dec 01 17:39:10 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 (non-flash)
Dec 01 17:39:10 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b85b01f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895'): ({'sdb'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Removing single pathed devices sdb {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:39:10 user nova-compute[75745]: INFO nova.compute.manager [None req-89e5a805-a4ec-4eb9-834d-1cd9c652291a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] instance snapshotting
Dec 01 17:39:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18dddba-74d7-49f7-9c5c-e3ee6906a139]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[87158765-e585-41d3-9d08-a7d8e2edd171]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Flushing IO for device /dev/sdb {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a17d8c-41ba-4b95-b98d-4cf2e2cf55b5]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fc733a-f5b8-47a9-88c1-ffe1de6e0b8d]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] SCSI volumes sdb have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:39:10 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-89e5a805-a4ec-4eb9-834d-1cd9c652291a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Beginning live snapshot process
Dec 01 17:39:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99ee81e-a65c-4936-9310-f69fe4854d44]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.359s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f7c5c1-e5ac-40a9-82d8-923bee52e73e]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895, portal: 172.16.0.220,3260]
Dec 01 17:39:10 user nova-compute[75745]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895, portal: 172.16.0.220,3260] successful.
Dec 01 17:39:10 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36817f6c-30a3-4ccb-b262-934a1e29f895 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[545b1319-3f5e-4df0-86b1-698148cf9194]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] <== disconnect_volume: return (354ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:39:10 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Deleting instance files /opt/stack/data/nova/instances/3da51c15-816b-40cd-9315-11a48d0f344c_del
Dec 01 17:39:10 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Deletion of /opt/stack/data/nova/instances/3da51c15-816b-40cd-9315-11a48d0f344c_del complete
Dec 01 17:39:10 user nova-compute[75745]: INFO nova.compute.manager [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Took 1.64 seconds to destroy the instance on the hypervisor.
Dec 01 17:39:10 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-89e5a805-a4ec-4eb9-834d-1cd9c652291a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk --force-share --output=json -f qcow2 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-89e5a805-a4ec-4eb9-834d-1cd9c652291a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk --force-share --output=json -f qcow2" returned: 0 in 0.210s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-89e5a805-a4ec-4eb9-834d-1cd9c652291a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk --force-share --output=json -f qcow2 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-89e5a805-a4ec-4eb9-834d-1cd9c652291a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-89e5a805-a4ec-4eb9-834d-1cd9c652291a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG nova.compute.manager [req-6142cb1f-0afb-49c5-b99e-62fbf767a0ab req-b2961ea3-b9e6-4b4a-b2e8-e6e9782d610b service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Received event network-vif-deleted-a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:39:10 user nova-compute[75745]: INFO nova.compute.manager [req-6142cb1f-0afb-49c5-b99e-62fbf767a0ab req-b2961ea3-b9e6-4b4a-b2e8-e6e9782d610b service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Neutron deleted interface a65d94d0-bf0b-4d66-981e-de1b674507a5; detaching it from the instance and deleting it from the info cache
Dec 01 17:39:10 user nova-compute[75745]: DEBUG nova.network.neutron [req-6142cb1f-0afb-49c5-b99e-62fbf767a0ab req-b2961ea3-b9e6-4b4a-b2e8-e6e9782d610b service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG nova.compute.manager [req-6142cb1f-0afb-49c5-b99e-62fbf767a0ab req-b2961ea3-b9e6-4b4a-b2e8-e6e9782d610b service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Detach interface failed, port_id=a65d94d0-bf0b-4d66-981e-de1b674507a5, reason: Instance 3da51c15-816b-40cd-9315-11a48d0f344c could not be found. {{(pid=75745) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 17:39:10 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Took 0.50 seconds to deallocate network for instance.
Dec 01 17:39:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-89e5a805-a4ec-4eb9-834d-1cd9c652291a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.176s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-89e5a805-a4ec-4eb9-834d-1cd9c652291a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbl8e7k9y/e160dbacaef148728937d924f261f3e8.delta 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:39:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-89e5a805-a4ec-4eb9-834d-1cd9c652291a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbl8e7k9y/e160dbacaef148728937d924f261f3e8.delta 1073741824" returned: 0 in 0.054s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:39:10 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-89e5a805-a4ec-4eb9-834d-1cd9c652291a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Quiescing instance not available: QEMU guest agent is not enabled.
Dec 01 17:39:11 user nova-compute[75745]: DEBUG nova.compute.manager [req-c1623918-b51b-4def-beb5-8ae349b725df req-ca82ec61-5a90-499c-8e43-3cb0e9793a0e service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Received event network-vif-plugged-a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:39:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c1623918-b51b-4def-beb5-8ae349b725df req-ca82ec61-5a90-499c-8e43-3cb0e9793a0e service nova] Acquiring lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:39:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c1623918-b51b-4def-beb5-8ae349b725df req-ca82ec61-5a90-499c-8e43-3cb0e9793a0e service nova] Lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:39:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c1623918-b51b-4def-beb5-8ae349b725df req-ca82ec61-5a90-499c-8e43-3cb0e9793a0e service nova] Lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:39:11 user nova-compute[75745]: DEBUG nova.compute.manager [req-c1623918-b51b-4def-beb5-8ae349b725df req-ca82ec61-5a90-499c-8e43-3cb0e9793a0e service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] No waiting events found dispatching network-vif-plugged-a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:39:11 user nova-compute[75745]: WARNING nova.compute.manager [req-c1623918-b51b-4def-beb5-8ae349b725df req-ca82ec61-5a90-499c-8e43-3cb0e9793a0e service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Received unexpected event network-vif-plugged-a65d94d0-bf0b-4d66-981e-de1b674507a5 for instance with vm_state active and task_state deleting.
Dec 01 17:39:11 user nova-compute[75745]: DEBUG nova.compute.manager [req-c1623918-b51b-4def-beb5-8ae349b725df req-ca82ec61-5a90-499c-8e43-3cb0e9793a0e service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Received event network-vif-plugged-a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:39:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c1623918-b51b-4def-beb5-8ae349b725df req-ca82ec61-5a90-499c-8e43-3cb0e9793a0e service nova] Acquiring lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:39:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c1623918-b51b-4def-beb5-8ae349b725df req-ca82ec61-5a90-499c-8e43-3cb0e9793a0e service nova] Lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:39:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c1623918-b51b-4def-beb5-8ae349b725df req-ca82ec61-5a90-499c-8e43-3cb0e9793a0e service nova] Lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:39:11 user nova-compute[75745]: DEBUG nova.compute.manager [req-c1623918-b51b-4def-beb5-8ae349b725df req-ca82ec61-5a90-499c-8e43-3cb0e9793a0e service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] No waiting events found dispatching network-vif-plugged-a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:39:11 user nova-compute[75745]: WARNING nova.compute.manager [req-c1623918-b51b-4def-beb5-8ae349b725df req-ca82ec61-5a90-499c-8e43-3cb0e9793a0e service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Received unexpected event network-vif-plugged-a65d94d0-bf0b-4d66-981e-de1b674507a5 for instance with vm_state active and task_state deleting.
Dec 01 17:39:11 user nova-compute[75745]: DEBUG nova.compute.manager [req-c1623918-b51b-4def-beb5-8ae349b725df req-ca82ec61-5a90-499c-8e43-3cb0e9793a0e service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Received event network-vif-plugged-a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:39:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c1623918-b51b-4def-beb5-8ae349b725df req-ca82ec61-5a90-499c-8e43-3cb0e9793a0e service nova] Acquiring lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:39:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c1623918-b51b-4def-beb5-8ae349b725df req-ca82ec61-5a90-499c-8e43-3cb0e9793a0e service nova] Lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:39:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c1623918-b51b-4def-beb5-8ae349b725df req-ca82ec61-5a90-499c-8e43-3cb0e9793a0e service nova] Lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:39:11 user nova-compute[75745]: DEBUG nova.compute.manager [req-c1623918-b51b-4def-beb5-8ae349b725df req-ca82ec61-5a90-499c-8e43-3cb0e9793a0e service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] No waiting events found dispatching network-vif-plugged-a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:39:11 user nova-compute[75745]: WARNING nova.compute.manager [req-c1623918-b51b-4def-beb5-8ae349b725df req-ca82ec61-5a90-499c-8e43-3cb0e9793a0e service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Received unexpected event network-vif-plugged-a65d94d0-bf0b-4d66-981e-de1b674507a5 for instance with vm_state active and task_state deleting.
Dec 01 17:39:11 user nova-compute[75745]: DEBUG nova.compute.manager [req-c1623918-b51b-4def-beb5-8ae349b725df req-ca82ec61-5a90-499c-8e43-3cb0e9793a0e service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Received event network-vif-unplugged-a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:39:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c1623918-b51b-4def-beb5-8ae349b725df req-ca82ec61-5a90-499c-8e43-3cb0e9793a0e service nova] Acquiring lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:39:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c1623918-b51b-4def-beb5-8ae349b725df req-ca82ec61-5a90-499c-8e43-3cb0e9793a0e service nova] Lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:39:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c1623918-b51b-4def-beb5-8ae349b725df req-ca82ec61-5a90-499c-8e43-3cb0e9793a0e service nova] Lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:39:11 user nova-compute[75745]: DEBUG nova.compute.manager [req-c1623918-b51b-4def-beb5-8ae349b725df req-ca82ec61-5a90-499c-8e43-3cb0e9793a0e service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] No waiting events found dispatching network-vif-unplugged-a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:39:11 user nova-compute[75745]: DEBUG nova.compute.manager [req-c1623918-b51b-4def-beb5-8ae349b725df req-ca82ec61-5a90-499c-8e43-3cb0e9793a0e service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Received event network-vif-unplugged-a65d94d0-bf0b-4d66-981e-de1b674507a5 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:39:11 user nova-compute[75745]: DEBUG nova.compute.manager [req-c1623918-b51b-4def-beb5-8ae349b725df req-ca82ec61-5a90-499c-8e43-3cb0e9793a0e service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Received event network-vif-plugged-a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:39:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c1623918-b51b-4def-beb5-8ae349b725df req-ca82ec61-5a90-499c-8e43-3cb0e9793a0e service nova] Acquiring lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:39:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c1623918-b51b-4def-beb5-8ae349b725df req-ca82ec61-5a90-499c-8e43-3cb0e9793a0e service nova] Lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:39:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c1623918-b51b-4def-beb5-8ae349b725df req-ca82ec61-5a90-499c-8e43-3cb0e9793a0e service nova] Lock "3da51c15-816b-40cd-9315-11a48d0f344c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:39:11 user nova-compute[75745]: DEBUG nova.compute.manager [req-c1623918-b51b-4def-beb5-8ae349b725df req-ca82ec61-5a90-499c-8e43-3cb0e9793a0e service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] No waiting events found dispatching network-vif-plugged-a65d94d0-bf0b-4d66-981e-de1b674507a5 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:39:11 user nova-compute[75745]: WARNING nova.compute.manager [req-c1623918-b51b-4def-beb5-8ae349b725df req-ca82ec61-5a90-499c-8e43-3cb0e9793a0e service nova] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Received unexpected event network-vif-plugged-a65d94d0-bf0b-4d66-981e-de1b674507a5 for instance with vm_state active and task_state deleting.
Dec 01 17:39:11 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:39:11 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:39:11 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-89e5a805-a4ec-4eb9-834d-1cd9c652291a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75745) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 17:39:11 user nova-compute[75745]: INFO nova.compute.manager [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Took 0.99 seconds to detach 1 volumes for instance.
Dec 01 17:39:11 user nova-compute[75745]: DEBUG nova.compute.manager [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] [instance: 3da51c15-816b-40cd-9315-11a48d0f344c] Deleting volume: 36817f6c-30a3-4ccb-b262-934a1e29f895 {{(pid=75745) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 01 17:39:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:39:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:39:12 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:39:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-89e5a805-a4ec-4eb9-834d-1cd9c652291a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75745) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 17:39:12 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-89e5a805-a4ec-4eb9-834d-1cd9c652291a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 01 17:39:12 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:39:12 user nova-compute[75745]: DEBUG nova.privsep.utils [None req-89e5a805-a4ec-4eb9-834d-1cd9c652291a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75745) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 17:39:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-89e5a805-a4ec-4eb9-834d-1cd9c652291a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbl8e7k9y/e160dbacaef148728937d924f261f3e8.delta /opt/stack/data/nova/instances/snapshots/tmpbl8e7k9y/e160dbacaef148728937d924f261f3e8 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:39:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.436s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:39:12 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Deleted allocations for instance 3da51c15-816b-40cd-9315-11a48d0f344c
Dec 01 17:39:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-67caf273-cd5d-4302-a319-6980dfa2dee9 tempest-TestShelveInstance-1224578669 tempest-TestShelveInstance-1224578669-project-member] Lock "3da51c15-816b-40cd-9315-11a48d0f344c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.905s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:39:12 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:39:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-89e5a805-a4ec-4eb9-834d-1cd9c652291a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbl8e7k9y/e160dbacaef148728937d924f261f3e8.delta /opt/stack/data/nova/instances/snapshots/tmpbl8e7k9y/e160dbacaef148728937d924f261f3e8" returned: 0 in 0.563s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:39:12 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-89e5a805-a4ec-4eb9-834d-1cd9c652291a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Snapshot extracted, beginning image upload
Dec 01 17:39:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:15 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-89e5a805-a4ec-4eb9-834d-1cd9c652291a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Snapshot image upload complete
Dec 01 17:39:15 user nova-compute[75745]: INFO nova.compute.manager [None req-89e5a805-a4ec-4eb9-834d-1cd9c652291a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Took 5.56 seconds to snapshot the instance on the hypervisor.
Dec 01 17:39:16 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:39:16 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:39:16 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Didn't find any instances for network info cache update. {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 17:39:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Acquiring lock "13972a4e-b898-438d-bd60-20bb09b89453" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:39:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "13972a4e-b898-438d-bd60-20bb09b89453" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:39:17 user nova-compute[75745]: DEBUG nova.compute.manager [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:39:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:39:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:39:17 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:39:17 user nova-compute[75745]: INFO nova.compute.claims [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Claim successful on node user
Dec 01 17:39:17 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:39:17 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:39:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.287s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:39:17 user nova-compute[75745]: DEBUG nova.compute.manager [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:39:17 user nova-compute[75745]: DEBUG nova.compute.manager [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:39:17 user nova-compute[75745]: DEBUG nova.network.neutron [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:39:17 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:39:17 user nova-compute[75745]: DEBUG nova.compute.manager [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:39:17 user nova-compute[75745]: DEBUG nova.policy [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2507209df93a48f1b17652da89646e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aff17da1db4afbb8563237035d13f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:39:17 user nova-compute[75745]: DEBUG nova.compute.manager [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:39:17 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:39:17 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Creating image(s)
Dec 01 17:39:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Acquiring lock "/opt/stack/data/nova/instances/13972a4e-b898-438d-bd60-20bb09b89453/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:39:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "/opt/stack/data/nova/instances/13972a4e-b898-438d-bd60-20bb09b89453/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:39:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "/opt/stack/data/nova/instances/13972a4e-b898-438d-bd60-20bb09b89453/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:39:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Acquiring lock "5d497edcca8844d9331d80de3c82fd2083dd8599" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:39:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "5d497edcca8844d9331d80de3c82fd2083dd8599" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:39:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d497edcca8844d9331d80de3c82fd2083dd8599.part --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:39:19 user nova-compute[75745]: DEBUG nova.network.neutron [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Successfully created port: fe2e9541-b487-4b3d-92fd-93f429bba1f4 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:39:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d497edcca8844d9331d80de3c82fd2083dd8599.part --force-share --output=json" returned: 0 in 0.175s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:39:19 user nova-compute[75745]: DEBUG nova.virt.images [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] 3a567948-76e8-4c75-98f5-54a545fceeb5 was qcow2, converting to raw {{(pid=75745) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 01 17:39:19 user nova-compute[75745]: DEBUG nova.privsep.utils [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75745) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 17:39:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5d497edcca8844d9331d80de3c82fd2083dd8599.part /opt/stack/data/nova/instances/_base/5d497edcca8844d9331d80de3c82fd2083dd8599.converted {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:39:19 user nova-compute[75745]: DEBUG nova.network.neutron [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Successfully updated port: fe2e9541-b487-4b3d-92fd-93f429bba1f4 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:39:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5d497edcca8844d9331d80de3c82fd2083dd8599.part /opt/stack/data/nova/instances/_base/5d497edcca8844d9331d80de3c82fd2083dd8599.converted" returned: 0 in 0.735s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:39:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d497edcca8844d9331d80de3c82fd2083dd8599.converted --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:39:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Acquiring lock "refresh_cache-13972a4e-b898-438d-bd60-20bb09b89453" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:39:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Acquired lock "refresh_cache-13972a4e-b898-438d-bd60-20bb09b89453" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:39:19 user nova-compute[75745]: DEBUG nova.network.neutron [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:39:19 user nova-compute[75745]: DEBUG nova.compute.manager [req-47256d7b-1afd-4280-b727-4c0c16aef50c req-ec883e35-135e-46e0-a9ac-e8186be15790 service nova] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Received event network-changed-fe2e9541-b487-4b3d-92fd-93f429bba1f4 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:39:19 user nova-compute[75745]: DEBUG nova.compute.manager [req-47256d7b-1afd-4280-b727-4c0c16aef50c req-ec883e35-135e-46e0-a9ac-e8186be15790 service nova] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Refreshing instance network info cache due to event network-changed-fe2e9541-b487-4b3d-92fd-93f429bba1f4. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:39:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-47256d7b-1afd-4280-b727-4c0c16aef50c req-ec883e35-135e-46e0-a9ac-e8186be15790 service nova] Acquiring lock "refresh_cache-13972a4e-b898-438d-bd60-20bb09b89453" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG nova.network.neutron [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d497edcca8844d9331d80de3c82fd2083dd8599.converted --force-share --output=json" returned: 0 in 0.203s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "5d497edcca8844d9331d80de3c82fd2083dd8599" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.378s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d497edcca8844d9331d80de3c82fd2083dd8599 --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d497edcca8844d9331d80de3c82fd2083dd8599 --force-share --output=json" returned: 0 in 0.199s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Acquiring lock "5d497edcca8844d9331d80de3c82fd2083dd8599" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "5d497edcca8844d9331d80de3c82fd2083dd8599" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d497edcca8844d9331d80de3c82fd2083dd8599 --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG nova.network.neutron [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Updating instance_info_cache with network_info: [{"id": "fe2e9541-b487-4b3d-92fd-93f429bba1f4", "address": "fa:16:3e:ee:0a:3c", "network": {"id": "ab165176-5fd5-4df3-97fc-464c4a6891d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2005430003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0aff17da1db4afbb8563237035d13f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2e9541-b4", "ovs_interfaceid": "fe2e9541-b487-4b3d-92fd-93f429bba1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Releasing lock "refresh_cache-13972a4e-b898-438d-bd60-20bb09b89453" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG nova.compute.manager [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Instance network_info: |[{"id": "fe2e9541-b487-4b3d-92fd-93f429bba1f4", "address": "fa:16:3e:ee:0a:3c", "network": {"id": "ab165176-5fd5-4df3-97fc-464c4a6891d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2005430003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0aff17da1db4afbb8563237035d13f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2e9541-b4", "ovs_interfaceid": "fe2e9541-b487-4b3d-92fd-93f429bba1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-47256d7b-1afd-4280-b727-4c0c16aef50c req-ec883e35-135e-46e0-a9ac-e8186be15790 service nova] Acquired lock "refresh_cache-13972a4e-b898-438d-bd60-20bb09b89453" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG nova.network.neutron [req-47256d7b-1afd-4280-b727-4c0c16aef50c req-ec883e35-135e-46e0-a9ac-e8186be15790 service nova] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Refreshing network info cache for port fe2e9541-b487-4b3d-92fd-93f429bba1f4 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d497edcca8844d9331d80de3c82fd2083dd8599 --force-share --output=json" returned: 0 in 0.178s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d497edcca8844d9331d80de3c82fd2083dd8599,backing_fmt=raw /opt/stack/data/nova/instances/13972a4e-b898-438d-bd60-20bb09b89453/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d497edcca8844d9331d80de3c82fd2083dd8599,backing_fmt=raw /opt/stack/data/nova/instances/13972a4e-b898-438d-bd60-20bb09b89453/disk 1073741824" returned: 0 in 0.056s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "5d497edcca8844d9331d80de3c82fd2083dd8599" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d497edcca8844d9331d80de3c82fd2083dd8599 --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d497edcca8844d9331d80de3c82fd2083dd8599 --force-share --output=json" returned: 0 in 0.174s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Ensure instance console log exists: /opt/stack/data/nova/instances/13972a4e-b898-438d-bd60-20bb09b89453/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Start _get_guest_xml network_info=[{"id": "fe2e9541-b487-4b3d-92fd-93f429bba1f4", "address": "fa:16:3e:ee:0a:3c", "network": {"id": "ab165176-5fd5-4df3-97fc-464c4a6891d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2005430003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0aff17da1db4afbb8563237035d13f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2e9541-b4", "ovs_interfaceid": "fe2e9541-b487-4b3d-92fd-93f429bba1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b56dcb12b727749dc2a5605af692de89',container_format='bare',created_at=2023-12-01T17:39:09Z,direct_url=<?>,disk_format='qcow2',id=3a567948-76e8-4c75-98f5-54a545fceeb5,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1453842381',owner='e0aff17da1db4afbb8563237035d13f5',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-12-01T17:39:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '3a567948-76e8-4c75-98f5-54a545fceeb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:39:20 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:39:20 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:39:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b56dcb12b727749dc2a5605af692de89',container_format='bare',created_at=2023-12-01T17:39:09Z,direct_url=<?>,disk_format='qcow2',id=3a567948-76e8-4c75-98f5-54a545fceeb5,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1453842381',owner='e0aff17da1db4afbb8563237035d13f5',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-12-01T17:39:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:39:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1673397788',display_name='tempest-TestStampPattern-server-1673397788',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1673397788',id=45,image_ref='3a567948-76e8-4c75-98f5-54a545fceeb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGNrLA5bKvG55GGS8MBbWt09LoTtS2gvVG2BKmrPsKsEdhegbzNdpBAYjEqY7P16s1fTayXnvtFgTmvCamKaUfjqCdJv5fIccc9eDKhtquF0DkT05mxPdPEaU8Xc/LdjA==',key_name='tempest-TestStampPattern-115018569',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0aff17da1db4afbb8563237035d13f5',ramdisk_id='',reservation_id='r-f5wb2g66',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='3c990a0a-188a-4973-846a-d09c98918500',image_min_disk='1',image_min_ram='0',image_owner_id='e0aff17da1db4afbb8563237035d13f5',image_owner_project_name='tempest-TestStampPattern-885997284',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-885997284-project-member',image_user_id='2507209df93a48f1b17652da89646e14',network_allocated='True',owner_project_name='tempest-TestStampPattern-885997284',owner_user_name='tempest-TestStampPattern-885997284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:39:18Z,user_data=None,user_id='2507209df93a48f1b17652da89646e14',uuid=13972a4e-b898-438d-bd60-20bb09b89453,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe2e9541-b487-4b3d-92fd-93f429bba1f4", "address": "fa:16:3e:ee:0a:3c", "network": {"id": "ab165176-5fd5-4df3-97fc-464c4a6891d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2005430003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0aff17da1db4afbb8563237035d13f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2e9541-b4", "ovs_interfaceid": "fe2e9541-b487-4b3d-92fd-93f429bba1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Converting VIF {"id": "fe2e9541-b487-4b3d-92fd-93f429bba1f4", "address": "fa:16:3e:ee:0a:3c", "network": {"id": "ab165176-5fd5-4df3-97fc-464c4a6891d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2005430003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0aff17da1db4afbb8563237035d13f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2e9541-b4", "ovs_interfaceid": "fe2e9541-b487-4b3d-92fd-93f429bba1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:0a:3c,bridge_name='br-int',has_traffic_filtering=True,id=fe2e9541-b487-4b3d-92fd-93f429bba1f4,network=Network(ab165176-5fd5-4df3-97fc-464c4a6891d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2e9541-b4') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG nova.objects.instance [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lazy-loading 'pci_devices' on Instance uuid 13972a4e-b898-438d-bd60-20bb09b89453 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG nova.network.neutron [req-47256d7b-1afd-4280-b727-4c0c16aef50c req-ec883e35-135e-46e0-a9ac-e8186be15790 service nova] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Updated VIF entry in instance network info cache for port fe2e9541-b487-4b3d-92fd-93f429bba1f4. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG nova.network.neutron [req-47256d7b-1afd-4280-b727-4c0c16aef50c req-ec883e35-135e-46e0-a9ac-e8186be15790 service nova] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Updating instance_info_cache with network_info: [{"id": "fe2e9541-b487-4b3d-92fd-93f429bba1f4", "address": "fa:16:3e:ee:0a:3c", "network": {"id": "ab165176-5fd5-4df3-97fc-464c4a6891d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2005430003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0aff17da1db4afbb8563237035d13f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2e9541-b4", "ovs_interfaceid": "fe2e9541-b487-4b3d-92fd-93f429bba1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:39:20 user nova-compute[75745]:   <uuid>13972a4e-b898-438d-bd60-20bb09b89453</uuid>
Dec 01 17:39:20 user nova-compute[75745]:   <name>instance-0000002d</name>
Dec 01 17:39:20 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:39:20 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:39:20 user nova-compute[75745]:   <metadata>
Dec 01 17:39:20 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:39:20 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:39:20 user nova-compute[75745]:       <nova:name>tempest-TestStampPattern-server-1673397788</nova:name>
Dec 01 17:39:20 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:39:20</nova:creationTime>
Dec 01 17:39:20 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:39:20 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:39:20 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:39:20 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:39:20 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:39:20 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:39:20 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:39:20 user nova-compute[75745]:       <nova:owner>
Dec 01 17:39:20 user nova-compute[75745]:         <nova:user uuid="2507209df93a48f1b17652da89646e14">tempest-TestStampPattern-885997284-project-member</nova:user>
Dec 01 17:39:20 user nova-compute[75745]:         <nova:project uuid="e0aff17da1db4afbb8563237035d13f5">tempest-TestStampPattern-885997284</nova:project>
Dec 01 17:39:20 user nova-compute[75745]:       </nova:owner>
Dec 01 17:39:20 user nova-compute[75745]:       <nova:root type="image" uuid="3a567948-76e8-4c75-98f5-54a545fceeb5"/>
Dec 01 17:39:20 user nova-compute[75745]:       <nova:ports>
Dec 01 17:39:20 user nova-compute[75745]:         <nova:port uuid="fe2e9541-b487-4b3d-92fd-93f429bba1f4">
Dec 01 17:39:20 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 01 17:39:20 user nova-compute[75745]:         </nova:port>
Dec 01 17:39:20 user nova-compute[75745]:       </nova:ports>
Dec 01 17:39:20 user nova-compute[75745]:     </nova:instance>
Dec 01 17:39:20 user nova-compute[75745]:   </metadata>
Dec 01 17:39:20 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:39:20 user nova-compute[75745]:     <system>
Dec 01 17:39:20 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:39:20 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:39:20 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:39:20 user nova-compute[75745]:       <entry name="serial">13972a4e-b898-438d-bd60-20bb09b89453</entry>
Dec 01 17:39:20 user nova-compute[75745]:       <entry name="uuid">13972a4e-b898-438d-bd60-20bb09b89453</entry>
Dec 01 17:39:20 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:39:20 user nova-compute[75745]:     </system>
Dec 01 17:39:20 user nova-compute[75745]:   </sysinfo>
Dec 01 17:39:20 user nova-compute[75745]:   <os>
Dec 01 17:39:20 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:39:20 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:39:20 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:39:20 user nova-compute[75745]:   </os>
Dec 01 17:39:20 user nova-compute[75745]:   <features>
Dec 01 17:39:20 user nova-compute[75745]:     <acpi/>
Dec 01 17:39:20 user nova-compute[75745]:     <apic/>
Dec 01 17:39:20 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:39:20 user nova-compute[75745]:   </features>
Dec 01 17:39:20 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:39:20 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:39:20 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:39:20 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:39:20 user nova-compute[75745]:   </clock>
Dec 01 17:39:20 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:39:20 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:39:20 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:39:20 user nova-compute[75745]:   </cpu>
Dec 01 17:39:20 user nova-compute[75745]:   <devices>
Dec 01 17:39:20 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:39:20 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:39:20 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/13972a4e-b898-438d-bd60-20bb09b89453/disk"/>
Dec 01 17:39:20 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:39:20 user nova-compute[75745]:     </disk>
Dec 01 17:39:20 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:39:20 user nova-compute[75745]:       <mac address="fa:16:3e:ee:0a:3c"/>
Dec 01 17:39:20 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:39:20 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:39:20 user nova-compute[75745]:       <target dev="tapfe2e9541-b4"/>
Dec 01 17:39:20 user nova-compute[75745]:     </interface>
Dec 01 17:39:20 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:39:20 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/13972a4e-b898-438d-bd60-20bb09b89453/console.log" append="off"/>
Dec 01 17:39:20 user nova-compute[75745]:     </serial>
Dec 01 17:39:20 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:39:20 user nova-compute[75745]:     <video>
Dec 01 17:39:20 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:39:20 user nova-compute[75745]:     </video>
Dec 01 17:39:20 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:39:20 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:39:20 user nova-compute[75745]:     </rng>
Dec 01 17:39:20 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:39:20 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:39:20 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:39:20 user nova-compute[75745]:     </memballoon>
Dec 01 17:39:20 user nova-compute[75745]:   </devices>
Dec 01 17:39:20 user nova-compute[75745]: </domain>
Dec 01 17:39:20 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:39:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1673397788',display_name='tempest-TestStampPattern-server-1673397788',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1673397788',id=45,image_ref='3a567948-76e8-4c75-98f5-54a545fceeb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGNrLA5bKvG55GGS8MBbWt09LoTtS2gvVG2BKmrPsKsEdhegbzNdpBAYjEqY7P16s1fTayXnvtFgTmvCamKaUfjqCdJv5fIccc9eDKhtquF0DkT05mxPdPEaU8Xc/LdjA==',key_name='tempest-TestStampPattern-115018569',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0aff17da1db4afbb8563237035d13f5',ramdisk_id='',reservation_id='r-f5wb2g66',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='3c990a0a-188a-4973-846a-d09c98918500',image_min_disk='1',image_min_ram='0',image_owner_id='e0aff17da1db4afbb8563237035d13f5',image_owner_project_name='tempest-TestStampPattern-885997284',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-885997284-project-member',image_user_id='2507209df93a48f1b17652da89646e14',network_allocated='True',owner_project_name='tempest-TestStampPattern-885997284',owner_user_name='tempest-TestStampPattern-885997284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:39:18Z,user_data=None,user_id='2507209df93a48f1b17652da89646e14',uuid=13972a4e-b898-438d-bd60-20bb09b89453,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe2e9541-b487-4b3d-92fd-93f429bba1f4", "address": "fa:16:3e:ee:0a:3c", "network": {"id": "ab165176-5fd5-4df3-97fc-464c4a6891d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2005430003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0aff17da1db4afbb8563237035d13f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2e9541-b4", "ovs_interfaceid": "fe2e9541-b487-4b3d-92fd-93f429bba1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Converting VIF {"id": "fe2e9541-b487-4b3d-92fd-93f429bba1f4", "address": "fa:16:3e:ee:0a:3c", "network": {"id": "ab165176-5fd5-4df3-97fc-464c4a6891d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2005430003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0aff17da1db4afbb8563237035d13f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2e9541-b4", "ovs_interfaceid": "fe2e9541-b487-4b3d-92fd-93f429bba1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:0a:3c,bridge_name='br-int',has_traffic_filtering=True,id=fe2e9541-b487-4b3d-92fd-93f429bba1f4,network=Network(ab165176-5fd5-4df3-97fc-464c4a6891d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2e9541-b4') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG os_vif [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:0a:3c,bridge_name='br-int',has_traffic_filtering=True,id=fe2e9541-b487-4b3d-92fd-93f429bba1f4,network=Network(ab165176-5fd5-4df3-97fc-464c4a6891d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2e9541-b4') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '96065668-6821-5b6e-beff-3ba667f1812a', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-47256d7b-1afd-4280-b727-4c0c16aef50c req-ec883e35-135e-46e0-a9ac-e8186be15790 service nova] Releasing lock "refresh_cache-13972a4e-b898-438d-bd60-20bb09b89453" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe2e9541-b4, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe2e9541-b4, col_values=(('qos', UUID('69a17339-a112-48a8-b8b5-65311e94711d')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe2e9541-b4, col_values=(('external_ids', {'iface-id': 'fe2e9541-b487-4b3d-92fd-93f429bba1f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:0a:3c', 'vm-uuid': '13972a4e-b898-438d-bd60-20bb09b89453'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:20 user nova-compute[75745]: INFO os_vif [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:0a:3c,bridge_name='br-int',has_traffic_filtering=True,id=fe2e9541-b487-4b3d-92fd-93f429bba1f4,network=Network(ab165176-5fd5-4df3-97fc-464c4a6891d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2e9541-b4')
Dec 01 17:39:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:39:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] No VIF found with MAC fa:16:3e:ee:0a:3c, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:39:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:22 user nova-compute[75745]: DEBUG nova.compute.manager [req-4d52b769-e974-4c86-852d-4d918a1fe94e req-e88a24de-723b-4524-9e24-7181e118100f service nova] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Received event network-vif-plugged-fe2e9541-b487-4b3d-92fd-93f429bba1f4 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:39:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-4d52b769-e974-4c86-852d-4d918a1fe94e req-e88a24de-723b-4524-9e24-7181e118100f service nova] Acquiring lock "13972a4e-b898-438d-bd60-20bb09b89453-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:39:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-4d52b769-e974-4c86-852d-4d918a1fe94e req-e88a24de-723b-4524-9e24-7181e118100f service nova] Lock "13972a4e-b898-438d-bd60-20bb09b89453-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:39:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-4d52b769-e974-4c86-852d-4d918a1fe94e req-e88a24de-723b-4524-9e24-7181e118100f service nova] Lock "13972a4e-b898-438d-bd60-20bb09b89453-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:39:22 user nova-compute[75745]: DEBUG nova.compute.manager [req-4d52b769-e974-4c86-852d-4d918a1fe94e req-e88a24de-723b-4524-9e24-7181e118100f service nova] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] No waiting events found dispatching network-vif-plugged-fe2e9541-b487-4b3d-92fd-93f429bba1f4 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:39:22 user nova-compute[75745]: WARNING nova.compute.manager [req-4d52b769-e974-4c86-852d-4d918a1fe94e req-e88a24de-723b-4524-9e24-7181e118100f service nova] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Received unexpected event network-vif-plugged-fe2e9541-b487-4b3d-92fd-93f429bba1f4 for instance with vm_state building and task_state spawning.
Dec 01 17:39:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:24 user nova-compute[75745]: DEBUG nova.compute.manager [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:39:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:39:24 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Instance spawned successfully.
Dec 01 17:39:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:39:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:39:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:39:24 user nova-compute[75745]: DEBUG nova.compute.manager [req-73035f70-d9f0-4d32-ae1c-4e75b597622f req-c422f881-4a64-40dc-abf2-25c3bd9ba8df service nova] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Received event network-vif-plugged-fe2e9541-b487-4b3d-92fd-93f429bba1f4 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:39:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-73035f70-d9f0-4d32-ae1c-4e75b597622f req-c422f881-4a64-40dc-abf2-25c3bd9ba8df service nova] Acquiring lock "13972a4e-b898-438d-bd60-20bb09b89453-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:39:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-73035f70-d9f0-4d32-ae1c-4e75b597622f req-c422f881-4a64-40dc-abf2-25c3bd9ba8df service nova] Lock "13972a4e-b898-438d-bd60-20bb09b89453-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:39:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-73035f70-d9f0-4d32-ae1c-4e75b597622f req-c422f881-4a64-40dc-abf2-25c3bd9ba8df service nova] Lock "13972a4e-b898-438d-bd60-20bb09b89453-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:39:24 user nova-compute[75745]: DEBUG nova.compute.manager [req-73035f70-d9f0-4d32-ae1c-4e75b597622f req-c422f881-4a64-40dc-abf2-25c3bd9ba8df service nova] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] No waiting events found dispatching network-vif-plugged-fe2e9541-b487-4b3d-92fd-93f429bba1f4 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:39:24 user nova-compute[75745]: WARNING nova.compute.manager [req-73035f70-d9f0-4d32-ae1c-4e75b597622f req-c422f881-4a64-40dc-abf2-25c3bd9ba8df service nova] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Received unexpected event network-vif-plugged-fe2e9541-b487-4b3d-92fd-93f429bba1f4 for instance with vm_state building and task_state spawning.
Dec 01 17:39:24 user nova-compute[75745]: INFO nova.compute.manager [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Took 6.66 seconds to spawn the instance on the hypervisor.
Dec 01 17:39:24 user nova-compute[75745]: DEBUG nova.compute.manager [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:39:24 user nova-compute[75745]: INFO nova.compute.manager [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Took 7.32 seconds to build instance.
Dec 01 17:39:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-776f9613-9367-421f-8df8-9124bcfaabd1 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "13972a4e-b898-438d-bd60-20bb09b89453" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.436s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:39:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:39:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:39:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:39:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:39:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:39:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:39:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:40:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:40:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:40:03 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:40:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:40:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:40:05 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:40:05 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:40:05 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:40:05 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:40:08 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:40:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:40:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:40:08 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:40:08 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:40:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13972a4e-b898-438d-bd60-20bb09b89453/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:40:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13972a4e-b898-438d-bd60-20bb09b89453/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:40:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13972a4e-b898-438d-bd60-20bb09b89453/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:40:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13972a4e-b898-438d-bd60-20bb09b89453/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:40:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:40:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:40:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:40:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:40:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:40:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:40:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:40:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:40:10 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:40:10 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:40:10 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=8693MB free_disk=25.060054779052734GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:40:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:40:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:40:10 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 3c990a0a-188a-4973-846a-d09c98918500 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:40:10 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 3793542a-2aeb-48a8-98c9-a05755aa708e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:40:10 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 13972a4e-b898-438d-bd60-20bb09b89453 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:40:10 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:40:10 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:40:10 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:40:10 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:40:10 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:40:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:40:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:40:11 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:40:11 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:40:13 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:40:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:40:18 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:40:18 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:40:18 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Rebuilding the list of instances to heal {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 17:40:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-3c990a0a-188a-4973-846a-d09c98918500" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:40:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-3c990a0a-188a-4973-846a-d09c98918500" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:40:18 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:40:18 user nova-compute[75745]: DEBUG nova.objects.instance [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lazy-loading 'info_cache' on Instance uuid 3c990a0a-188a-4973-846a-d09c98918500 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:40:19 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Updating instance_info_cache with network_info: [{"id": "964bbd9c-d6ac-462c-8342-f565c3ab2934", "address": "fa:16:3e:4a:af:e3", "network": {"id": "ab165176-5fd5-4df3-97fc-464c4a6891d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2005430003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0aff17da1db4afbb8563237035d13f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap964bbd9c-d6", "ovs_interfaceid": "964bbd9c-d6ac-462c-8342-f565c3ab2934", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:40:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-3c990a0a-188a-4973-846a-d09c98918500" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:40:19 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:40:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:40:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:40:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:40:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:40:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:40:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:40:25 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:40:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:40:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:40:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:40:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:40:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:40:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:40:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:40:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:40:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:40:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:40:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:40:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:40:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:40:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:40:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:40:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:40:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:40:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:40:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:40:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:40:48 user nova-compute[75745]: DEBUG nova.compute.manager [req-0e844115-746c-4a47-a490-6a1b207fcf65 req-702c2e32-01e2-475f-845d-5acb5b1fafb7 service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Received event network-changed-6e0b2dc1-93ba-4f89-9059-51d908bd03c8 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:40:48 user nova-compute[75745]: DEBUG nova.compute.manager [req-0e844115-746c-4a47-a490-6a1b207fcf65 req-702c2e32-01e2-475f-845d-5acb5b1fafb7 service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Refreshing instance network info cache due to event network-changed-6e0b2dc1-93ba-4f89-9059-51d908bd03c8. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:40:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0e844115-746c-4a47-a490-6a1b207fcf65 req-702c2e32-01e2-475f-845d-5acb5b1fafb7 service nova] Acquiring lock "refresh_cache-3793542a-2aeb-48a8-98c9-a05755aa708e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:40:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0e844115-746c-4a47-a490-6a1b207fcf65 req-702c2e32-01e2-475f-845d-5acb5b1fafb7 service nova] Acquired lock "refresh_cache-3793542a-2aeb-48a8-98c9-a05755aa708e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:40:48 user nova-compute[75745]: DEBUG nova.network.neutron [req-0e844115-746c-4a47-a490-6a1b207fcf65 req-702c2e32-01e2-475f-845d-5acb5b1fafb7 service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Refreshing network info cache for port 6e0b2dc1-93ba-4f89-9059-51d908bd03c8 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:40:48 user nova-compute[75745]: DEBUG nova.network.neutron [req-0e844115-746c-4a47-a490-6a1b207fcf65 req-702c2e32-01e2-475f-845d-5acb5b1fafb7 service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Updated VIF entry in instance network info cache for port 6e0b2dc1-93ba-4f89-9059-51d908bd03c8. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:40:48 user nova-compute[75745]: DEBUG nova.network.neutron [req-0e844115-746c-4a47-a490-6a1b207fcf65 req-702c2e32-01e2-475f-845d-5acb5b1fafb7 service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Updating instance_info_cache with network_info: [{"id": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "address": "fa:16:3e:08:eb:e0", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0b2dc1-93", "ovs_interfaceid": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:40:48 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0e844115-746c-4a47-a490-6a1b207fcf65 req-702c2e32-01e2-475f-845d-5acb5b1fafb7 service nova] Releasing lock "refresh_cache-3793542a-2aeb-48a8-98c9-a05755aa708e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:40:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:40:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:40:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-80f38819-4e91-4cfe-8fcb-bb541aead25f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "3793542a-2aeb-48a8-98c9-a05755aa708e" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:40:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-80f38819-4e91-4cfe-8fcb-bb541aead25f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "3793542a-2aeb-48a8-98c9-a05755aa708e" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:40:51 user nova-compute[75745]: INFO nova.compute.manager [None req-80f38819-4e91-4cfe-8fcb-bb541aead25f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Shelving
Dec 01 17:40:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:40:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:40:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:40:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:40:52 user nova-compute[75745]: DEBUG nova.compute.manager [req-085780b8-e4f2-4bf9-b6e1-b35285ad739c req-0cd5439c-ad54-4d80-8ad3-cae79815866b service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Received event network-vif-unplugged-6e0b2dc1-93ba-4f89-9059-51d908bd03c8 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:40:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-085780b8-e4f2-4bf9-b6e1-b35285ad739c req-0cd5439c-ad54-4d80-8ad3-cae79815866b service nova] Acquiring lock "3793542a-2aeb-48a8-98c9-a05755aa708e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:40:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-085780b8-e4f2-4bf9-b6e1-b35285ad739c req-0cd5439c-ad54-4d80-8ad3-cae79815866b service nova] Lock "3793542a-2aeb-48a8-98c9-a05755aa708e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:40:52 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-085780b8-e4f2-4bf9-b6e1-b35285ad739c req-0cd5439c-ad54-4d80-8ad3-cae79815866b service nova] Lock "3793542a-2aeb-48a8-98c9-a05755aa708e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:40:52 user nova-compute[75745]: DEBUG nova.compute.manager [req-085780b8-e4f2-4bf9-b6e1-b35285ad739c req-0cd5439c-ad54-4d80-8ad3-cae79815866b service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] No waiting events found dispatching network-vif-unplugged-6e0b2dc1-93ba-4f89-9059-51d908bd03c8 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:40:52 user nova-compute[75745]: WARNING nova.compute.manager [req-085780b8-e4f2-4bf9-b6e1-b35285ad739c req-0cd5439c-ad54-4d80-8ad3-cae79815866b service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Received unexpected event network-vif-unplugged-6e0b2dc1-93ba-4f89-9059-51d908bd03c8 for instance with vm_state active and task_state shelving.
Dec 01 17:40:52 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Instance destroyed successfully.
Dec 01 17:40:52 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-80f38819-4e91-4cfe-8fcb-bb541aead25f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Beginning cold snapshot process
Dec 01 17:40:52 user nova-compute[75745]: DEBUG nova.privsep.utils [None req-80f38819-4e91-4cfe-8fcb-bb541aead25f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75745) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 17:40:52 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-80f38819-4e91-4cfe-8fcb-bb541aead25f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk /opt/stack/data/nova/instances/snapshots/tmpu35u7w_8/dcb33264041042a49e40099824a30a3d {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:40:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-80f38819-4e91-4cfe-8fcb-bb541aead25f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk /opt/stack/data/nova/instances/snapshots/tmpu35u7w_8/dcb33264041042a49e40099824a30a3d" returned: 0 in 0.448s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:40:53 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-80f38819-4e91-4cfe-8fcb-bb541aead25f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Snapshot extracted, beginning image upload
Dec 01 17:40:54 user nova-compute[75745]: DEBUG nova.compute.manager [req-8789a201-cc11-451a-b958-e4ad0060e428 req-529e93a1-9ddd-450f-9637-f54bbc447cff service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Received event network-vif-plugged-6e0b2dc1-93ba-4f89-9059-51d908bd03c8 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:40:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8789a201-cc11-451a-b958-e4ad0060e428 req-529e93a1-9ddd-450f-9637-f54bbc447cff service nova] Acquiring lock "3793542a-2aeb-48a8-98c9-a05755aa708e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:40:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8789a201-cc11-451a-b958-e4ad0060e428 req-529e93a1-9ddd-450f-9637-f54bbc447cff service nova] Lock "3793542a-2aeb-48a8-98c9-a05755aa708e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:40:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8789a201-cc11-451a-b958-e4ad0060e428 req-529e93a1-9ddd-450f-9637-f54bbc447cff service nova] Lock "3793542a-2aeb-48a8-98c9-a05755aa708e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:40:54 user nova-compute[75745]: DEBUG nova.compute.manager [req-8789a201-cc11-451a-b958-e4ad0060e428 req-529e93a1-9ddd-450f-9637-f54bbc447cff service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] No waiting events found dispatching network-vif-plugged-6e0b2dc1-93ba-4f89-9059-51d908bd03c8 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:40:54 user nova-compute[75745]: WARNING nova.compute.manager [req-8789a201-cc11-451a-b958-e4ad0060e428 req-529e93a1-9ddd-450f-9637-f54bbc447cff service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Received unexpected event network-vif-plugged-6e0b2dc1-93ba-4f89-9059-51d908bd03c8 for instance with vm_state active and task_state shelving_image_uploading.
Dec 01 17:40:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:40:55 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-80f38819-4e91-4cfe-8fcb-bb541aead25f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Snapshot image upload complete
Dec 01 17:40:55 user nova-compute[75745]: DEBUG nova.compute.manager [None req-80f38819-4e91-4cfe-8fcb-bb541aead25f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:40:55 user nova-compute[75745]: INFO nova.compute.manager [None req-80f38819-4e91-4cfe-8fcb-bb541aead25f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Shelve offloading
Dec 01 17:40:55 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Instance destroyed successfully.
Dec 01 17:40:55 user nova-compute[75745]: DEBUG nova.compute.manager [None req-80f38819-4e91-4cfe-8fcb-bb541aead25f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:40:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-80f38819-4e91-4cfe-8fcb-bb541aead25f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "refresh_cache-3793542a-2aeb-48a8-98c9-a05755aa708e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:40:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-80f38819-4e91-4cfe-8fcb-bb541aead25f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquired lock "refresh_cache-3793542a-2aeb-48a8-98c9-a05755aa708e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:40:55 user nova-compute[75745]: DEBUG nova.network.neutron [None req-80f38819-4e91-4cfe-8fcb-bb541aead25f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:40:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:40:56 user nova-compute[75745]: DEBUG nova.network.neutron [None req-80f38819-4e91-4cfe-8fcb-bb541aead25f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Updating instance_info_cache with network_info: [{"id": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "address": "fa:16:3e:08:eb:e0", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0b2dc1-93", "ovs_interfaceid": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:40:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-80f38819-4e91-4cfe-8fcb-bb541aead25f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Releasing lock "refresh_cache-3793542a-2aeb-48a8-98c9-a05755aa708e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:40:56 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Instance destroyed successfully.
Dec 01 17:40:56 user nova-compute[75745]: DEBUG nova.objects.instance [None req-80f38819-4e91-4cfe-8fcb-bb541aead25f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lazy-loading 'resources' on Instance uuid 3793542a-2aeb-48a8-98c9-a05755aa708e {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:40:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-80f38819-4e91-4cfe-8fcb-bb541aead25f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:38:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1003279284',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1003279284',id=44,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcQCSrwD4JtgfCYf4reZFDST8WTEo0dhy0owtKX6n8CWePIMWjMZaIRxx+5eriy40cQVQD7h7D5FYpkS/0KzeAes/NVzOnzK3FmwcemVryPyyRJbeWzwkcZhpDEIthh5w==',key_name='tempest-keypair-186142728',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:39:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2b1e7099305f4571804612f3a3d8befb',ramdisk_id='',reservation_id='r-ngh0576r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1555393357',owner_user_name='tempest-AttachVolumeShelveTestJSON-1555393357-project-member',shelved_at='2023-12-01T17:40:55.723972',shelved_host='user',shelved_image_id='af6dea76-5df1-4873-a011-ae20ecdefc13'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:40:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f78365cc1e11444db345efc5fe3cc502',uuid=3793542a-2aeb-48a8-98c9-a05755aa708e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "address": "fa:16:3e:08:eb:e0", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0b2dc1-93", "ovs_interfaceid": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:40:56 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-80f38819-4e91-4cfe-8fcb-bb541aead25f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Converting VIF {"id": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "address": "fa:16:3e:08:eb:e0", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0b2dc1-93", "ovs_interfaceid": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:40:56 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-80f38819-4e91-4cfe-8fcb-bb541aead25f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:eb:e0,bridge_name='br-int',has_traffic_filtering=True,id=6e0b2dc1-93ba-4f89-9059-51d908bd03c8,network=Network(773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e0b2dc1-93') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:40:56 user nova-compute[75745]: DEBUG os_vif [None req-80f38819-4e91-4cfe-8fcb-bb541aead25f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:eb:e0,bridge_name='br-int',has_traffic_filtering=True,id=6e0b2dc1-93ba-4f89-9059-51d908bd03c8,network=Network(773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e0b2dc1-93') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:40:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:40:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e0b2dc1-93, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:40:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:40:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:40:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:40:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7b50ba5d-a0c9-45df-a408-d608e2c164d0) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:40:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:40:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:40:56 user nova-compute[75745]: INFO os_vif [None req-80f38819-4e91-4cfe-8fcb-bb541aead25f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:eb:e0,bridge_name='br-int',has_traffic_filtering=True,id=6e0b2dc1-93ba-4f89-9059-51d908bd03c8,network=Network(773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e0b2dc1-93')
Dec 01 17:40:56 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-80f38819-4e91-4cfe-8fcb-bb541aead25f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Deleting instance files /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e_del
Dec 01 17:40:56 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-80f38819-4e91-4cfe-8fcb-bb541aead25f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Deletion of /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e_del complete
Dec 01 17:40:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-eba8af15-7c0e-42d0-8b41-21dd6c2b78fc req-1082620b-d944-4507-a4de-af71957b9a66 service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Received event network-changed-6e0b2dc1-93ba-4f89-9059-51d908bd03c8 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:40:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-eba8af15-7c0e-42d0-8b41-21dd6c2b78fc req-1082620b-d944-4507-a4de-af71957b9a66 service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Refreshing instance network info cache due to event network-changed-6e0b2dc1-93ba-4f89-9059-51d908bd03c8. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:40:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-eba8af15-7c0e-42d0-8b41-21dd6c2b78fc req-1082620b-d944-4507-a4de-af71957b9a66 service nova] Acquiring lock "refresh_cache-3793542a-2aeb-48a8-98c9-a05755aa708e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:40:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-eba8af15-7c0e-42d0-8b41-21dd6c2b78fc req-1082620b-d944-4507-a4de-af71957b9a66 service nova] Acquired lock "refresh_cache-3793542a-2aeb-48a8-98c9-a05755aa708e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:40:56 user nova-compute[75745]: DEBUG nova.network.neutron [req-eba8af15-7c0e-42d0-8b41-21dd6c2b78fc req-1082620b-d944-4507-a4de-af71957b9a66 service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Refreshing network info cache for port 6e0b2dc1-93ba-4f89-9059-51d908bd03c8 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:40:56 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-80f38819-4e91-4cfe-8fcb-bb541aead25f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Deleted allocations for instance 3793542a-2aeb-48a8-98c9-a05755aa708e
Dec 01 17:40:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-80f38819-4e91-4cfe-8fcb-bb541aead25f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:40:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-80f38819-4e91-4cfe-8fcb-bb541aead25f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:40:56 user nova-compute[75745]: DEBUG nova.objects.instance [None req-80f38819-4e91-4cfe-8fcb-bb541aead25f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lazy-loading 'numa_topology' on Instance uuid 3793542a-2aeb-48a8-98c9-a05755aa708e {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:40:56 user nova-compute[75745]: DEBUG nova.objects.base [None req-80f38819-4e91-4cfe-8fcb-bb541aead25f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Object Instance<3793542a-2aeb-48a8-98c9-a05755aa708e> lazy-loaded attributes: resources,numa_topology {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:40:57 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-80f38819-4e91-4cfe-8fcb-bb541aead25f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:40:57 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-80f38819-4e91-4cfe-8fcb-bb541aead25f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:40:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-80f38819-4e91-4cfe-8fcb-bb541aead25f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:40:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-80f38819-4e91-4cfe-8fcb-bb541aead25f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "3793542a-2aeb-48a8-98c9-a05755aa708e" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.303s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:40:57 user nova-compute[75745]: DEBUG nova.network.neutron [req-eba8af15-7c0e-42d0-8b41-21dd6c2b78fc req-1082620b-d944-4507-a4de-af71957b9a66 service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Updated VIF entry in instance network info cache for port 6e0b2dc1-93ba-4f89-9059-51d908bd03c8. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:40:57 user nova-compute[75745]: DEBUG nova.network.neutron [req-eba8af15-7c0e-42d0-8b41-21dd6c2b78fc req-1082620b-d944-4507-a4de-af71957b9a66 service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Updating instance_info_cache with network_info: [{"id": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "address": "fa:16:3e:08:eb:e0", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap6e0b2dc1-93", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:40:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-eba8af15-7c0e-42d0-8b41-21dd6c2b78fc req-1082620b-d944-4507-a4de-af71957b9a66 service nova] Releasing lock "refresh_cache-3793542a-2aeb-48a8-98c9-a05755aa708e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:41:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:41:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:41:05 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:41:05 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:41:05 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:41:05 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:41:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:41:07 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:41:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:41:09 user nova-compute[75745]: DEBUG nova.compute.manager [req-0254621b-1f9f-4f35-9fa7-96b870a875bd req-e4ed618b-bcc5-4068-b8b5-0b1bef41929c service nova] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Received event network-changed-fe2e9541-b487-4b3d-92fd-93f429bba1f4 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:41:09 user nova-compute[75745]: DEBUG nova.compute.manager [req-0254621b-1f9f-4f35-9fa7-96b870a875bd req-e4ed618b-bcc5-4068-b8b5-0b1bef41929c service nova] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Refreshing instance network info cache due to event network-changed-fe2e9541-b487-4b3d-92fd-93f429bba1f4. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:41:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0254621b-1f9f-4f35-9fa7-96b870a875bd req-e4ed618b-bcc5-4068-b8b5-0b1bef41929c service nova] Acquiring lock "refresh_cache-13972a4e-b898-438d-bd60-20bb09b89453" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:41:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0254621b-1f9f-4f35-9fa7-96b870a875bd req-e4ed618b-bcc5-4068-b8b5-0b1bef41929c service nova] Acquired lock "refresh_cache-13972a4e-b898-438d-bd60-20bb09b89453" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:41:09 user nova-compute[75745]: DEBUG nova.network.neutron [req-0254621b-1f9f-4f35-9fa7-96b870a875bd req-e4ed618b-bcc5-4068-b8b5-0b1bef41929c service nova] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Refreshing network info cache for port fe2e9541-b487-4b3d-92fd-93f429bba1f4 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:41:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Acquiring lock "13972a4e-b898-438d-bd60-20bb09b89453" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:41:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "13972a4e-b898-438d-bd60-20bb09b89453" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:41:09 user nova-compute[75745]: DEBUG nova.objects.instance [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lazy-loading 'flavor' on Instance uuid 13972a4e-b898-438d-bd60-20bb09b89453 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:41:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "13972a4e-b898-438d-bd60-20bb09b89453" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:41:09 user nova-compute[75745]: DEBUG nova.network.neutron [req-0254621b-1f9f-4f35-9fa7-96b870a875bd req-e4ed618b-bcc5-4068-b8b5-0b1bef41929c service nova] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Updated VIF entry in instance network info cache for port fe2e9541-b487-4b3d-92fd-93f429bba1f4. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:41:09 user nova-compute[75745]: DEBUG nova.network.neutron [req-0254621b-1f9f-4f35-9fa7-96b870a875bd req-e4ed618b-bcc5-4068-b8b5-0b1bef41929c service nova] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Updating instance_info_cache with network_info: [{"id": "fe2e9541-b487-4b3d-92fd-93f429bba1f4", "address": "fa:16:3e:ee:0a:3c", "network": {"id": "ab165176-5fd5-4df3-97fc-464c4a6891d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2005430003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0aff17da1db4afbb8563237035d13f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2e9541-b4", "ovs_interfaceid": "fe2e9541-b487-4b3d-92fd-93f429bba1f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:41:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0254621b-1f9f-4f35-9fa7-96b870a875bd req-e4ed618b-bcc5-4068-b8b5-0b1bef41929c service nova] Releasing lock "refresh_cache-13972a4e-b898-438d-bd60-20bb09b89453" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:41:09 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:41:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Acquiring lock "13972a4e-b898-438d-bd60-20bb09b89453" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:41:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "13972a4e-b898-438d-bd60-20bb09b89453" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:41:09 user nova-compute[75745]: INFO nova.compute.manager [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Attaching volume 8ac965ff-4713-4e74-ace5-d97f15dc5f4e to /dev/vdb
Dec 01 17:41:09 user nova-compute[75745]: DEBUG os_brick.utils [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:41:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:41:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:41:09 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[16798176-5ac0-42b6-abfe-eba1ba8455d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:41:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:41:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:41:09 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf63c4f-beb2-490e-8382-f14bc94acd8a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:41:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:41:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:41:09 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8670c817-adfe-4a87-9196-7f393719caeb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:41:09 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbd2cd9-a4f2-4cd5-9efe-f3e5de4aca74]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:41:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:41:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:41:10 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:41:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:41:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:41:10 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:41:10 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5fc9d0-0a71-4335-a566-d2cd7f56456b]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:41:10 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:41:10 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:41:10 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:41:10 user nova-compute[75745]: DEBUG os_brick.utils [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:41:10 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Updating existing volume attachment record: 0781b7a8-ce70-4d9f-84b1-9cf5d2f6b501 {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:41:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:41:10 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:41:10 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:41:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:41:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:41:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:41:10 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:41:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13972a4e-b898-438d-bd60-20bb09b89453/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:41:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13972a4e-b898-438d-bd60-20bb09b89453/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:41:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13972a4e-b898-438d-bd60-20bb09b89453/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:41:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13972a4e-b898-438d-bd60-20bb09b89453/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:41:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:41:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:41:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:41:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:41:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:41:12 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:41:12 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:41:12 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=8878MB free_disk=25.037982940673828GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:41:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:41:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:41:12 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 3c990a0a-188a-4973-846a-d09c98918500 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:41:12 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 13972a4e-b898-438d-bd60-20bb09b89453 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:41:12 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:41:12 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:41:12 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:41:12 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:41:12 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:41:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.230s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:41:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:41:17 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:41:17 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'snBoDzPa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:41:18 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:41:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:41:18 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:41:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:41:18 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:41:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[233c4fd2-e5d2-4adb-87ad-5ae7a27d8cb5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:41:18 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce4bc9f-c3c5-4fbb-b4ec-56fcc3370567]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e] added
Dec 01 17:41:18 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d653a2b-1b44-4120-8ddc-2692dc77efd2]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5e75d1-6b4d-44bd-aa94-32fe32febfe3]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v snBoDzPa {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v snBoDzPa" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d864ab5-5826-400f-8c0c-682aa822f53d]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'snBoDzPa'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4e745b-2296-4928-8898-9e7578c09321]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[14316ac9-3fed-4e8c-9323-818f03364e15]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 01 17:41:18 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 01 17:41:18 user nova-compute[75745]:  {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:41:18 user nova-compute[75745]: WARNING os_brick.initiator.connectors.iscsi [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 01 17:41:18 user nova-compute[75745]: 
Dec 01 17:41:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-13972a4e-b898-438d-bd60-20bb09b89453" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-13972a4e-b898-438d-bd60-20bb09b89453" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:41:18 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:41:19 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Updating instance_info_cache with network_info: [{"id": "fe2e9541-b487-4b3d-92fd-93f429bba1f4", "address": "fa:16:3e:ee:0a:3c", "network": {"id": "ab165176-5fd5-4df3-97fc-464c4a6891d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2005430003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0aff17da1db4afbb8563237035d13f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2e9541-b4", "ovs_interfaceid": "fe2e9541-b487-4b3d-92fd-93f429bba1f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:41:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-13972a4e-b898-438d-bd60-20bb09b89453" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:41:19 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:41:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e -p 172.16.0.220:3260 --login" returned: 0 in 1.045s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:41:19 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47ba6ba-3fe2-4bd7-bc35-4f4ea029f685]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:41:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e, portal: 172.16.0.220,3260]
Dec 01 17:41:19 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e, portal: 172.16.0.220,3260] successful.
Dec 01 17:41:19 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:41:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:41:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:41:19 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5147c89e-5dd3-4fc0-a014-0f935a0909bb]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:41:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:41:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:41:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:41:19 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[595a72b1-87b3-45bb-b15e-bac8152d220a]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:41:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e (non-flash)
Dec 01 17:41:19 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:41:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e (non-flash)
Dec 01 17:41:19 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:41:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.249s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:41:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:41:19 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:41:19 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:41:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:41:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:41:19 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[74edd40c-3b23-420f-b6ae-79d52c416f1f]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:41:19 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:41:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:41:20 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:41:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'snBoDzPa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:41:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.286s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:41:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] <== connect_volume: return (2287ms) {'type': 'block', 'scsi_wwn': '26134306231356461', 'path': '/dev/sdb'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:41:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134306231356461', 'path': '/dev/sdb'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:41:20 user nova-compute[75745]: DEBUG nova.objects.instance [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lazy-loading 'flavor' on Instance uuid 13972a4e-b898-438d-bd60-20bb09b89453 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:41:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 17:41:20 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:41:20 user nova-compute[75745]:   <source dev="/dev/sdb"/>
Dec 01 17:41:20 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:41:20 user nova-compute[75745]:   <serial>8ac965ff-4713-4e74-ace5-d97f15dc5f4e</serial>
Dec 01 17:41:20 user nova-compute[75745]: </disk>
Dec 01 17:41:20 user nova-compute[75745]:  {{(pid=75745) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 17:41:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:41:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:41:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] No VIF found with MAC fa:16:3e:ee:0a:3c, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:41:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4b530b86-3595-449a-b2a2-dc98112eff6c tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "13972a4e-b898-438d-bd60-20bb09b89453" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.558s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:41:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:41:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Acquiring lock "13972a4e-b898-438d-bd60-20bb09b89453" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:41:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "13972a4e-b898-438d-bd60-20bb09b89453" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:41:22 user nova-compute[75745]: INFO nova.compute.manager [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Detaching volume 8ac965ff-4713-4e74-ace5-d97f15dc5f4e
Dec 01 17:41:22 user nova-compute[75745]: INFO nova.virt.block_device [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Attempting to driver detach volume 8ac965ff-4713-4e74-ace5-d97f15dc5f4e from mountpoint /dev/vdb
Dec 01 17:41:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Attempting to detach device vdb from instance 13972a4e-b898-438d-bd60-20bb09b89453 from the persistent domain config. {{(pid=75745) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 17:41:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:41:22 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:41:22 user nova-compute[75745]:   <source dev="/dev/sdb"/>
Dec 01 17:41:22 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:41:22 user nova-compute[75745]:   <serial>8ac965ff-4713-4e74-ace5-d97f15dc5f4e</serial>
Dec 01 17:41:22 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 17:41:22 user nova-compute[75745]: </disk>
Dec 01 17:41:22 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:41:22 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Successfully detached device vdb from instance 13972a4e-b898-438d-bd60-20bb09b89453 from the persistent domain config.
Dec 01 17:41:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 13972a4e-b898-438d-bd60-20bb09b89453 from the live domain config. {{(pid=75745) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 17:41:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:41:22 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:41:22 user nova-compute[75745]:   <source dev="/dev/sdb"/>
Dec 01 17:41:22 user nova-compute[75745]:   <target dev="vdb" bus="virtio"/>
Dec 01 17:41:22 user nova-compute[75745]:   <serial>8ac965ff-4713-4e74-ace5-d97f15dc5f4e</serial>
Dec 01 17:41:22 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 17:41:22 user nova-compute[75745]: </disk>
Dec 01 17:41:22 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:41:23 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 13972a4e-b898-438d-bd60-20bb09b89453 {{(pid=75745) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 17:41:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:41:27 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:41:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:41:32 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:41:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:41:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:41:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:41:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:41:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:41:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:41:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.imagecache [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Verify base images {{(pid=75745) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Dec 01 17:41:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.imagecache [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Image id 3a567948-76e8-4c75-98f5-54a545fceeb5 yields fingerprint 5d497edcca8844d9331d80de3c82fd2083dd8599 {{(pid=75745) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Dec 01 17:41:32 user nova-compute[75745]: INFO nova.virt.libvirt.imagecache [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] image 3a567948-76e8-4c75-98f5-54a545fceeb5 at (/opt/stack/data/nova/instances/_base/5d497edcca8844d9331d80de3c82fd2083dd8599): checking
Dec 01 17:41:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.imagecache [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] image 3a567948-76e8-4c75-98f5-54a545fceeb5 at (/opt/stack/data/nova/instances/_base/5d497edcca8844d9331d80de3c82fd2083dd8599): image is in use {{(pid=75745) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Dec 01 17:41:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.imagecache [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75745) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Dec 01 17:41:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.imagecache [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Image id 695c84b8-d08d-488d-9841-cc1da92fb985 yields fingerprint c8853abafd3b960abf164c2d738731e067f690bf {{(pid=75745) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Dec 01 17:41:32 user nova-compute[75745]: INFO nova.virt.libvirt.imagecache [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] image 695c84b8-d08d-488d-9841-cc1da92fb985 at (/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf): checking
Dec 01 17:41:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.imagecache [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] image 695c84b8-d08d-488d-9841-cc1da92fb985 at (/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf): image is in use {{(pid=75745) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Dec 01 17:41:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.imagecache [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] 13972a4e-b898-438d-bd60-20bb09b89453 is a valid instance name {{(pid=75745) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Dec 01 17:41:32 user nova-compute[75745]: DEBUG nova.virt.libvirt.imagecache [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] 13972a4e-b898-438d-bd60-20bb09b89453 has a disk file {{(pid=75745) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Dec 01 17:41:32 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13972a4e-b898-438d-bd60-20bb09b89453/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:41:33 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13972a4e-b898-438d-bd60-20bb09b89453/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:41:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.imagecache [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 13972a4e-b898-438d-bd60-20bb09b89453 is backed by 5d497edcca8844d9331d80de3c82fd2083dd8599 {{(pid=75745) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Dec 01 17:41:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.imagecache [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] 3c990a0a-188a-4973-846a-d09c98918500 is a valid instance name {{(pid=75745) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Dec 01 17:41:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.imagecache [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] 3c990a0a-188a-4973-846a-d09c98918500 has a disk file {{(pid=75745) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Dec 01 17:41:33 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:41:33 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:41:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.imagecache [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 3c990a0a-188a-4973-846a-d09c98918500 is backed by c8853abafd3b960abf164c2d738731e067f690bf {{(pid=75745) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Dec 01 17:41:33 user nova-compute[75745]: WARNING nova.virt.libvirt.imagecache [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9baa52f0563aa01ef86ccc990e0971563d7e1530
Dec 01 17:41:33 user nova-compute[75745]: WARNING nova.virt.libvirt.imagecache [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1272d41440fb2e0fa65f0fb2741276acbb416358
Dec 01 17:41:33 user nova-compute[75745]: WARNING nova.virt.libvirt.imagecache [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a4c04ba342c0aeea48d647aae442fc0990563d86
Dec 01 17:41:33 user nova-compute[75745]: WARNING nova.virt.libvirt.imagecache [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e86ba2f36b2b3f5ac59848f2c60ebbd1950a493a
Dec 01 17:41:33 user nova-compute[75745]: WARNING nova.virt.libvirt.imagecache [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a9723ca95a631d31b9d4e5e654b4b630a693ec7a
Dec 01 17:41:33 user nova-compute[75745]: WARNING nova.virt.libvirt.imagecache [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/adc667bbe95b665dffefc10f171a91c672a52d6a
Dec 01 17:41:33 user nova-compute[75745]: INFO nova.virt.libvirt.imagecache [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Active base files: /opt/stack/data/nova/instances/_base/5d497edcca8844d9331d80de3c82fd2083dd8599 /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf
Dec 01 17:41:33 user nova-compute[75745]: INFO nova.virt.libvirt.imagecache [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Removable base files: /opt/stack/data/nova/instances/_base/9baa52f0563aa01ef86ccc990e0971563d7e1530 /opt/stack/data/nova/instances/_base/1272d41440fb2e0fa65f0fb2741276acbb416358 /opt/stack/data/nova/instances/_base/a4c04ba342c0aeea48d647aae442fc0990563d86 /opt/stack/data/nova/instances/_base/e86ba2f36b2b3f5ac59848f2c60ebbd1950a493a /opt/stack/data/nova/instances/_base/a9723ca95a631d31b9d4e5e654b4b630a693ec7a /opt/stack/data/nova/instances/_base/adc667bbe95b665dffefc10f171a91c672a52d6a
Dec 01 17:41:33 user nova-compute[75745]: INFO nova.virt.libvirt.imagecache [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9baa52f0563aa01ef86ccc990e0971563d7e1530
Dec 01 17:41:33 user nova-compute[75745]: INFO nova.virt.libvirt.imagecache [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1272d41440fb2e0fa65f0fb2741276acbb416358
Dec 01 17:41:33 user nova-compute[75745]: INFO nova.virt.libvirt.imagecache [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a4c04ba342c0aeea48d647aae442fc0990563d86
Dec 01 17:41:33 user nova-compute[75745]: INFO nova.virt.libvirt.imagecache [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e86ba2f36b2b3f5ac59848f2c60ebbd1950a493a
Dec 01 17:41:33 user nova-compute[75745]: INFO nova.virt.libvirt.imagecache [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a9723ca95a631d31b9d4e5e654b4b630a693ec7a
Dec 01 17:41:33 user nova-compute[75745]: INFO nova.virt.libvirt.imagecache [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/adc667bbe95b665dffefc10f171a91c672a52d6a
Dec 01 17:41:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.imagecache [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Verification complete {{(pid=75745) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Dec 01 17:41:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.imagecache [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Verify swap images {{(pid=75745) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Dec 01 17:41:33 user nova-compute[75745]: DEBUG nova.virt.libvirt.imagecache [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Verify ephemeral images {{(pid=75745) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Dec 01 17:41:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:41:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:41:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:41:43 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 13972a4e-b898-438d-bd60-20bb09b89453 is timed out.
Dec 01 17:41:43 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Successfully detached device vdb from instance 13972a4e-b898-438d-bd60-20bb09b89453 from the live domain config.
Dec 01 17:41:43 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'snBoDzPa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:41:43 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:41:43 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9562b4b6-282b-4919-9884-0b8203b3eeb0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:41:43 user nova-compute[75745]: No targets found.
Dec 01 17:41:43 user nova-compute[75745]: iSNS:
Dec 01 17:41:43 user nova-compute[75745]: No targets found.
Dec 01 17:41:43 user nova-compute[75745]: STATIC:
Dec 01 17:41:43 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e
Dec 01 17:41:43 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:41:43 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:41:43 user nova-compute[75745]: FIRMWARE:
Dec 01 17:41:43 user nova-compute[75745]: No targets found.
Dec 01 17:41:43 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:41:43 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:41:43 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd8fae1-6ebc-4805-96eb-915d5ba593ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac948578-22e8-46ea-841b-01d5d4d00220]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e (non-flash)
Dec 01 17:41:43 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e (non-flash)
Dec 01 17:41:43 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b85f56c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e'): ({'sdb'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Removing single pathed devices sdb {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfaba1e5-0dac-432d-8b9f-af2d99c629ef]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[51460f78-62d3-4476-aac4-f17ad4fed7d2]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Flushing IO for device /dev/sdb {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[203df97c-63d1-4d1e-bbfc-87d11699e165]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[64140043-d52d-4919-826b-370e9a2c2878]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] SCSI volumes sdb have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25fea76-527e-40b1-a7f3-85eb4d33b6f8]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e97573-69c9-4314-830f-6bb0b3c2e105]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e, portal: 172.16.0.220,3260]
Dec 01 17:41:43 user nova-compute[75745]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e, portal: 172.16.0.220,3260] successful.
Dec 01 17:41:43 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ac965ff-4713-4e74-ace5-d97f15dc5f4e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a85944-5549-484e-9112-4d849b84eda8]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] <== disconnect_volume: return (280ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:41:43 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:41:44 user nova-compute[75745]: DEBUG nova.objects.instance [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lazy-loading 'flavor' on Instance uuid 13972a4e-b898-438d-bd60-20bb09b89453 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:41:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-8ee7f4c3-c596-4de3-b673-faac748c9134 tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "13972a4e-b898-438d-bd60-20bb09b89453" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.654s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:41:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:41:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:41:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:42:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:42:06 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:42:06 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:42:06 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Cleaning up deleted instances {{(pid=75745) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 01 17:42:06 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] There are 0 instances to clean {{(pid=75745) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 01 17:42:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:42:07 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:42:07 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:42:07 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:42:08 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:42:09 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:42:10 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:42:11 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:42:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:42:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:42:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:42:11 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:42:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13972a4e-b898-438d-bd60-20bb09b89453/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:42:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:42:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13972a4e-b898-438d-bd60-20bb09b89453/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:42:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13972a4e-b898-438d-bd60-20bb09b89453/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:42:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13972a4e-b898-438d-bd60-20bb09b89453/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:42:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:42:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:42:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:42:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:42:13 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:42:13 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:42:13 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=8865MB free_disk=25.03708267211914GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:42:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:42:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:42:13 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 3c990a0a-188a-4973-846a-d09c98918500 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:42:13 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 13972a4e-b898-438d-bd60-20bb09b89453 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:42:13 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:42:13 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:42:13 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:42:13 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:42:13 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:42:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:42:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:42:13 user nova-compute[75745]: DEBUG nova.compute.manager [req-8258548e-d8d6-4bc7-b312-177d795763ce req-4814b7d6-dd5b-499d-9e7d-3c4d683499b3 service nova] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Received event network-changed-fe2e9541-b487-4b3d-92fd-93f429bba1f4 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:42:13 user nova-compute[75745]: DEBUG nova.compute.manager [req-8258548e-d8d6-4bc7-b312-177d795763ce req-4814b7d6-dd5b-499d-9e7d-3c4d683499b3 service nova] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Refreshing instance network info cache due to event network-changed-fe2e9541-b487-4b3d-92fd-93f429bba1f4. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:42:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8258548e-d8d6-4bc7-b312-177d795763ce req-4814b7d6-dd5b-499d-9e7d-3c4d683499b3 service nova] Acquiring lock "refresh_cache-13972a4e-b898-438d-bd60-20bb09b89453" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:42:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8258548e-d8d6-4bc7-b312-177d795763ce req-4814b7d6-dd5b-499d-9e7d-3c4d683499b3 service nova] Acquired lock "refresh_cache-13972a4e-b898-438d-bd60-20bb09b89453" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:42:13 user nova-compute[75745]: DEBUG nova.network.neutron [req-8258548e-d8d6-4bc7-b312-177d795763ce req-4814b7d6-dd5b-499d-9e7d-3c4d683499b3 service nova] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Refreshing network info cache for port fe2e9541-b487-4b3d-92fd-93f429bba1f4 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:42:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c77d4b90-833a-4b5f-b78a-b2642b06f65e tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Acquiring lock "13972a4e-b898-438d-bd60-20bb09b89453" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:42:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c77d4b90-833a-4b5f-b78a-b2642b06f65e tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "13972a4e-b898-438d-bd60-20bb09b89453" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:42:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c77d4b90-833a-4b5f-b78a-b2642b06f65e tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Acquiring lock "13972a4e-b898-438d-bd60-20bb09b89453-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:42:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c77d4b90-833a-4b5f-b78a-b2642b06f65e tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "13972a4e-b898-438d-bd60-20bb09b89453-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:42:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c77d4b90-833a-4b5f-b78a-b2642b06f65e tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "13972a4e-b898-438d-bd60-20bb09b89453-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:42:13 user nova-compute[75745]: INFO nova.compute.manager [None req-c77d4b90-833a-4b5f-b78a-b2642b06f65e tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Terminating instance
Dec 01 17:42:13 user nova-compute[75745]: DEBUG nova.compute.manager [None req-c77d4b90-833a-4b5f-b78a-b2642b06f65e tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:42:13 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:42:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:42:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:42:14 user nova-compute[75745]: DEBUG nova.network.neutron [req-8258548e-d8d6-4bc7-b312-177d795763ce req-4814b7d6-dd5b-499d-9e7d-3c4d683499b3 service nova] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Updated VIF entry in instance network info cache for port fe2e9541-b487-4b3d-92fd-93f429bba1f4. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:42:14 user nova-compute[75745]: DEBUG nova.network.neutron [req-8258548e-d8d6-4bc7-b312-177d795763ce req-4814b7d6-dd5b-499d-9e7d-3c4d683499b3 service nova] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Updating instance_info_cache with network_info: [{"id": "fe2e9541-b487-4b3d-92fd-93f429bba1f4", "address": "fa:16:3e:ee:0a:3c", "network": {"id": "ab165176-5fd5-4df3-97fc-464c4a6891d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2005430003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0aff17da1db4afbb8563237035d13f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2e9541-b4", "ovs_interfaceid": "fe2e9541-b487-4b3d-92fd-93f429bba1f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:42:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8258548e-d8d6-4bc7-b312-177d795763ce req-4814b7d6-dd5b-499d-9e7d-3c4d683499b3 service nova] Releasing lock "refresh_cache-13972a4e-b898-438d-bd60-20bb09b89453" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:42:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:42:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:42:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:42:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:42:14 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Instance destroyed successfully.
Dec 01 17:42:14 user nova-compute[75745]: DEBUG nova.objects.instance [None req-c77d4b90-833a-4b5f-b78a-b2642b06f65e tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lazy-loading 'resources' on Instance uuid 13972a4e-b898-438d-bd60-20bb09b89453 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:42:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-c77d4b90-833a-4b5f-b78a-b2642b06f65e tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:39:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1673397788',display_name='tempest-TestStampPattern-server-1673397788',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1673397788',id=45,image_ref='3a567948-76e8-4c75-98f5-54a545fceeb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGNrLA5bKvG55GGS8MBbWt09LoTtS2gvVG2BKmrPsKsEdhegbzNdpBAYjEqY7P16s1fTayXnvtFgTmvCamKaUfjqCdJv5fIccc9eDKhtquF0DkT05mxPdPEaU8Xc/LdjA==',key_name='tempest-TestStampPattern-115018569',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:39:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0aff17da1db4afbb8563237035d13f5',ramdisk_id='',reservation_id='r-f5wb2g66',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='3c990a0a-188a-4973-846a-d09c98918500',image_min_disk='1',image_min_ram='0',image_owner_id='e0aff17da1db4afbb8563237035d13f5',image_owner_project_name='tempest-TestStampPattern-885997284',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-885997284-project-member',image_user_id='2507209df93a48f1b17652da89646e14',owner_project_name='tempest-TestStampPattern-885997284',owner_user_name='tempest-TestStampPattern-885997284-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:39:24Z,user_data=None,user_id='2507209df93a48f1b17652da89646e14',uuid=13972a4e-b898-438d-bd60-20bb09b89453,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe2e9541-b487-4b3d-92fd-93f429bba1f4", "address": "fa:16:3e:ee:0a:3c", "network": {"id": "ab165176-5fd5-4df3-97fc-464c4a6891d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2005430003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0aff17da1db4afbb8563237035d13f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2e9541-b4", "ovs_interfaceid": "fe2e9541-b487-4b3d-92fd-93f429bba1f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:42:14 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-c77d4b90-833a-4b5f-b78a-b2642b06f65e tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Converting VIF {"id": "fe2e9541-b487-4b3d-92fd-93f429bba1f4", "address": "fa:16:3e:ee:0a:3c", "network": {"id": "ab165176-5fd5-4df3-97fc-464c4a6891d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2005430003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0aff17da1db4afbb8563237035d13f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2e9541-b4", "ovs_interfaceid": "fe2e9541-b487-4b3d-92fd-93f429bba1f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:42:14 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-c77d4b90-833a-4b5f-b78a-b2642b06f65e tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:0a:3c,bridge_name='br-int',has_traffic_filtering=True,id=fe2e9541-b487-4b3d-92fd-93f429bba1f4,network=Network(ab165176-5fd5-4df3-97fc-464c4a6891d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2e9541-b4') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:42:14 user nova-compute[75745]: DEBUG os_vif [None req-c77d4b90-833a-4b5f-b78a-b2642b06f65e tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:0a:3c,bridge_name='br-int',has_traffic_filtering=True,id=fe2e9541-b487-4b3d-92fd-93f429bba1f4,network=Network(ab165176-5fd5-4df3-97fc-464c4a6891d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2e9541-b4') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:42:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:42:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe2e9541-b4, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:42:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:42:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:42:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:42:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=69a17339-a112-48a8-b8b5-65311e94711d) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:42:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:42:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:42:14 user nova-compute[75745]: INFO os_vif [None req-c77d4b90-833a-4b5f-b78a-b2642b06f65e tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:0a:3c,bridge_name='br-int',has_traffic_filtering=True,id=fe2e9541-b487-4b3d-92fd-93f429bba1f4,network=Network(ab165176-5fd5-4df3-97fc-464c4a6891d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2e9541-b4')
Dec 01 17:42:14 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-c77d4b90-833a-4b5f-b78a-b2642b06f65e tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Deleting instance files /opt/stack/data/nova/instances/13972a4e-b898-438d-bd60-20bb09b89453_del
Dec 01 17:42:14 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-c77d4b90-833a-4b5f-b78a-b2642b06f65e tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Deletion of /opt/stack/data/nova/instances/13972a4e-b898-438d-bd60-20bb09b89453_del complete
Dec 01 17:42:14 user nova-compute[75745]: INFO nova.compute.manager [None req-c77d4b90-833a-4b5f-b78a-b2642b06f65e tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Took 0.86 seconds to destroy the instance on the hypervisor.
Dec 01 17:42:14 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-c77d4b90-833a-4b5f-b78a-b2642b06f65e tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:42:14 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:42:14 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:42:15 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:42:15 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Took 0.75 seconds to deallocate network for instance.
Dec 01 17:42:15 user nova-compute[75745]: DEBUG nova.compute.manager [req-64a3871b-fd6b-4b8e-8227-b0939c497e96 req-037e7d00-63c3-41f4-885b-d65d9f59dfe8 service nova] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Received event network-vif-deleted-fe2e9541-b487-4b3d-92fd-93f429bba1f4 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:42:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c77d4b90-833a-4b5f-b78a-b2642b06f65e tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:42:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c77d4b90-833a-4b5f-b78a-b2642b06f65e tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:42:15 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-c77d4b90-833a-4b5f-b78a-b2642b06f65e tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:42:15 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-c77d4b90-833a-4b5f-b78a-b2642b06f65e tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:42:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c77d4b90-833a-4b5f-b78a-b2642b06f65e tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.149s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:42:15 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-c77d4b90-833a-4b5f-b78a-b2642b06f65e tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Deleted allocations for instance 13972a4e-b898-438d-bd60-20bb09b89453
Dec 01 17:42:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-c77d4b90-833a-4b5f-b78a-b2642b06f65e tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "13972a4e-b898-438d-bd60-20bb09b89453" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.940s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:42:15 user nova-compute[75745]: DEBUG nova.compute.manager [req-7860f771-f4f1-47ce-b6fd-4d3e2b3c06c9 req-40c73e00-76e9-478a-b08d-e46af1dd3df1 service nova] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Received event network-vif-unplugged-fe2e9541-b487-4b3d-92fd-93f429bba1f4 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:42:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7860f771-f4f1-47ce-b6fd-4d3e2b3c06c9 req-40c73e00-76e9-478a-b08d-e46af1dd3df1 service nova] Acquiring lock "13972a4e-b898-438d-bd60-20bb09b89453-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:42:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7860f771-f4f1-47ce-b6fd-4d3e2b3c06c9 req-40c73e00-76e9-478a-b08d-e46af1dd3df1 service nova] Lock "13972a4e-b898-438d-bd60-20bb09b89453-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:42:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7860f771-f4f1-47ce-b6fd-4d3e2b3c06c9 req-40c73e00-76e9-478a-b08d-e46af1dd3df1 service nova] Lock "13972a4e-b898-438d-bd60-20bb09b89453-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:42:15 user nova-compute[75745]: DEBUG nova.compute.manager [req-7860f771-f4f1-47ce-b6fd-4d3e2b3c06c9 req-40c73e00-76e9-478a-b08d-e46af1dd3df1 service nova] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] No waiting events found dispatching network-vif-unplugged-fe2e9541-b487-4b3d-92fd-93f429bba1f4 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:42:15 user nova-compute[75745]: WARNING nova.compute.manager [req-7860f771-f4f1-47ce-b6fd-4d3e2b3c06c9 req-40c73e00-76e9-478a-b08d-e46af1dd3df1 service nova] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Received unexpected event network-vif-unplugged-fe2e9541-b487-4b3d-92fd-93f429bba1f4 for instance with vm_state deleted and task_state None.
Dec 01 17:42:15 user nova-compute[75745]: DEBUG nova.compute.manager [req-7860f771-f4f1-47ce-b6fd-4d3e2b3c06c9 req-40c73e00-76e9-478a-b08d-e46af1dd3df1 service nova] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Received event network-vif-plugged-fe2e9541-b487-4b3d-92fd-93f429bba1f4 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:42:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7860f771-f4f1-47ce-b6fd-4d3e2b3c06c9 req-40c73e00-76e9-478a-b08d-e46af1dd3df1 service nova] Acquiring lock "13972a4e-b898-438d-bd60-20bb09b89453-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:42:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7860f771-f4f1-47ce-b6fd-4d3e2b3c06c9 req-40c73e00-76e9-478a-b08d-e46af1dd3df1 service nova] Lock "13972a4e-b898-438d-bd60-20bb09b89453-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:42:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7860f771-f4f1-47ce-b6fd-4d3e2b3c06c9 req-40c73e00-76e9-478a-b08d-e46af1dd3df1 service nova] Lock "13972a4e-b898-438d-bd60-20bb09b89453-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:42:15 user nova-compute[75745]: DEBUG nova.compute.manager [req-7860f771-f4f1-47ce-b6fd-4d3e2b3c06c9 req-40c73e00-76e9-478a-b08d-e46af1dd3df1 service nova] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] No waiting events found dispatching network-vif-plugged-fe2e9541-b487-4b3d-92fd-93f429bba1f4 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:42:15 user nova-compute[75745]: WARNING nova.compute.manager [req-7860f771-f4f1-47ce-b6fd-4d3e2b3c06c9 req-40c73e00-76e9-478a-b08d-e46af1dd3df1 service nova] [instance: 13972a4e-b898-438d-bd60-20bb09b89453] Received unexpected event network-vif-plugged-fe2e9541-b487-4b3d-92fd-93f429bba1f4 for instance with vm_state deleted and task_state None.
Dec 01 17:42:16 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:42:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:42:20 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:42:20 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:42:20 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Rebuilding the list of instances to heal {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 17:42:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-3c990a0a-188a-4973-846a-d09c98918500" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:42:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-3c990a0a-188a-4973-846a-d09c98918500" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:42:20 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:42:20 user nova-compute[75745]: DEBUG nova.objects.instance [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lazy-loading 'info_cache' on Instance uuid 3c990a0a-188a-4973-846a-d09c98918500 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:42:21 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Updating instance_info_cache with network_info: [{"id": "964bbd9c-d6ac-462c-8342-f565c3ab2934", "address": "fa:16:3e:4a:af:e3", "network": {"id": "ab165176-5fd5-4df3-97fc-464c4a6891d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2005430003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0aff17da1db4afbb8563237035d13f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap964bbd9c-d6", "ovs_interfaceid": "964bbd9c-d6ac-462c-8342-f565c3ab2934", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:42:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-3c990a0a-188a-4973-846a-d09c98918500" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:42:21 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:42:21 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:42:21 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75745) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 01 17:42:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:42:25 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:42:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:42:34 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:42:34 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Triggering sync for uuid 3c990a0a-188a-4973-846a-d09c98918500 {{(pid=75745) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 17:42:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "3c990a0a-188a-4973-846a-d09c98918500" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:42:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "3c990a0a-188a-4973-846a-d09c98918500" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:42:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "3c990a0a-188a-4973-846a-d09c98918500" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:42:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:42:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:42:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "3793542a-2aeb-48a8-98c9-a05755aa708e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:42:44 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "3793542a-2aeb-48a8-98c9-a05755aa708e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:42:44 user nova-compute[75745]: INFO nova.compute.manager [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Unshelving
Dec 01 17:42:44 user nova-compute[75745]: INFO nova.virt.block_device [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Booting with volume 038e806e-f206-41d4-bf44-48db209b3896 at /dev/vdc
Dec 01 17:42:44 user nova-compute[75745]: DEBUG os_brick.utils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:42:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:42:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:42:44 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[baba6846-dd34-4674-9622-eb77066845ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:42:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:42:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:42:44 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[67dfe5cc-288e-4a43-823c-9c110a90f4dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:42:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:42:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:42:44 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fb20ff-3a3a-487c-a0fe-575849bf6479]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:42:44 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6d24a4-06f8-46b2-af05-6aa7f6898d2f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:42:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:42:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:42:44 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:42:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:42:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:42:44 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:42:44 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebcf9c1-c469-4b9f-876d-5becffb50d2f]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:42:44 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:42:44 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:42:44 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:42:44 user nova-compute[75745]: DEBUG os_brick.utils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:42:44 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Updating existing volume attachment record: 67131a0a-4ca2-401b-be7f-6e5eaf8597f3 {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:42:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:42:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:42:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:42:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:42:53 user nova-compute[75745]: DEBUG nova.objects.instance [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lazy-loading 'pci_requests' on Instance uuid 3793542a-2aeb-48a8-98c9-a05755aa708e {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:42:53 user nova-compute[75745]: DEBUG nova.objects.instance [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lazy-loading 'numa_topology' on Instance uuid 3793542a-2aeb-48a8-98c9-a05755aa708e {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:42:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:42:53 user nova-compute[75745]: INFO nova.compute.claims [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Claim successful on node user
Dec 01 17:42:53 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:42:53 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:42:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.257s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:42:53 user nova-compute[75745]: INFO nova.network.neutron [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Updating port 6e0b2dc1-93ba-4f89-9059-51d908bd03c8 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Dec 01 17:42:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "refresh_cache-3793542a-2aeb-48a8-98c9-a05755aa708e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:42:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquired lock "refresh_cache-3793542a-2aeb-48a8-98c9-a05755aa708e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:42:54 user nova-compute[75745]: DEBUG nova.network.neutron [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:42:54 user nova-compute[75745]: DEBUG nova.compute.manager [req-dfc77dc8-d5c9-4f8f-8e20-030bbd0f49f6 req-4af99f50-40e4-4074-b1e0-a167e5135f45 service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Received event network-changed-6e0b2dc1-93ba-4f89-9059-51d908bd03c8 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:42:54 user nova-compute[75745]: DEBUG nova.compute.manager [req-dfc77dc8-d5c9-4f8f-8e20-030bbd0f49f6 req-4af99f50-40e4-4074-b1e0-a167e5135f45 service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Refreshing instance network info cache due to event network-changed-6e0b2dc1-93ba-4f89-9059-51d908bd03c8. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:42:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-dfc77dc8-d5c9-4f8f-8e20-030bbd0f49f6 req-4af99f50-40e4-4074-b1e0-a167e5135f45 service nova] Acquiring lock "refresh_cache-3793542a-2aeb-48a8-98c9-a05755aa708e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:42:54 user nova-compute[75745]: DEBUG nova.network.neutron [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Updating instance_info_cache with network_info: [{"id": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "address": "fa:16:3e:08:eb:e0", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0b2dc1-93", "ovs_interfaceid": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:42:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Releasing lock "refresh_cache-3793542a-2aeb-48a8-98c9-a05755aa708e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:42:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:42:54 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Creating image(s)
Dec 01 17:42:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "/opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:42:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "/opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:42:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "/opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:42:54 user nova-compute[75745]: DEBUG nova.objects.instance [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3793542a-2aeb-48a8-98c9-a05755aa708e {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:42:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-dfc77dc8-d5c9-4f8f-8e20-030bbd0f49f6 req-4af99f50-40e4-4074-b1e0-a167e5135f45 service nova] Acquired lock "refresh_cache-3793542a-2aeb-48a8-98c9-a05755aa708e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:42:54 user nova-compute[75745]: DEBUG nova.network.neutron [req-dfc77dc8-d5c9-4f8f-8e20-030bbd0f49f6 req-4af99f50-40e4-4074-b1e0-a167e5135f45 service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Refreshing network info cache for port 6e0b2dc1-93ba-4f89-9059-51d908bd03c8 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:42:54 user nova-compute[75745]: DEBUG nova.objects.base [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Object Instance<3793542a-2aeb-48a8-98c9-a05755aa708e> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:42:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "d5135e90d083f145c1019eb1fdb3feb237e44bcf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:42:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "d5135e90d083f145c1019eb1fdb3feb237e44bcf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:42:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d5135e90d083f145c1019eb1fdb3feb237e44bcf.part --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:42:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:42:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d5135e90d083f145c1019eb1fdb3feb237e44bcf.part --force-share --output=json" returned: 0 in 0.178s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:42:55 user nova-compute[75745]: DEBUG nova.virt.images [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] af6dea76-5df1-4873-a011-ae20ecdefc13 was qcow2, converting to raw {{(pid=75745) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 01 17:42:55 user nova-compute[75745]: DEBUG nova.privsep.utils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75745) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 17:42:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d5135e90d083f145c1019eb1fdb3feb237e44bcf.part /opt/stack/data/nova/instances/_base/d5135e90d083f145c1019eb1fdb3feb237e44bcf.converted {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:42:55 user nova-compute[75745]: DEBUG nova.network.neutron [req-dfc77dc8-d5c9-4f8f-8e20-030bbd0f49f6 req-4af99f50-40e4-4074-b1e0-a167e5135f45 service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Updated VIF entry in instance network info cache for port 6e0b2dc1-93ba-4f89-9059-51d908bd03c8. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:42:55 user nova-compute[75745]: DEBUG nova.network.neutron [req-dfc77dc8-d5c9-4f8f-8e20-030bbd0f49f6 req-4af99f50-40e4-4074-b1e0-a167e5135f45 service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Updating instance_info_cache with network_info: [{"id": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "address": "fa:16:3e:08:eb:e0", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0b2dc1-93", "ovs_interfaceid": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:42:55 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-dfc77dc8-d5c9-4f8f-8e20-030bbd0f49f6 req-4af99f50-40e4-4074-b1e0-a167e5135f45 service nova] Releasing lock "refresh_cache-3793542a-2aeb-48a8-98c9-a05755aa708e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:42:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d5135e90d083f145c1019eb1fdb3feb237e44bcf.part /opt/stack/data/nova/instances/_base/d5135e90d083f145c1019eb1fdb3feb237e44bcf.converted" returned: 0 in 0.667s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:42:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d5135e90d083f145c1019eb1fdb3feb237e44bcf.converted --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:42:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d5135e90d083f145c1019eb1fdb3feb237e44bcf.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:42:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "d5135e90d083f145c1019eb1fdb3feb237e44bcf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.153s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:42:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d5135e90d083f145c1019eb1fdb3feb237e44bcf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:42:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d5135e90d083f145c1019eb1fdb3feb237e44bcf --force-share --output=json" returned: 0 in 0.173s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:42:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "d5135e90d083f145c1019eb1fdb3feb237e44bcf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:42:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "d5135e90d083f145c1019eb1fdb3feb237e44bcf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:42:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d5135e90d083f145c1019eb1fdb3feb237e44bcf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:42:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d5135e90d083f145c1019eb1fdb3feb237e44bcf --force-share --output=json" returned: 0 in 0.173s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:42:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d5135e90d083f145c1019eb1fdb3feb237e44bcf,backing_fmt=raw /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:42:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d5135e90d083f145c1019eb1fdb3feb237e44bcf,backing_fmt=raw /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk 1073741824" returned: 0 in 0.057s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:42:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "d5135e90d083f145c1019eb1fdb3feb237e44bcf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:42:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d5135e90d083f145c1019eb1fdb3feb237e44bcf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:42:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d5135e90d083f145c1019eb1fdb3feb237e44bcf --force-share --output=json" returned: 0 in 0.181s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:42:57 user nova-compute[75745]: DEBUG nova.objects.instance [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lazy-loading 'migration_context' on Instance uuid 3793542a-2aeb-48a8-98c9-a05755aa708e {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:42:57 user nova-compute[75745]: DEBUG nova.objects.base [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Object Instance<3793542a-2aeb-48a8-98c9-a05755aa708e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:42:57 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Rebasing disk image.
Dec 01 17:42:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:42:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.177s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:42:57 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf -F raw /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf -F raw /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk" returned: 0 in 2.242s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Ensure instance console log exists: /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Start _get_guest_xml network_info=[{"id": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "address": "fa:16:3e:08:eb:e0", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0b2dc1-93", "ovs_interfaceid": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='33ab56f9016d80dba95c42550ef05ffd',container_format='bare',created_at=2023-12-01T17:40:52Z,direct_url=<?>,disk_format='qcow2',id=af6dea76-5df1-4873-a011-ae20ecdefc13,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1003279284-shelved',owner='2b1e7099305f4571804612f3a3d8befb',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-12-01T17:40:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': '67131a0a-4ca2-401b-be7f-6e5eaf8597f3', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RalJZgiB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '3793542a-2aeb-48a8-98c9-a05755aa708e', 'attached_at': '', 'detached_at': '', 'volume_id': '038e806e-f206-41d4-bf44-48db209b3896', 'serial': '038e806e-f206-41d4-bf44-48db209b3896'}, 'mount_device': '/dev/vdc', 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:42:59 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:42:59 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:42:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='33ab56f9016d80dba95c42550ef05ffd',container_format='bare',created_at=2023-12-01T17:40:52Z,direct_url=<?>,disk_format='qcow2',id=af6dea76-5df1-4873-a011-ae20ecdefc13,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1003279284-shelved',owner='2b1e7099305f4571804612f3a3d8befb',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-12-01T17:40:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG nova.objects.instance [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3793542a-2aeb-48a8-98c9-a05755aa708e {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG nova.objects.base [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Object Instance<3793542a-2aeb-48a8-98c9-a05755aa708e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RalJZgiB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:42:59 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:42:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:42:59 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:42:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:42:59 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:42:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14995e7-e007-446b-996e-907f1d710126]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:42:59 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2aff2c7-c4db-4ec0-8216-88b33a88c77d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896] added
Dec 01 17:42:59 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0771bec6-87d1-4779-926b-7fc6897acfd1]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f41896f-abc9-4c51-9bef-1e09ea602891]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:42:59 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RalJZgiB {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RalJZgiB" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a9b470-cff8-4f32-8de7-4b4f3fd4ef44]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RalJZgiB'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[129e3751-dd62-41f7-ba27-186f921b29d9]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b1bf0a-808e-48d2-b7de-ccc53fc06ccd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 01 17:43:00 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 01 17:43:00 user nova-compute[75745]:  {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:43:00 user nova-compute[75745]: WARNING os_brick.initiator.connectors.iscsi [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 01 17:43:00 user nova-compute[75745]: 
Dec 01 17:43:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e14d4e-ac40-4442-89e2-6e79feaadb12]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896, portal: 172.16.0.220,3260]
Dec 01 17:43:00 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896, portal: 172.16.0.220,3260] successful.
Dec 01 17:43:00 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c710fbef-e390-4252-99e2-c9f81c7d8c4d]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9491ec03-2b55-4f18-a360-156ab2309834]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896 (non-flash)
Dec 01 17:43:00 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896 (non-flash)
Dec 01 17:43:00 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e5764b-ec02-4dcb-96f3-bf0528af3703]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:43:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:43:01 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:43:01 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RalJZgiB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:43:01 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:43:01 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '26664656637636535', 'path': '/dev/sdb'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:43:01 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664656637636535', 'path': '/dev/sdb'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:43:01 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T17:38:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1003279284',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1003279284',id=44,image_ref='af6dea76-5df1-4873-a011-ae20ecdefc13',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-186142728',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:39:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2b1e7099305f4571804612f3a3d8befb',ramdisk_id='',reservation_id='r-ngh0576r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1555393357',owner_user_name='tempest-AttachVolumeShelveTestJSON-1555393357-project-member',shelved_at='2023-12-01T17:40:55.723972',shelved_host='user',shelved_image_id='af6dea76-5df1-4873-a011-ae20ecdefc13'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:42:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f78365cc1e11444db345efc5fe3cc502',uuid=3793542a-2aeb-48a8-98c9-a05755aa708e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "address": "fa:16:3e:08:eb:e0", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0b2dc1-93", "ovs_interfaceid": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:43:01 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Converting VIF {"id": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "address": "fa:16:3e:08:eb:e0", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0b2dc1-93", "ovs_interfaceid": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:43:01 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:eb:e0,bridge_name='br-int',has_traffic_filtering=True,id=6e0b2dc1-93ba-4f89-9059-51d908bd03c8,network=Network(773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e0b2dc1-93') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:43:01 user nova-compute[75745]: DEBUG nova.objects.instance [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lazy-loading 'pci_devices' on Instance uuid 3793542a-2aeb-48a8-98c9-a05755aa708e {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:43:01 user nova-compute[75745]: DEBUG nova.objects.base [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Object Instance<3793542a-2aeb-48a8-98c9-a05755aa708e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:43:01 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:43:01 user nova-compute[75745]:   <uuid>3793542a-2aeb-48a8-98c9-a05755aa708e</uuid>
Dec 01 17:43:01 user nova-compute[75745]:   <name>instance-0000002c</name>
Dec 01 17:43:01 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:43:01 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:43:01 user nova-compute[75745]:   <metadata>
Dec 01 17:43:01 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:43:01 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:43:01 user nova-compute[75745]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1003279284</nova:name>
Dec 01 17:43:01 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:42:59</nova:creationTime>
Dec 01 17:43:01 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:43:01 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:43:01 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:43:01 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:43:01 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:43:01 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:43:01 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:43:01 user nova-compute[75745]:       <nova:owner>
Dec 01 17:43:01 user nova-compute[75745]:         <nova:user uuid="f78365cc1e11444db345efc5fe3cc502">tempest-AttachVolumeShelveTestJSON-1555393357-project-member</nova:user>
Dec 01 17:43:01 user nova-compute[75745]:         <nova:project uuid="2b1e7099305f4571804612f3a3d8befb">tempest-AttachVolumeShelveTestJSON-1555393357</nova:project>
Dec 01 17:43:01 user nova-compute[75745]:       </nova:owner>
Dec 01 17:43:01 user nova-compute[75745]:       <nova:root type="image" uuid="af6dea76-5df1-4873-a011-ae20ecdefc13"/>
Dec 01 17:43:01 user nova-compute[75745]:       <nova:ports>
Dec 01 17:43:01 user nova-compute[75745]:         <nova:port uuid="6e0b2dc1-93ba-4f89-9059-51d908bd03c8">
Dec 01 17:43:01 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 01 17:43:01 user nova-compute[75745]:         </nova:port>
Dec 01 17:43:01 user nova-compute[75745]:       </nova:ports>
Dec 01 17:43:01 user nova-compute[75745]:     </nova:instance>
Dec 01 17:43:01 user nova-compute[75745]:   </metadata>
Dec 01 17:43:01 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:43:01 user nova-compute[75745]:     <system>
Dec 01 17:43:01 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:43:01 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:43:01 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:43:01 user nova-compute[75745]:       <entry name="serial">3793542a-2aeb-48a8-98c9-a05755aa708e</entry>
Dec 01 17:43:01 user nova-compute[75745]:       <entry name="uuid">3793542a-2aeb-48a8-98c9-a05755aa708e</entry>
Dec 01 17:43:01 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:43:01 user nova-compute[75745]:     </system>
Dec 01 17:43:01 user nova-compute[75745]:   </sysinfo>
Dec 01 17:43:01 user nova-compute[75745]:   <os>
Dec 01 17:43:01 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:43:01 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:43:01 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:43:01 user nova-compute[75745]:   </os>
Dec 01 17:43:01 user nova-compute[75745]:   <features>
Dec 01 17:43:01 user nova-compute[75745]:     <acpi/>
Dec 01 17:43:01 user nova-compute[75745]:     <apic/>
Dec 01 17:43:01 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:43:01 user nova-compute[75745]:   </features>
Dec 01 17:43:01 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:43:01 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:43:01 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:43:01 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:43:01 user nova-compute[75745]:   </clock>
Dec 01 17:43:01 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:43:01 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:43:01 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:43:01 user nova-compute[75745]:   </cpu>
Dec 01 17:43:01 user nova-compute[75745]:   <devices>
Dec 01 17:43:01 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:43:01 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:43:01 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk"/>
Dec 01 17:43:01 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:43:01 user nova-compute[75745]:     </disk>
Dec 01 17:43:01 user nova-compute[75745]:     <disk type="block" device="disk">
Dec 01 17:43:01 user nova-compute[75745]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:43:01 user nova-compute[75745]:       <source dev="/dev/sdb"/>
Dec 01 17:43:01 user nova-compute[75745]:       <target dev="vdc" bus="virtio"/>
Dec 01 17:43:01 user nova-compute[75745]:       <serial>038e806e-f206-41d4-bf44-48db209b3896</serial>
Dec 01 17:43:01 user nova-compute[75745]:     </disk>
Dec 01 17:43:01 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:43:01 user nova-compute[75745]:       <mac address="fa:16:3e:08:eb:e0"/>
Dec 01 17:43:01 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:43:01 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:43:01 user nova-compute[75745]:       <target dev="tap6e0b2dc1-93"/>
Dec 01 17:43:01 user nova-compute[75745]:     </interface>
Dec 01 17:43:01 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:43:01 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/console.log" append="off"/>
Dec 01 17:43:01 user nova-compute[75745]:     </serial>
Dec 01 17:43:01 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:43:01 user nova-compute[75745]:     <video>
Dec 01 17:43:01 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:43:01 user nova-compute[75745]:     </video>
Dec 01 17:43:01 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:43:01 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:43:01 user nova-compute[75745]:     </rng>
Dec 01 17:43:01 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:43:01 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:43:01 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:43:01 user nova-compute[75745]:     </memballoon>
Dec 01 17:43:01 user nova-compute[75745]:   </devices>
Dec 01 17:43:01 user nova-compute[75745]: </domain>
Dec 01 17:43:01 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:43:01 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T17:38:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1003279284',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1003279284',id=44,image_ref='af6dea76-5df1-4873-a011-ae20ecdefc13',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-186142728',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:39:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2b1e7099305f4571804612f3a3d8befb',ramdisk_id='',reservation_id='r-ngh0576r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1555393357',owner_user_name='tempest-AttachVolumeShelveTestJSON-1555393357-project-member',shelved_at='2023-12-01T17:40:55.723972',shelved_host='user',shelved_image_id='af6dea76-5df1-4873-a011-ae20ecdefc13'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:42:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f78365cc1e11444db345efc5fe3cc502',uuid=3793542a-2aeb-48a8-98c9-a05755aa708e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "address": "fa:16:3e:08:eb:e0", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0b2dc1-93", "ovs_interfaceid": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:43:01 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Converting VIF {"id": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "address": "fa:16:3e:08:eb:e0", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0b2dc1-93", "ovs_interfaceid": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:43:01 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:eb:e0,bridge_name='br-int',has_traffic_filtering=True,id=6e0b2dc1-93ba-4f89-9059-51d908bd03c8,network=Network(773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e0b2dc1-93') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:43:01 user nova-compute[75745]: DEBUG os_vif [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:eb:e0,bridge_name='br-int',has_traffic_filtering=True,id=6e0b2dc1-93ba-4f89-9059-51d908bd03c8,network=Network(773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e0b2dc1-93') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:43:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:43:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:43:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:43:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:43:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '90ed5ac9-16da-56c7-95d7-ceb4b715421f', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:43:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:43:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:43:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e0b2dc1-93, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:43:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e0b2dc1-93, col_values=(('qos', UUID('8a62f050-a93a-40e0-9b83-1e5ea8ec3e3f')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:43:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e0b2dc1-93, col_values=(('external_ids', {'iface-id': '6e0b2dc1-93ba-4f89-9059-51d908bd03c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:eb:e0', 'vm-uuid': '3793542a-2aeb-48a8-98c9-a05755aa708e'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:43:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:43:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:43:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:43:01 user nova-compute[75745]: INFO os_vif [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:eb:e0,bridge_name='br-int',has_traffic_filtering=True,id=6e0b2dc1-93ba-4f89-9059-51d908bd03c8,network=Network(773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e0b2dc1-93')
Dec 01 17:43:01 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:43:01 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:43:01 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] No VIF found with MAC fa:16:3e:08:eb:e0, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:43:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:43:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:43:03 user nova-compute[75745]: DEBUG nova.compute.manager [req-9e9da141-9a58-4150-9d54-408802ecea59 req-267c03eb-4aec-48ab-9da0-fe15446d0344 service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Received event network-vif-plugged-6e0b2dc1-93ba-4f89-9059-51d908bd03c8 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:43:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-9e9da141-9a58-4150-9d54-408802ecea59 req-267c03eb-4aec-48ab-9da0-fe15446d0344 service nova] Acquiring lock "3793542a-2aeb-48a8-98c9-a05755aa708e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:43:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-9e9da141-9a58-4150-9d54-408802ecea59 req-267c03eb-4aec-48ab-9da0-fe15446d0344 service nova] Lock "3793542a-2aeb-48a8-98c9-a05755aa708e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:43:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-9e9da141-9a58-4150-9d54-408802ecea59 req-267c03eb-4aec-48ab-9da0-fe15446d0344 service nova] Lock "3793542a-2aeb-48a8-98c9-a05755aa708e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:43:03 user nova-compute[75745]: DEBUG nova.compute.manager [req-9e9da141-9a58-4150-9d54-408802ecea59 req-267c03eb-4aec-48ab-9da0-fe15446d0344 service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] No waiting events found dispatching network-vif-plugged-6e0b2dc1-93ba-4f89-9059-51d908bd03c8 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:43:03 user nova-compute[75745]: WARNING nova.compute.manager [req-9e9da141-9a58-4150-9d54-408802ecea59 req-267c03eb-4aec-48ab-9da0-fe15446d0344 service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Received unexpected event network-vif-plugged-6e0b2dc1-93ba-4f89-9059-51d908bd03c8 for instance with vm_state shelved_offloaded and task_state spawning.
Dec 01 17:43:03 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:43:03 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:43:03 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:43:03 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:43:03 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:43:04 user nova-compute[75745]: DEBUG nova.compute.manager [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:43:04 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:43:04 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Instance spawned successfully.
Dec 01 17:43:05 user nova-compute[75745]: DEBUG nova.compute.manager [req-fafc2c6f-f417-4b1f-8b5c-2b7fc5e36b2a req-c7e099e6-2d1e-43eb-b433-8b7996e8d68f service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Received event network-vif-plugged-6e0b2dc1-93ba-4f89-9059-51d908bd03c8 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:43:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fafc2c6f-f417-4b1f-8b5c-2b7fc5e36b2a req-c7e099e6-2d1e-43eb-b433-8b7996e8d68f service nova] Acquiring lock "3793542a-2aeb-48a8-98c9-a05755aa708e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:43:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fafc2c6f-f417-4b1f-8b5c-2b7fc5e36b2a req-c7e099e6-2d1e-43eb-b433-8b7996e8d68f service nova] Lock "3793542a-2aeb-48a8-98c9-a05755aa708e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:43:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fafc2c6f-f417-4b1f-8b5c-2b7fc5e36b2a req-c7e099e6-2d1e-43eb-b433-8b7996e8d68f service nova] Lock "3793542a-2aeb-48a8-98c9-a05755aa708e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:43:05 user nova-compute[75745]: DEBUG nova.compute.manager [req-fafc2c6f-f417-4b1f-8b5c-2b7fc5e36b2a req-c7e099e6-2d1e-43eb-b433-8b7996e8d68f service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] No waiting events found dispatching network-vif-plugged-6e0b2dc1-93ba-4f89-9059-51d908bd03c8 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:43:05 user nova-compute[75745]: WARNING nova.compute.manager [req-fafc2c6f-f417-4b1f-8b5c-2b7fc5e36b2a req-c7e099e6-2d1e-43eb-b433-8b7996e8d68f service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Received unexpected event network-vif-plugged-6e0b2dc1-93ba-4f89-9059-51d908bd03c8 for instance with vm_state shelved_offloaded and task_state spawning.
Dec 01 17:43:05 user nova-compute[75745]: DEBUG nova.compute.manager [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:43:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-9cf9cdc7-fe33-41cb-9434-ff8f8de1d8b4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "3793542a-2aeb-48a8-98c9-a05755aa708e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 21.233s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:43:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:43:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:43:06 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:43:08 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:43:08 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:43:08 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:43:09 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:43:09 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:43:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:43:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:43:12 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:43:12 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:43:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:43:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:43:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:43:12 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:43:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:43:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:43:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:43:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:43:13 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:43:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:43:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:43:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:43:13 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG nova.compute.manager [req-6cd33c6e-7077-45e1-96b9-27c5c1a5f0c1 req-0fac5071-5ef2-4a2d-b447-e8ee5b38c9b2 service nova] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Received event network-changed-964bbd9c-d6ac-462c-8342-f565c3ab2934 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG nova.compute.manager [req-6cd33c6e-7077-45e1-96b9-27c5c1a5f0c1 req-0fac5071-5ef2-4a2d-b447-e8ee5b38c9b2 service nova] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Refreshing instance network info cache due to event network-changed-964bbd9c-d6ac-462c-8342-f565c3ab2934. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6cd33c6e-7077-45e1-96b9-27c5c1a5f0c1 req-0fac5071-5ef2-4a2d-b447-e8ee5b38c9b2 service nova] Acquiring lock "refresh_cache-3c990a0a-188a-4973-846a-d09c98918500" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6cd33c6e-7077-45e1-96b9-27c5c1a5f0c1 req-0fac5071-5ef2-4a2d-b447-e8ee5b38c9b2 service nova] Acquired lock "refresh_cache-3c990a0a-188a-4973-846a-d09c98918500" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG nova.network.neutron [req-6cd33c6e-7077-45e1-96b9-27c5c1a5f0c1 req-0fac5071-5ef2-4a2d-b447-e8ee5b38c9b2 service nova] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Refreshing network info cache for port 964bbd9c-d6ac-462c-8342-f565c3ab2934 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:43:14 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:43:14 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:43:14 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=8801MB free_disk=25.109466552734375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-cf2870a3-3ee0-4a34-8dda-95c3a2dbcd8a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Acquiring lock "3c990a0a-188a-4973-846a-d09c98918500" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-cf2870a3-3ee0-4a34-8dda-95c3a2dbcd8a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "3c990a0a-188a-4973-846a-d09c98918500" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-cf2870a3-3ee0-4a34-8dda-95c3a2dbcd8a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Acquiring lock "3c990a0a-188a-4973-846a-d09c98918500-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-cf2870a3-3ee0-4a34-8dda-95c3a2dbcd8a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "3c990a0a-188a-4973-846a-d09c98918500-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-cf2870a3-3ee0-4a34-8dda-95c3a2dbcd8a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "3c990a0a-188a-4973-846a-d09c98918500-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:43:14 user nova-compute[75745]: INFO nova.compute.manager [None req-cf2870a3-3ee0-4a34-8dda-95c3a2dbcd8a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Terminating instance
Dec 01 17:43:14 user nova-compute[75745]: DEBUG nova.compute.manager [None req-cf2870a3-3ee0-4a34-8dda-95c3a2dbcd8a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 3c990a0a-188a-4973-846a-d09c98918500 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 3793542a-2aeb-48a8-98c9-a05755aa708e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Refreshing inventories for resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Updating ProviderTree inventory for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Updating inventory in ProviderTree for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Refreshing aggregate associations for resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9, aggregates: None {{(pid=75745) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG nova.network.neutron [req-6cd33c6e-7077-45e1-96b9-27c5c1a5f0c1 req-0fac5071-5ef2-4a2d-b447-e8ee5b38c9b2 service nova] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Updated VIF entry in instance network info cache for port 964bbd9c-d6ac-462c-8342-f565c3ab2934. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG nova.network.neutron [req-6cd33c6e-7077-45e1-96b9-27c5c1a5f0c1 req-0fac5071-5ef2-4a2d-b447-e8ee5b38c9b2 service nova] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Updating instance_info_cache with network_info: [{"id": "964bbd9c-d6ac-462c-8342-f565c3ab2934", "address": "fa:16:3e:4a:af:e3", "network": {"id": "ab165176-5fd5-4df3-97fc-464c4a6891d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2005430003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0aff17da1db4afbb8563237035d13f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap964bbd9c-d6", "ovs_interfaceid": "964bbd9c-d6ac-462c-8342-f565c3ab2934", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6cd33c6e-7077-45e1-96b9-27c5c1a5f0c1 req-0fac5071-5ef2-4a2d-b447-e8ee5b38c9b2 service nova] Releasing lock "refresh_cache-3c990a0a-188a-4973-846a-d09c98918500" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Refreshing trait associations for resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9, traits: COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=75745) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.730s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:43:14 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Instance destroyed successfully.
Dec 01 17:43:14 user nova-compute[75745]: DEBUG nova.objects.instance [None req-cf2870a3-3ee0-4a34-8dda-95c3a2dbcd8a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lazy-loading 'resources' on Instance uuid 3c990a0a-188a-4973-846a-d09c98918500 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-cf2870a3-3ee0-4a34-8dda-95c3a2dbcd8a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:36:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1281729636',display_name='tempest-TestStampPattern-server-1281729636',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1281729636',id=43,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGNrLA5bKvG55GGS8MBbWt09LoTtS2gvVG2BKmrPsKsEdhegbzNdpBAYjEqY7P16s1fTayXnvtFgTmvCamKaUfjqCdJv5fIccc9eDKhtquF0DkT05mxPdPEaU8Xc/LdjA==',key_name='tempest-TestStampPattern-115018569',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:36:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0aff17da1db4afbb8563237035d13f5',ramdisk_id='',reservation_id='r-08uxyfmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-885997284',owner_user_name='tempest-TestStampPattern-885997284-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:39:16Z,user_data=None,user_id='2507209df93a48f1b17652da89646e14',uuid=3c990a0a-188a-4973-846a-d09c98918500,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "964bbd9c-d6ac-462c-8342-f565c3ab2934", "address": "fa:16:3e:4a:af:e3", "network": {"id": "ab165176-5fd5-4df3-97fc-464c4a6891d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2005430003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0aff17da1db4afbb8563237035d13f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap964bbd9c-d6", "ovs_interfaceid": "964bbd9c-d6ac-462c-8342-f565c3ab2934", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-cf2870a3-3ee0-4a34-8dda-95c3a2dbcd8a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Converting VIF {"id": "964bbd9c-d6ac-462c-8342-f565c3ab2934", "address": "fa:16:3e:4a:af:e3", "network": {"id": "ab165176-5fd5-4df3-97fc-464c4a6891d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2005430003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0aff17da1db4afbb8563237035d13f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap964bbd9c-d6", "ovs_interfaceid": "964bbd9c-d6ac-462c-8342-f565c3ab2934", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-cf2870a3-3ee0-4a34-8dda-95c3a2dbcd8a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:af:e3,bridge_name='br-int',has_traffic_filtering=True,id=964bbd9c-d6ac-462c-8342-f565c3ab2934,network=Network(ab165176-5fd5-4df3-97fc-464c4a6891d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap964bbd9c-d6') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG os_vif [None req-cf2870a3-3ee0-4a34-8dda-95c3a2dbcd8a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:af:e3,bridge_name='br-int',has_traffic_filtering=True,id=964bbd9c-d6ac-462c-8342-f565c3ab2934,network=Network(ab165176-5fd5-4df3-97fc-464c4a6891d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap964bbd9c-d6') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap964bbd9c-d6, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:43:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:43:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:43:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:43:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ccc45b53-3e81-4548-9d56-e2e7ba59e4ce) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:43:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:43:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:43:15 user nova-compute[75745]: INFO os_vif [None req-cf2870a3-3ee0-4a34-8dda-95c3a2dbcd8a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:af:e3,bridge_name='br-int',has_traffic_filtering=True,id=964bbd9c-d6ac-462c-8342-f565c3ab2934,network=Network(ab165176-5fd5-4df3-97fc-464c4a6891d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap964bbd9c-d6')
Dec 01 17:43:15 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-cf2870a3-3ee0-4a34-8dda-95c3a2dbcd8a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Deleting instance files /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500_del
Dec 01 17:43:15 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-cf2870a3-3ee0-4a34-8dda-95c3a2dbcd8a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Deletion of /opt/stack/data/nova/instances/3c990a0a-188a-4973-846a-d09c98918500_del complete
Dec 01 17:43:15 user nova-compute[75745]: INFO nova.compute.manager [None req-cf2870a3-3ee0-4a34-8dda-95c3a2dbcd8a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Took 0.93 seconds to destroy the instance on the hypervisor.
Dec 01 17:43:15 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-cf2870a3-3ee0-4a34-8dda-95c3a2dbcd8a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:43:15 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:43:15 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 3c990a0a-188a-4973-846a-d09c98918500] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:43:15 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:43:15 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Took 0.45 seconds to deallocate network for instance.
Dec 01 17:43:15 user nova-compute[75745]: DEBUG nova.compute.manager [req-0956a986-1ad2-45e8-a417-9ea633b42cd0 req-9abe167c-ac2b-4ede-866d-6cf0bcb31724 service nova] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Received event network-vif-deleted-964bbd9c-d6ac-462c-8342-f565c3ab2934 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:43:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-cf2870a3-3ee0-4a34-8dda-95c3a2dbcd8a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:43:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-cf2870a3-3ee0-4a34-8dda-95c3a2dbcd8a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:43:15 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-cf2870a3-3ee0-4a34-8dda-95c3a2dbcd8a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:43:15 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-cf2870a3-3ee0-4a34-8dda-95c3a2dbcd8a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:43:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-cf2870a3-3ee0-4a34-8dda-95c3a2dbcd8a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:43:15 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-cf2870a3-3ee0-4a34-8dda-95c3a2dbcd8a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Deleted allocations for instance 3c990a0a-188a-4973-846a-d09c98918500
Dec 01 17:43:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-cf2870a3-3ee0-4a34-8dda-95c3a2dbcd8a tempest-TestStampPattern-885997284 tempest-TestStampPattern-885997284-project-member] Lock "3c990a0a-188a-4973-846a-d09c98918500" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.702s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:43:16 user nova-compute[75745]: DEBUG nova.compute.manager [req-0b883465-e9ce-4344-9a35-1c65db780436 req-c6460c8b-11ab-4b80-9525-8f7cec01ab02 service nova] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Received event network-vif-unplugged-964bbd9c-d6ac-462c-8342-f565c3ab2934 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:43:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0b883465-e9ce-4344-9a35-1c65db780436 req-c6460c8b-11ab-4b80-9525-8f7cec01ab02 service nova] Acquiring lock "3c990a0a-188a-4973-846a-d09c98918500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:43:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0b883465-e9ce-4344-9a35-1c65db780436 req-c6460c8b-11ab-4b80-9525-8f7cec01ab02 service nova] Lock "3c990a0a-188a-4973-846a-d09c98918500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:43:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0b883465-e9ce-4344-9a35-1c65db780436 req-c6460c8b-11ab-4b80-9525-8f7cec01ab02 service nova] Lock "3c990a0a-188a-4973-846a-d09c98918500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:43:16 user nova-compute[75745]: DEBUG nova.compute.manager [req-0b883465-e9ce-4344-9a35-1c65db780436 req-c6460c8b-11ab-4b80-9525-8f7cec01ab02 service nova] [instance: 3c990a0a-188a-4973-846a-d09c98918500] No waiting events found dispatching network-vif-unplugged-964bbd9c-d6ac-462c-8342-f565c3ab2934 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:43:16 user nova-compute[75745]: WARNING nova.compute.manager [req-0b883465-e9ce-4344-9a35-1c65db780436 req-c6460c8b-11ab-4b80-9525-8f7cec01ab02 service nova] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Received unexpected event network-vif-unplugged-964bbd9c-d6ac-462c-8342-f565c3ab2934 for instance with vm_state deleted and task_state None.
Dec 01 17:43:16 user nova-compute[75745]: DEBUG nova.compute.manager [req-0b883465-e9ce-4344-9a35-1c65db780436 req-c6460c8b-11ab-4b80-9525-8f7cec01ab02 service nova] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Received event network-vif-plugged-964bbd9c-d6ac-462c-8342-f565c3ab2934 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:43:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0b883465-e9ce-4344-9a35-1c65db780436 req-c6460c8b-11ab-4b80-9525-8f7cec01ab02 service nova] Acquiring lock "3c990a0a-188a-4973-846a-d09c98918500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:43:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0b883465-e9ce-4344-9a35-1c65db780436 req-c6460c8b-11ab-4b80-9525-8f7cec01ab02 service nova] Lock "3c990a0a-188a-4973-846a-d09c98918500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:43:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0b883465-e9ce-4344-9a35-1c65db780436 req-c6460c8b-11ab-4b80-9525-8f7cec01ab02 service nova] Lock "3c990a0a-188a-4973-846a-d09c98918500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:43:16 user nova-compute[75745]: DEBUG nova.compute.manager [req-0b883465-e9ce-4344-9a35-1c65db780436 req-c6460c8b-11ab-4b80-9525-8f7cec01ab02 service nova] [instance: 3c990a0a-188a-4973-846a-d09c98918500] No waiting events found dispatching network-vif-plugged-964bbd9c-d6ac-462c-8342-f565c3ab2934 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:43:16 user nova-compute[75745]: WARNING nova.compute.manager [req-0b883465-e9ce-4344-9a35-1c65db780436 req-c6460c8b-11ab-4b80-9525-8f7cec01ab02 service nova] [instance: 3c990a0a-188a-4973-846a-d09c98918500] Received unexpected event network-vif-plugged-964bbd9c-d6ac-462c-8342-f565c3ab2934 for instance with vm_state deleted and task_state None.
Dec 01 17:43:18 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:43:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:43:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:43:22 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:43:22 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:43:22 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Rebuilding the list of instances to heal {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 17:43:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-3793542a-2aeb-48a8-98c9-a05755aa708e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:43:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-3793542a-2aeb-48a8-98c9-a05755aa708e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:43:22 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:43:22 user nova-compute[75745]: DEBUG nova.objects.instance [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lazy-loading 'info_cache' on Instance uuid 3793542a-2aeb-48a8-98c9-a05755aa708e {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:43:23 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Updating instance_info_cache with network_info: [{"id": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "address": "fa:16:3e:08:eb:e0", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0b2dc1-93", "ovs_interfaceid": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:43:23 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-3793542a-2aeb-48a8-98c9-a05755aa708e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:43:23 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:43:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:43:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:43:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:43:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:43:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:43:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:43:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:43:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:43:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:43:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:07 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:44:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:09 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:44:09 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:44:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:10 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:44:10 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:44:10 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:44:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:13 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:44:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:14 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:44:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:44:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:44:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:44:14 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:44:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:44:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:15 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:44:15 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:44:15 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:44:15 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:44:15 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:44:15 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:44:15 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=8927MB free_disk=25.128040313720703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:44:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:44:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:44:15 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 3793542a-2aeb-48a8-98c9-a05755aa708e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:44:15 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:44:15 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:44:15 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:44:15 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:44:15 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:44:15 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:44:17 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:44:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:44:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:24 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:44:24 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:44:24 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Rebuilding the list of instances to heal {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 17:44:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-3793542a-2aeb-48a8-98c9-a05755aa708e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:44:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-3793542a-2aeb-48a8-98c9-a05755aa708e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:44:24 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:44:24 user nova-compute[75745]: DEBUG nova.objects.instance [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lazy-loading 'info_cache' on Instance uuid 3793542a-2aeb-48a8-98c9-a05755aa708e {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:44:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:25 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Updating instance_info_cache with network_info: [{"id": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "address": "fa:16:3e:08:eb:e0", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0b2dc1-93", "ovs_interfaceid": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:44:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-3793542a-2aeb-48a8-98c9-a05755aa708e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:44:25 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:44:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:27 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:30 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:44:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "3793542a-2aeb-48a8-98c9-a05755aa708e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:44:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "3793542a-2aeb-48a8-98c9-a05755aa708e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:44:34 user nova-compute[75745]: INFO nova.compute.manager [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Detaching volume 038e806e-f206-41d4-bf44-48db209b3896
Dec 01 17:44:34 user nova-compute[75745]: INFO nova.virt.block_device [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Attempting to driver detach volume 038e806e-f206-41d4-bf44-48db209b3896 from mountpoint /dev/vdc
Dec 01 17:44:34 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Attempting to detach device vdc from instance 3793542a-2aeb-48a8-98c9-a05755aa708e from the persistent domain config. {{(pid=75745) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 17:44:34 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:44:34 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:44:34 user nova-compute[75745]:   <source dev="/dev/sdb"/>
Dec 01 17:44:34 user nova-compute[75745]:   <target dev="vdc" bus="virtio"/>
Dec 01 17:44:34 user nova-compute[75745]:   <serial>038e806e-f206-41d4-bf44-48db209b3896</serial>
Dec 01 17:44:34 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 01 17:44:34 user nova-compute[75745]: </disk>
Dec 01 17:44:34 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:44:34 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Successfully detached device vdc from instance 3793542a-2aeb-48a8-98c9-a05755aa708e from the persistent domain config.
Dec 01 17:44:34 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 3793542a-2aeb-48a8-98c9-a05755aa708e from the live domain config. {{(pid=75745) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 17:44:34 user nova-compute[75745]: DEBUG nova.virt.libvirt.guest [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 17:44:34 user nova-compute[75745]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:44:34 user nova-compute[75745]:   <source dev="/dev/sdb"/>
Dec 01 17:44:34 user nova-compute[75745]:   <target dev="vdc" bus="virtio"/>
Dec 01 17:44:34 user nova-compute[75745]:   <serial>038e806e-f206-41d4-bf44-48db209b3896</serial>
Dec 01 17:44:34 user nova-compute[75745]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 01 17:44:34 user nova-compute[75745]: </disk>
Dec 01 17:44:34 user nova-compute[75745]:  {{(pid=75745) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 17:44:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:35 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 3793542a-2aeb-48a8-98c9-a05755aa708e {{(pid=75745) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 17:44:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "94b38732-ce72-400b-ac07-7228d68f232a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:44:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "94b38732-ce72-400b-ac07-7228d68f232a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:44:39 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:44:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:44:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:44:39 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:44:39 user nova-compute[75745]: INFO nova.compute.claims [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Claim successful on node user
Dec 01 17:44:39 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:44:39 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:44:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.200s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:44:39 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:44:39 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:44:39 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:44:39 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:44:39 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:44:40 user nova-compute[75745]: INFO nova.virt.block_device [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Booting with volume snapshot da64da31-9565-4a7d-887c-a12f6a950c00 at /dev/vda
Dec 01 17:44:40 user nova-compute[75745]: DEBUG nova.policy [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd79b4d42093f4a12aae4fb90bbbcba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d35468e65461d8ac34cb6c1d19b68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:44:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:40 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Successfully created port: 3db872b3-b631-40d3-a6d6-d6c0020f43e3 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:44:41 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Successfully updated port: 3db872b3-b631-40d3-a6d6-d6c0020f43e3 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:44:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "refresh_cache-94b38732-ce72-400b-ac07-7228d68f232a" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:44:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquired lock "refresh_cache-94b38732-ce72-400b-ac07-7228d68f232a" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:44:41 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:44:41 user nova-compute[75745]: DEBUG nova.compute.manager [req-e1d9d571-130b-48ce-aaf7-cffe5e557cb2 req-b5be039f-4399-4a00-a26f-b4563de62340 service nova] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Received event network-changed-3db872b3-b631-40d3-a6d6-d6c0020f43e3 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:44:41 user nova-compute[75745]: DEBUG nova.compute.manager [req-e1d9d571-130b-48ce-aaf7-cffe5e557cb2 req-b5be039f-4399-4a00-a26f-b4563de62340 service nova] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Refreshing instance network info cache due to event network-changed-3db872b3-b631-40d3-a6d6-d6c0020f43e3. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:44:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e1d9d571-130b-48ce-aaf7-cffe5e557cb2 req-b5be039f-4399-4a00-a26f-b4563de62340 service nova] Acquiring lock "refresh_cache-94b38732-ce72-400b-ac07-7228d68f232a" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:44:41 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:44:41 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Updating instance_info_cache with network_info: [{"id": "3db872b3-b631-40d3-a6d6-d6c0020f43e3", "address": "fa:16:3e:cd:b0:3b", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db872b3-b6", "ovs_interfaceid": "3db872b3-b631-40d3-a6d6-d6c0020f43e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:44:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Releasing lock "refresh_cache-94b38732-ce72-400b-ac07-7228d68f232a" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:44:41 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Instance network_info: |[{"id": "3db872b3-b631-40d3-a6d6-d6c0020f43e3", "address": "fa:16:3e:cd:b0:3b", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db872b3-b6", "ovs_interfaceid": "3db872b3-b631-40d3-a6d6-d6c0020f43e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:44:41 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e1d9d571-130b-48ce-aaf7-cffe5e557cb2 req-b5be039f-4399-4a00-a26f-b4563de62340 service nova] Acquired lock "refresh_cache-94b38732-ce72-400b-ac07-7228d68f232a" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:44:41 user nova-compute[75745]: DEBUG nova.network.neutron [req-e1d9d571-130b-48ce-aaf7-cffe5e557cb2 req-b5be039f-4399-4a00-a26f-b4563de62340 service nova] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Refreshing network info cache for port 3db872b3-b631-40d3-a6d6-d6c0020f43e3 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:44:42 user nova-compute[75745]: DEBUG nova.network.neutron [req-e1d9d571-130b-48ce-aaf7-cffe5e557cb2 req-b5be039f-4399-4a00-a26f-b4563de62340 service nova] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Updated VIF entry in instance network info cache for port 3db872b3-b631-40d3-a6d6-d6c0020f43e3. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:44:42 user nova-compute[75745]: DEBUG nova.network.neutron [req-e1d9d571-130b-48ce-aaf7-cffe5e557cb2 req-b5be039f-4399-4a00-a26f-b4563de62340 service nova] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Updating instance_info_cache with network_info: [{"id": "3db872b3-b631-40d3-a6d6-d6c0020f43e3", "address": "fa:16:3e:cd:b0:3b", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db872b3-b6", "ovs_interfaceid": "3db872b3-b631-40d3-a6d6-d6c0020f43e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:44:42 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e1d9d571-130b-48ce-aaf7-cffe5e557cb2 req-b5be039f-4399-4a00-a26f-b4563de62340 service nova] Releasing lock "refresh_cache-94b38732-ce72-400b-ac07-7228d68f232a" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:44:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:44:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:44:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:44:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:44:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:45 user nova-compute[75745]: DEBUG os_brick.utils [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:44:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:44:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:44:45 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d61227-7545-4de6-9560-2d5ed0ba4677]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:44:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:44:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:44:45 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4ce9dc-6c35-427d-a487-87dd02f635fb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:44:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:44:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:44:45 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc6b148-acf8-4042-b7a8-1ba55c8a7a94]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:44:45 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59ff0c9-64fe-4731-81eb-83032f10959a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:44:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:44:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:44:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:44:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:44:45 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:44:45 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:44:45 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb953e17-c4a2-4f52-ac18-e6b739ebe6a1]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:44:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:44:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:44:45 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:44:45 user nova-compute[75745]: DEBUG os_brick.utils [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:44:45 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Updating existing volume attachment record: 6c5b6fa3-d8f1-4f6e-831d-84eb0b5dd23e {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:44:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:44:54 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Creating image(s)
Dec 01 17:44:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Did not create local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Ensure instance console log exists: /opt/stack/data/nova/instances/94b38732-ce72-400b-ac07-7228d68f232a/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Start _get_guest_xml network_info=[{"id": "3db872b3-b631-40d3-a6d6-d6c0020f43e3", "address": "fa:16:3e:cd:b0:3b", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db872b3-b6", "ovs_interfaceid": "3db872b3-b631-40d3-a6d6-d6c0020f43e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': '6c5b6fa3-d8f1-4f6e-831d-84eb0b5dd23e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uSgBIHcK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '94b38732-ce72-400b-ac07-7228d68f232a', 'attached_at': '', 'detached_at': '', 'volume_id': '90cfbf01-9922-4b32-9126-c91b40b394ff', 'serial': '90cfbf01-9922-4b32-9126-c91b40b394ff'}, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:44:54 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:44:54 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:44:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uSgBIHcK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:44:54 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:44:54 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:44:54 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:44:54 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:44:54 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:44:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e1e4df-1d22-48b6-a696-d2b709af1a59]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:44:54 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4865357a-9ebb-41cd-aa2c-eea57e3fcfa9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff] added
Dec 01 17:44:54 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f7701f-e5ac-4dfd-9482-70fd16107738]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eafafe9-49e3-4f43-a6ba-18487238a512]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uSgBIHcK {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uSgBIHcK" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3eaecf-df1d-4cb0-8feb-2aa71abe10c9]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uSgBIHcK'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.060s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1d50ae-d2a8-41bf-bfbb-9cdc9a12c196]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c878c226-b353-4d65-99e2-4b21cb609fcb]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896 (non-flash)
Dec 01 17:44:54 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896 (non-flash)
Dec 01 17:44:54 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b03d37-2153-4a9a-a117-5063a73574d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff, portal: 172.16.0.220,3260]
Dec 01 17:44:54 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff, portal: 172.16.0.220,3260] successful.
Dec 01 17:44:54 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b24946-5808-4f73-b49d-a57b7707e11c]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[edae9727-08ed-4d13-8d67-98a257dd550b]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896 (non-flash)
Dec 01 17:44:54 user nova-compute[75745]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff (non-flash)
Dec 01 17:44:54 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896 (non-flash)
Dec 01 17:44:54 user nova-compute[75745]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff (non-flash)
Dec 01 17:44:54 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:44:54 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:44:55 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:44:55 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[05805b0f-60ff-4e2d-85ce-19482c3156ba]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:44:55 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: None {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:44:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:55 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 3793542a-2aeb-48a8-98c9-a05755aa708e is timed out.
Dec 01 17:44:55 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Successfully detached device vdc from instance 3793542a-2aeb-48a8-98c9-a05755aa708e from the live domain config.
Dec 01 17:44:55 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:44:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RalJZgiB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:44:55 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:44:55 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:44:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uSgBIHcK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '26338383262636131', 'path': '/dev/sdc'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338383262636131', 'path': '/dev/sdc'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.812s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dba5d51-d5c8-4d0b-8c13-019d8e710f60]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:44:56 user nova-compute[75745]: No targets found.
Dec 01 17:44:56 user nova-compute[75745]: iSNS:
Dec 01 17:44:56 user nova-compute[75745]: No targets found.
Dec 01 17:44:56 user nova-compute[75745]: STATIC:
Dec 01 17:44:56 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896
Dec 01 17:44:56 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:44:56 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:44:56 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff
Dec 01 17:44:56 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:44:56 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:44:56 user nova-compute[75745]: FIRMWARE:
Dec 01 17:44:56 user nova-compute[75745]: No targets found.
Dec 01 17:44:56 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:44:56 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:44:56 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:44:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1948953569',display_name='tempest-TestVolumeBootPattern-server-1948953569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1948953569',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e92d35468e65461d8ac34cb6c1d19b68',ramdisk_id='',reservation_id='r-ew2k8lma',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1187866378',owner_user_name='tempest-TestVolumeBootPattern-1187866378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:44:40Z,user_data=None,user_id='d79b4d42093f4a12aae4fb90bbbcba39',uuid=94b38732-ce72-400b-ac07-7228d68f232a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3db872b3-b631-40d3-a6d6-d6c0020f43e3", "address": "fa:16:3e:cd:b0:3b", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db872b3-b6", "ovs_interfaceid": "3db872b3-b631-40d3-a6d6-d6c0020f43e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Converting VIF {"id": "3db872b3-b631-40d3-a6d6-d6c0020f43e3", "address": "fa:16:3e:cd:b0:3b", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db872b3-b6", "ovs_interfaceid": "3db872b3-b631-40d3-a6d6-d6c0020f43e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:b0:3b,bridge_name='br-int',has_traffic_filtering=True,id=3db872b3-b631-40d3-a6d6-d6c0020f43e3,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3db872b3-b6') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG nova.objects.instance [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lazy-loading 'pci_devices' on Instance uuid 94b38732-ce72-400b-ac07-7228d68f232a {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:44:56 user nova-compute[75745]:   <uuid>94b38732-ce72-400b-ac07-7228d68f232a</uuid>
Dec 01 17:44:56 user nova-compute[75745]:   <name>instance-0000002e</name>
Dec 01 17:44:56 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:44:56 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:44:56 user nova-compute[75745]:   <metadata>
Dec 01 17:44:56 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:44:56 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:44:56 user nova-compute[75745]:       <nova:name>tempest-TestVolumeBootPattern-server-1948953569</nova:name>
Dec 01 17:44:56 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:44:54</nova:creationTime>
Dec 01 17:44:56 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:44:56 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:44:56 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:44:56 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:44:56 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:44:56 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:44:56 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:44:56 user nova-compute[75745]:       <nova:owner>
Dec 01 17:44:56 user nova-compute[75745]:         <nova:user uuid="d79b4d42093f4a12aae4fb90bbbcba39">tempest-TestVolumeBootPattern-1187866378-project-member</nova:user>
Dec 01 17:44:56 user nova-compute[75745]:         <nova:project uuid="e92d35468e65461d8ac34cb6c1d19b68">tempest-TestVolumeBootPattern-1187866378</nova:project>
Dec 01 17:44:56 user nova-compute[75745]:       </nova:owner>
Dec 01 17:44:56 user nova-compute[75745]:       <nova:ports>
Dec 01 17:44:56 user nova-compute[75745]:         <nova:port uuid="3db872b3-b631-40d3-a6d6-d6c0020f43e3">
Dec 01 17:44:56 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 01 17:44:56 user nova-compute[75745]:         </nova:port>
Dec 01 17:44:56 user nova-compute[75745]:       </nova:ports>
Dec 01 17:44:56 user nova-compute[75745]:     </nova:instance>
Dec 01 17:44:56 user nova-compute[75745]:   </metadata>
Dec 01 17:44:56 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:44:56 user nova-compute[75745]:     <system>
Dec 01 17:44:56 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:44:56 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:44:56 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:44:56 user nova-compute[75745]:       <entry name="serial">94b38732-ce72-400b-ac07-7228d68f232a</entry>
Dec 01 17:44:56 user nova-compute[75745]:       <entry name="uuid">94b38732-ce72-400b-ac07-7228d68f232a</entry>
Dec 01 17:44:56 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:44:56 user nova-compute[75745]:     </system>
Dec 01 17:44:56 user nova-compute[75745]:   </sysinfo>
Dec 01 17:44:56 user nova-compute[75745]:   <os>
Dec 01 17:44:56 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:44:56 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:44:56 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:44:56 user nova-compute[75745]:   </os>
Dec 01 17:44:56 user nova-compute[75745]:   <features>
Dec 01 17:44:56 user nova-compute[75745]:     <acpi/>
Dec 01 17:44:56 user nova-compute[75745]:     <apic/>
Dec 01 17:44:56 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:44:56 user nova-compute[75745]:   </features>
Dec 01 17:44:56 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:44:56 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:44:56 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:44:56 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:44:56 user nova-compute[75745]:   </clock>
Dec 01 17:44:56 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:44:56 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:44:56 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:44:56 user nova-compute[75745]:   </cpu>
Dec 01 17:44:56 user nova-compute[75745]:   <devices>
Dec 01 17:44:56 user nova-compute[75745]:     <disk type="block" device="disk">
Dec 01 17:44:56 user nova-compute[75745]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:44:56 user nova-compute[75745]:       <source dev="/dev/sdc"/>
Dec 01 17:44:56 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:44:56 user nova-compute[75745]:       <serial>90cfbf01-9922-4b32-9126-c91b40b394ff</serial>
Dec 01 17:44:56 user nova-compute[75745]:     </disk>
Dec 01 17:44:56 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:44:56 user nova-compute[75745]:       <mac address="fa:16:3e:cd:b0:3b"/>
Dec 01 17:44:56 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:44:56 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:44:56 user nova-compute[75745]:       <target dev="tap3db872b3-b6"/>
Dec 01 17:44:56 user nova-compute[75745]:     </interface>
Dec 01 17:44:56 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:44:56 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/94b38732-ce72-400b-ac07-7228d68f232a/console.log" append="off"/>
Dec 01 17:44:56 user nova-compute[75745]:     </serial>
Dec 01 17:44:56 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:44:56 user nova-compute[75745]:     <video>
Dec 01 17:44:56 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:44:56 user nova-compute[75745]:     </video>
Dec 01 17:44:56 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:44:56 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:44:56 user nova-compute[75745]:     </rng>
Dec 01 17:44:56 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:44:56 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:44:56 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:44:56 user nova-compute[75745]:     </memballoon>
Dec 01 17:44:56 user nova-compute[75745]:   </devices>
Dec 01 17:44:56 user nova-compute[75745]: </domain>
Dec 01 17:44:56 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:44:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1948953569',display_name='tempest-TestVolumeBootPattern-server-1948953569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1948953569',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e92d35468e65461d8ac34cb6c1d19b68',ramdisk_id='',reservation_id='r-ew2k8lma',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1187866378',owner_user_name='tempest-TestVolumeBootPattern-1187866378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:44:40Z,user_data=None,user_id='d79b4d42093f4a12aae4fb90bbbcba39',uuid=94b38732-ce72-400b-ac07-7228d68f232a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3db872b3-b631-40d3-a6d6-d6c0020f43e3", "address": "fa:16:3e:cd:b0:3b", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db872b3-b6", "ovs_interfaceid": "3db872b3-b631-40d3-a6d6-d6c0020f43e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Converting VIF {"id": "3db872b3-b631-40d3-a6d6-d6c0020f43e3", "address": "fa:16:3e:cd:b0:3b", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db872b3-b6", "ovs_interfaceid": "3db872b3-b631-40d3-a6d6-d6c0020f43e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:b0:3b,bridge_name='br-int',has_traffic_filtering=True,id=3db872b3-b631-40d3-a6d6-d6c0020f43e3,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3db872b3-b6') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG os_vif [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:b0:3b,bridge_name='br-int',has_traffic_filtering=True,id=3db872b3-b631-40d3-a6d6-d6c0020f43e3,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3db872b3-b6') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fa43f7-baac-44d3-a5b0-e9289f36a41d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2531f0d6-5db3-54b7-888a-ce42272007ca', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3db872b3-b6, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3db872b3-b6, col_values=(('qos', UUID('b261fce4-efcc-4141-954b-19a359500410')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3db872b3-b6, col_values=(('external_ids', {'iface-id': '3db872b3-b631-40d3-a6d6-d6c0020f43e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:b0:3b', 'vm-uuid': '94b38732-ce72-400b-ac07-7228d68f232a'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2183cedf-e617-4738-8d0b-f3feac3d47b8]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896 (non-flash)
Dec 01 17:44:56 user nova-compute[75745]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff (non-flash)
Dec 01 17:44:56 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896 (non-flash)
Dec 01 17:44:56 user nova-compute[75745]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff (non-flash)
Dec 01 17:44:56 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f249850dc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896'): ({'sdb'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Removing single pathed devices sdb {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:56 user nova-compute[75745]: INFO os_vif [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:b0:3b,bridge_name='br-int',has_traffic_filtering=True,id=3db872b3-b631-40d3-a6d6-d6c0020f43e3,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3db872b3-b6')
Dec 01 17:44:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29981f3-b1c4-450a-b580-276cf720582d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c238407c-dabe-458d-b741-fe7a557c874d]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Flushing IO for device /dev/sdb {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] No VIF found with MAC fa:16:3e:cd:b0:3b, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f321b4f4-54c8-4b7c-bfd2-d8d1c9f9c6f9]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6381936-fe01-4329-b9f5-222228a3667c]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] SCSI volumes sdb have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d9315e-933e-4298-a175-89df09d490c1]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[68549d5b-7e07-48e9-bbe1-3d4a9b82dd6d]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896, portal: 172.16.0.220,3260]
Dec 01 17:44:56 user nova-compute[75745]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896, portal: 172.16.0.220,3260] successful.
Dec 01 17:44:56 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:038e806e-f206-41d4-bf44-48db209b3896 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[66220a9c-7638-4423-8f3c-85d43abb1264]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] <== disconnect_volume: return (1109ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:44:56 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:44:57 user nova-compute[75745]: DEBUG nova.objects.instance [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lazy-loading 'flavor' on Instance uuid 3793542a-2aeb-48a8-98c9-a05755aa708e {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:44:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-273e03cf-c40c-4d41-a1e9-85ad964fbbf4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "3793542a-2aeb-48a8-98c9-a05755aa708e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.551s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:44:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:57 user nova-compute[75745]: DEBUG nova.compute.manager [req-8ccbcc51-dc25-4a11-ab7b-5b95e4f6548b req-c2ed07d9-d0df-4d75-9484-04dd9425e64f service nova] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Received event network-vif-plugged-3db872b3-b631-40d3-a6d6-d6c0020f43e3 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:44:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8ccbcc51-dc25-4a11-ab7b-5b95e4f6548b req-c2ed07d9-d0df-4d75-9484-04dd9425e64f service nova] Acquiring lock "94b38732-ce72-400b-ac07-7228d68f232a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:44:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8ccbcc51-dc25-4a11-ab7b-5b95e4f6548b req-c2ed07d9-d0df-4d75-9484-04dd9425e64f service nova] Lock "94b38732-ce72-400b-ac07-7228d68f232a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:44:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8ccbcc51-dc25-4a11-ab7b-5b95e4f6548b req-c2ed07d9-d0df-4d75-9484-04dd9425e64f service nova] Lock "94b38732-ce72-400b-ac07-7228d68f232a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:44:57 user nova-compute[75745]: DEBUG nova.compute.manager [req-8ccbcc51-dc25-4a11-ab7b-5b95e4f6548b req-c2ed07d9-d0df-4d75-9484-04dd9425e64f service nova] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] No waiting events found dispatching network-vif-plugged-3db872b3-b631-40d3-a6d6-d6c0020f43e3 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:44:57 user nova-compute[75745]: WARNING nova.compute.manager [req-8ccbcc51-dc25-4a11-ab7b-5b95e4f6548b req-c2ed07d9-d0df-4d75-9484-04dd9425e64f service nova] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Received unexpected event network-vif-plugged-3db872b3-b631-40d3-a6d6-d6c0020f43e3 for instance with vm_state building and task_state spawning.
Dec 01 17:44:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:44:59 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:44:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:44:59 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Instance spawned successfully.
Dec 01 17:44:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:44:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:44:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:44:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:44:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:44:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:44:59 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:44:59 user nova-compute[75745]: INFO nova.compute.manager [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Took 4.97 seconds to spawn the instance on the hypervisor.
Dec 01 17:44:59 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:44:59 user nova-compute[75745]: INFO nova.compute.manager [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Took 20.02 seconds to build instance.
Dec 01 17:44:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d93ddf45-461f-49b6-92aa-bf5c54a54dfa tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "94b38732-ce72-400b-ac07-7228d68f232a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.113s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:44:59 user nova-compute[75745]: DEBUG nova.compute.manager [req-56616dcd-8cfe-4b03-a0da-7d7a52cf50fe req-1a0ab8ee-3053-43a1-a243-498be0c2eaf1 service nova] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Received event network-vif-plugged-3db872b3-b631-40d3-a6d6-d6c0020f43e3 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:44:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-56616dcd-8cfe-4b03-a0da-7d7a52cf50fe req-1a0ab8ee-3053-43a1-a243-498be0c2eaf1 service nova] Acquiring lock "94b38732-ce72-400b-ac07-7228d68f232a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:44:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-56616dcd-8cfe-4b03-a0da-7d7a52cf50fe req-1a0ab8ee-3053-43a1-a243-498be0c2eaf1 service nova] Lock "94b38732-ce72-400b-ac07-7228d68f232a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:44:59 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-56616dcd-8cfe-4b03-a0da-7d7a52cf50fe req-1a0ab8ee-3053-43a1-a243-498be0c2eaf1 service nova] Lock "94b38732-ce72-400b-ac07-7228d68f232a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:44:59 user nova-compute[75745]: DEBUG nova.compute.manager [req-56616dcd-8cfe-4b03-a0da-7d7a52cf50fe req-1a0ab8ee-3053-43a1-a243-498be0c2eaf1 service nova] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] No waiting events found dispatching network-vif-plugged-3db872b3-b631-40d3-a6d6-d6c0020f43e3 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:44:59 user nova-compute[75745]: WARNING nova.compute.manager [req-56616dcd-8cfe-4b03-a0da-7d7a52cf50fe req-1a0ab8ee-3053-43a1-a243-498be0c2eaf1 service nova] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Received unexpected event network-vif-plugged-3db872b3-b631-40d3-a6d6-d6c0020f43e3 for instance with vm_state active and task_state None.
Dec 01 17:45:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:45:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:45:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:45:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:45:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:45:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:45:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:45:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:45:07 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:45:10 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:45:10 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:45:10 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:45:10 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:45:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:45:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:45:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:45:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:45:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:45:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:45:11 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:45:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:45:15 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:45:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:45:16 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:45:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:45:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:45:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:45:16 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:45:16 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:45:17 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:45:17 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:45:17 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:45:17 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:45:17 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:45:17 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:45:17 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=8759MB free_disk=25.125072479248047GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:45:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:45:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:45:17 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 3793542a-2aeb-48a8-98c9-a05755aa708e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:45:17 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 94b38732-ce72-400b-ac07-7228d68f232a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:45:17 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:45:17 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:45:17 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:45:17 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:45:17 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:45:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:45:19 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:45:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:45:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:45:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4799c0ee-3243-4f78-9885-88f61c42c236 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "3793542a-2aeb-48a8-98c9-a05755aa708e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:45:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4799c0ee-3243-4f78-9885-88f61c42c236 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "3793542a-2aeb-48a8-98c9-a05755aa708e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:45:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4799c0ee-3243-4f78-9885-88f61c42c236 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "3793542a-2aeb-48a8-98c9-a05755aa708e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:45:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4799c0ee-3243-4f78-9885-88f61c42c236 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "3793542a-2aeb-48a8-98c9-a05755aa708e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:45:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4799c0ee-3243-4f78-9885-88f61c42c236 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "3793542a-2aeb-48a8-98c9-a05755aa708e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:45:24 user nova-compute[75745]: INFO nova.compute.manager [None req-4799c0ee-3243-4f78-9885-88f61c42c236 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Terminating instance
Dec 01 17:45:24 user nova-compute[75745]: DEBUG nova.compute.manager [None req-4799c0ee-3243-4f78-9885-88f61c42c236 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:45:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:45:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:45:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:45:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:45:25 user nova-compute[75745]: DEBUG nova.compute.manager [req-54ab8f78-c463-424f-a897-f6655fe38e65 req-2565e2d8-75e1-4cb7-9aa9-ebbb69bbfc67 service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Received event network-vif-unplugged-6e0b2dc1-93ba-4f89-9059-51d908bd03c8 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:45:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-54ab8f78-c463-424f-a897-f6655fe38e65 req-2565e2d8-75e1-4cb7-9aa9-ebbb69bbfc67 service nova] Acquiring lock "3793542a-2aeb-48a8-98c9-a05755aa708e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:45:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-54ab8f78-c463-424f-a897-f6655fe38e65 req-2565e2d8-75e1-4cb7-9aa9-ebbb69bbfc67 service nova] Lock "3793542a-2aeb-48a8-98c9-a05755aa708e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:45:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-54ab8f78-c463-424f-a897-f6655fe38e65 req-2565e2d8-75e1-4cb7-9aa9-ebbb69bbfc67 service nova] Lock "3793542a-2aeb-48a8-98c9-a05755aa708e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:45:25 user nova-compute[75745]: DEBUG nova.compute.manager [req-54ab8f78-c463-424f-a897-f6655fe38e65 req-2565e2d8-75e1-4cb7-9aa9-ebbb69bbfc67 service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] No waiting events found dispatching network-vif-unplugged-6e0b2dc1-93ba-4f89-9059-51d908bd03c8 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:45:25 user nova-compute[75745]: DEBUG nova.compute.manager [req-54ab8f78-c463-424f-a897-f6655fe38e65 req-2565e2d8-75e1-4cb7-9aa9-ebbb69bbfc67 service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Received event network-vif-unplugged-6e0b2dc1-93ba-4f89-9059-51d908bd03c8 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:45:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:45:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:45:25 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Instance destroyed successfully.
Dec 01 17:45:25 user nova-compute[75745]: DEBUG nova.objects.instance [None req-4799c0ee-3243-4f78-9885-88f61c42c236 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lazy-loading 'resources' on Instance uuid 3793542a-2aeb-48a8-98c9-a05755aa708e {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:45:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-4799c0ee-3243-4f78-9885-88f61c42c236 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T17:38:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1003279284',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1003279284',id=44,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcQCSrwD4JtgfCYf4reZFDST8WTEo0dhy0owtKX6n8CWePIMWjMZaIRxx+5eriy40cQVQD7h7D5FYpkS/0KzeAes/NVzOnzK3FmwcemVryPyyRJbeWzwkcZhpDEIthh5w==',key_name='tempest-keypair-186142728',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:43:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b1e7099305f4571804612f3a3d8befb',ramdisk_id='',reservation_id='r-ngh0576r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1555393357',owner_user_name='tempest-AttachVolumeShelveTestJSON-1555393357-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:43:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f78365cc1e11444db345efc5fe3cc502',uuid=3793542a-2aeb-48a8-98c9-a05755aa708e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "address": "fa:16:3e:08:eb:e0", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0b2dc1-93", "ovs_interfaceid": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:45:25 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-4799c0ee-3243-4f78-9885-88f61c42c236 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Converting VIF {"id": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "address": "fa:16:3e:08:eb:e0", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0b2dc1-93", "ovs_interfaceid": "6e0b2dc1-93ba-4f89-9059-51d908bd03c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:45:25 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-4799c0ee-3243-4f78-9885-88f61c42c236 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:eb:e0,bridge_name='br-int',has_traffic_filtering=True,id=6e0b2dc1-93ba-4f89-9059-51d908bd03c8,network=Network(773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e0b2dc1-93') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:45:25 user nova-compute[75745]: DEBUG os_vif [None req-4799c0ee-3243-4f78-9885-88f61c42c236 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:eb:e0,bridge_name='br-int',has_traffic_filtering=True,id=6e0b2dc1-93ba-4f89-9059-51d908bd03c8,network=Network(773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e0b2dc1-93') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:45:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:45:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e0b2dc1-93, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:45:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:45:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:45:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:45:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8a62f050-a93a-40e0-9b83-1e5ea8ec3e3f) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:45:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:45:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:45:25 user nova-compute[75745]: INFO os_vif [None req-4799c0ee-3243-4f78-9885-88f61c42c236 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:eb:e0,bridge_name='br-int',has_traffic_filtering=True,id=6e0b2dc1-93ba-4f89-9059-51d908bd03c8,network=Network(773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e0b2dc1-93')
Dec 01 17:45:25 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-4799c0ee-3243-4f78-9885-88f61c42c236 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Deleting instance files /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e_del
Dec 01 17:45:25 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-4799c0ee-3243-4f78-9885-88f61c42c236 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Deletion of /opt/stack/data/nova/instances/3793542a-2aeb-48a8-98c9-a05755aa708e_del complete
Dec 01 17:45:25 user nova-compute[75745]: INFO nova.compute.manager [None req-4799c0ee-3243-4f78-9885-88f61c42c236 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Took 0.87 seconds to destroy the instance on the hypervisor.
Dec 01 17:45:25 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-4799c0ee-3243-4f78-9885-88f61c42c236 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:45:25 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:45:25 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:45:26 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:45:26 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Took 0.84 seconds to deallocate network for instance.
Dec 01 17:45:26 user nova-compute[75745]: DEBUG nova.compute.manager [req-75ae818d-2237-43d8-8e5d-5c0be99e9dd1 req-70e79a42-3f33-4bb0-b6a8-2c41ee36b84d service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Received event network-vif-deleted-6e0b2dc1-93ba-4f89-9059-51d908bd03c8 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:45:26 user nova-compute[75745]: INFO nova.compute.manager [req-75ae818d-2237-43d8-8e5d-5c0be99e9dd1 req-70e79a42-3f33-4bb0-b6a8-2c41ee36b84d service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Neutron deleted interface 6e0b2dc1-93ba-4f89-9059-51d908bd03c8; detaching it from the instance and deleting it from the info cache
Dec 01 17:45:26 user nova-compute[75745]: DEBUG nova.network.neutron [req-75ae818d-2237-43d8-8e5d-5c0be99e9dd1 req-70e79a42-3f33-4bb0-b6a8-2c41ee36b84d service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:45:26 user nova-compute[75745]: DEBUG nova.compute.manager [req-75ae818d-2237-43d8-8e5d-5c0be99e9dd1 req-70e79a42-3f33-4bb0-b6a8-2c41ee36b84d service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Detach interface failed, port_id=6e0b2dc1-93ba-4f89-9059-51d908bd03c8, reason: Instance 3793542a-2aeb-48a8-98c9-a05755aa708e could not be found. {{(pid=75745) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 17:45:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4799c0ee-3243-4f78-9885-88f61c42c236 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:45:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4799c0ee-3243-4f78-9885-88f61c42c236 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:45:26 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-4799c0ee-3243-4f78-9885-88f61c42c236 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:45:26 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-4799c0ee-3243-4f78-9885-88f61c42c236 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:45:26 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:45:26 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:45:26 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Rebuilding the list of instances to heal {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 17:45:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4799c0ee-3243-4f78-9885-88f61c42c236 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:45:26 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-4799c0ee-3243-4f78-9885-88f61c42c236 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Deleted allocations for instance 3793542a-2aeb-48a8-98c9-a05755aa708e
Dec 01 17:45:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-94b38732-ce72-400b-ac07-7228d68f232a" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:45:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-94b38732-ce72-400b-ac07-7228d68f232a" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:45:26 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:45:26 user nova-compute[75745]: DEBUG nova.objects.instance [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lazy-loading 'info_cache' on Instance uuid 94b38732-ce72-400b-ac07-7228d68f232a {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:45:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4799c0ee-3243-4f78-9885-88f61c42c236 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "3793542a-2aeb-48a8-98c9-a05755aa708e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.064s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:45:27 user nova-compute[75745]: DEBUG nova.compute.manager [req-56d17517-019e-4839-a8eb-68f7f26d67fd req-76d1396b-8876-4a02-97fc-9042d837ce2a service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Received event network-vif-plugged-6e0b2dc1-93ba-4f89-9059-51d908bd03c8 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:45:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-56d17517-019e-4839-a8eb-68f7f26d67fd req-76d1396b-8876-4a02-97fc-9042d837ce2a service nova] Acquiring lock "3793542a-2aeb-48a8-98c9-a05755aa708e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:45:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-56d17517-019e-4839-a8eb-68f7f26d67fd req-76d1396b-8876-4a02-97fc-9042d837ce2a service nova] Lock "3793542a-2aeb-48a8-98c9-a05755aa708e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:45:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-56d17517-019e-4839-a8eb-68f7f26d67fd req-76d1396b-8876-4a02-97fc-9042d837ce2a service nova] Lock "3793542a-2aeb-48a8-98c9-a05755aa708e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:45:27 user nova-compute[75745]: DEBUG nova.compute.manager [req-56d17517-019e-4839-a8eb-68f7f26d67fd req-76d1396b-8876-4a02-97fc-9042d837ce2a service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] No waiting events found dispatching network-vif-plugged-6e0b2dc1-93ba-4f89-9059-51d908bd03c8 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:45:27 user nova-compute[75745]: WARNING nova.compute.manager [req-56d17517-019e-4839-a8eb-68f7f26d67fd req-76d1396b-8876-4a02-97fc-9042d837ce2a service nova] [instance: 3793542a-2aeb-48a8-98c9-a05755aa708e] Received unexpected event network-vif-plugged-6e0b2dc1-93ba-4f89-9059-51d908bd03c8 for instance with vm_state deleted and task_state None.
Dec 01 17:45:27 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Updating instance_info_cache with network_info: [{"id": "3db872b3-b631-40d3-a6d6-d6c0020f43e3", "address": "fa:16:3e:cd:b0:3b", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db872b3-b6", "ovs_interfaceid": "3db872b3-b631-40d3-a6d6-d6c0020f43e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:45:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-94b38732-ce72-400b-ac07-7228d68f232a" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:45:27 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:45:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:45:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:45:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:45:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:45:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:45:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:45:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:45:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:45:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:45:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:45:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:45:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:46:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:46:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:46:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:46:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:46:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:09 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:46:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:10 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:46:10 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:46:11 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:46:11 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:46:12 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:46:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:16 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:46:16 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:46:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:46:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:46:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:46:16 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:46:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:46:17 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:46:17 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:46:17 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=8931MB free_disk=25.152095794677734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:46:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:46:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:46:17 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 94b38732-ce72-400b-ac07-7228d68f232a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:46:17 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:46:17 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:46:17 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:46:17 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:46:17 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:46:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:46:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:46:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:46:18 user nova-compute[75745]: DEBUG nova.compute.manager [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:46:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:46:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:46:18 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:46:18 user nova-compute[75745]: INFO nova.compute.claims [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Claim successful on node user
Dec 01 17:46:19 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:46:19 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:46:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.216s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:46:19 user nova-compute[75745]: DEBUG nova.compute.manager [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:46:19 user nova-compute[75745]: DEBUG nova.compute.manager [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:46:19 user nova-compute[75745]: DEBUG nova.network.neutron [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:46:19 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:46:19 user nova-compute[75745]: DEBUG nova.compute.manager [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:46:19 user nova-compute[75745]: DEBUG nova.compute.manager [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:46:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:46:19 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Creating image(s)
Dec 01 17:46:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:46:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "/opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:46:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "/opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:46:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:46:19 user nova-compute[75745]: DEBUG nova.policy [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f78365cc1e11444db345efc5fe3cc502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1e7099305f4571804612f3a3d8befb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:46:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.188s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:46:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "c8853abafd3b960abf164c2d738731e067f690bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:46:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:46:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:46:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.171s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:46:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:46:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf,backing_fmt=raw /opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e/disk 1073741824" returned: 0 in 0.049s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:46:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "c8853abafd3b960abf164c2d738731e067f690bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:46:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:46:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.174s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:46:19 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e/disk. size=1073741824 {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 17:46:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:46:20 user nova-compute[75745]: DEBUG nova.network.neutron [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Successfully created port: 66c9992f-e23d-4c4c-bac0-302c3cbf23b3 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:46:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:46:20 user nova-compute[75745]: DEBUG nova.virt.disk.api [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Cannot resize image /opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e/disk to a smaller size. {{(pid=75745) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 17:46:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:46:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Ensure instance console log exists: /opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:46:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:46:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:46:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:46:20 user nova-compute[75745]: DEBUG nova.network.neutron [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Successfully updated port: 66c9992f-e23d-4c4c-bac0-302c3cbf23b3 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:46:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "refresh_cache-f1dc83ed-2b0e-4da0-9347-9c84ec56178e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:46:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquired lock "refresh_cache-f1dc83ed-2b0e-4da0-9347-9c84ec56178e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:46:20 user nova-compute[75745]: DEBUG nova.network.neutron [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:46:20 user nova-compute[75745]: DEBUG nova.network.neutron [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:46:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:46:20 user nova-compute[75745]: DEBUG nova.compute.manager [req-659e0a21-8b86-40a8-aa3e-5490c43c8240 req-2a271ffd-8491-4d48-a08f-14411ebe54b5 service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Received event network-changed-66c9992f-e23d-4c4c-bac0-302c3cbf23b3 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:46:20 user nova-compute[75745]: DEBUG nova.compute.manager [req-659e0a21-8b86-40a8-aa3e-5490c43c8240 req-2a271ffd-8491-4d48-a08f-14411ebe54b5 service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Refreshing instance network info cache due to event network-changed-66c9992f-e23d-4c4c-bac0-302c3cbf23b3. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:46:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-659e0a21-8b86-40a8-aa3e-5490c43c8240 req-2a271ffd-8491-4d48-a08f-14411ebe54b5 service nova] Acquiring lock "refresh_cache-f1dc83ed-2b0e-4da0-9347-9c84ec56178e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:46:20 user nova-compute[75745]: DEBUG nova.network.neutron [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Updating instance_info_cache with network_info: [{"id": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "address": "fa:16:3e:c0:4f:9a", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c9992f-e2", "ovs_interfaceid": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:46:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Releasing lock "refresh_cache-f1dc83ed-2b0e-4da0-9347-9c84ec56178e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG nova.compute.manager [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Instance network_info: |[{"id": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "address": "fa:16:3e:c0:4f:9a", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c9992f-e2", "ovs_interfaceid": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-659e0a21-8b86-40a8-aa3e-5490c43c8240 req-2a271ffd-8491-4d48-a08f-14411ebe54b5 service nova] Acquired lock "refresh_cache-f1dc83ed-2b0e-4da0-9347-9c84ec56178e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG nova.network.neutron [req-659e0a21-8b86-40a8-aa3e-5490c43c8240 req-2a271ffd-8491-4d48-a08f-14411ebe54b5 service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Refreshing network info cache for port 66c9992f-e23d-4c4c-bac0-302c3cbf23b3 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Start _get_guest_xml network_info=[{"id": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "address": "fa:16:3e:c0:4f:9a", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c9992f-e2", "ovs_interfaceid": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:46:21 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:46:21 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:46:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T17:02:02Z,direct_url=<?>,disk_format='qcow2',id=695c84b8-d08d-488d-9841-cc1da92fb985,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='061216e5b9b54621948598ae244101c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T17:02:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1367548217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1367548217',id=47,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrJjzWe2dmCmfbeohRIk+Pm459FXB6ILb6KNT9dVtbXr/Rb7p3tqvYGiAgsb8bBqY0SFBblqW+doitJ7086KH0vAYypa1FPV1ZHGj93RrNMK68bNSvI+WBbwwAkUVcRHw==',key_name='tempest-keypair-1089424176',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b1e7099305f4571804612f3a3d8befb',ramdisk_id='',reservation_id='r-s927zouf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1555393357',owner_user_name='tempest-AttachVolumeShelveTestJSON-1555393357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f78365cc1e11444db345efc5fe3cc502',uuid=f1dc83ed-2b0e-4da0-9347-9c84ec56178e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "address": "fa:16:3e:c0:4f:9a", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c9992f-e2", "ovs_interfaceid": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Converting VIF {"id": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "address": "fa:16:3e:c0:4f:9a", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c9992f-e2", "ovs_interfaceid": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:4f:9a,bridge_name='br-int',has_traffic_filtering=True,id=66c9992f-e23d-4c4c-bac0-302c3cbf23b3,network=Network(773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66c9992f-e2') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG nova.objects.instance [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lazy-loading 'pci_devices' on Instance uuid f1dc83ed-2b0e-4da0-9347-9c84ec56178e {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:46:21 user nova-compute[75745]:   <uuid>f1dc83ed-2b0e-4da0-9347-9c84ec56178e</uuid>
Dec 01 17:46:21 user nova-compute[75745]:   <name>instance-0000002f</name>
Dec 01 17:46:21 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:46:21 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:46:21 user nova-compute[75745]:   <metadata>
Dec 01 17:46:21 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:46:21 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:46:21 user nova-compute[75745]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1367548217</nova:name>
Dec 01 17:46:21 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:46:21</nova:creationTime>
Dec 01 17:46:21 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:46:21 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:46:21 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:46:21 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:46:21 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:46:21 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:46:21 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:46:21 user nova-compute[75745]:       <nova:owner>
Dec 01 17:46:21 user nova-compute[75745]:         <nova:user uuid="f78365cc1e11444db345efc5fe3cc502">tempest-AttachVolumeShelveTestJSON-1555393357-project-member</nova:user>
Dec 01 17:46:21 user nova-compute[75745]:         <nova:project uuid="2b1e7099305f4571804612f3a3d8befb">tempest-AttachVolumeShelveTestJSON-1555393357</nova:project>
Dec 01 17:46:21 user nova-compute[75745]:       </nova:owner>
Dec 01 17:46:21 user nova-compute[75745]:       <nova:root type="image" uuid="695c84b8-d08d-488d-9841-cc1da92fb985"/>
Dec 01 17:46:21 user nova-compute[75745]:       <nova:ports>
Dec 01 17:46:21 user nova-compute[75745]:         <nova:port uuid="66c9992f-e23d-4c4c-bac0-302c3cbf23b3">
Dec 01 17:46:21 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 01 17:46:21 user nova-compute[75745]:         </nova:port>
Dec 01 17:46:21 user nova-compute[75745]:       </nova:ports>
Dec 01 17:46:21 user nova-compute[75745]:     </nova:instance>
Dec 01 17:46:21 user nova-compute[75745]:   </metadata>
Dec 01 17:46:21 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:46:21 user nova-compute[75745]:     <system>
Dec 01 17:46:21 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:46:21 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:46:21 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:46:21 user nova-compute[75745]:       <entry name="serial">f1dc83ed-2b0e-4da0-9347-9c84ec56178e</entry>
Dec 01 17:46:21 user nova-compute[75745]:       <entry name="uuid">f1dc83ed-2b0e-4da0-9347-9c84ec56178e</entry>
Dec 01 17:46:21 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:46:21 user nova-compute[75745]:     </system>
Dec 01 17:46:21 user nova-compute[75745]:   </sysinfo>
Dec 01 17:46:21 user nova-compute[75745]:   <os>
Dec 01 17:46:21 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:46:21 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:46:21 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:46:21 user nova-compute[75745]:   </os>
Dec 01 17:46:21 user nova-compute[75745]:   <features>
Dec 01 17:46:21 user nova-compute[75745]:     <acpi/>
Dec 01 17:46:21 user nova-compute[75745]:     <apic/>
Dec 01 17:46:21 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:46:21 user nova-compute[75745]:   </features>
Dec 01 17:46:21 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:46:21 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:46:21 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:46:21 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:46:21 user nova-compute[75745]:   </clock>
Dec 01 17:46:21 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:46:21 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:46:21 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:46:21 user nova-compute[75745]:   </cpu>
Dec 01 17:46:21 user nova-compute[75745]:   <devices>
Dec 01 17:46:21 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:46:21 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:46:21 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e/disk"/>
Dec 01 17:46:21 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:46:21 user nova-compute[75745]:     </disk>
Dec 01 17:46:21 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:46:21 user nova-compute[75745]:       <mac address="fa:16:3e:c0:4f:9a"/>
Dec 01 17:46:21 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:46:21 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:46:21 user nova-compute[75745]:       <target dev="tap66c9992f-e2"/>
Dec 01 17:46:21 user nova-compute[75745]:     </interface>
Dec 01 17:46:21 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:46:21 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e/console.log" append="off"/>
Dec 01 17:46:21 user nova-compute[75745]:     </serial>
Dec 01 17:46:21 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:46:21 user nova-compute[75745]:     <video>
Dec 01 17:46:21 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:46:21 user nova-compute[75745]:     </video>
Dec 01 17:46:21 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:46:21 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:46:21 user nova-compute[75745]:     </rng>
Dec 01 17:46:21 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:46:21 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:46:21 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:46:21 user nova-compute[75745]:     </memballoon>
Dec 01 17:46:21 user nova-compute[75745]:   </devices>
Dec 01 17:46:21 user nova-compute[75745]: </domain>
Dec 01 17:46:21 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1367548217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1367548217',id=47,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrJjzWe2dmCmfbeohRIk+Pm459FXB6ILb6KNT9dVtbXr/Rb7p3tqvYGiAgsb8bBqY0SFBblqW+doitJ7086KH0vAYypa1FPV1ZHGj93RrNMK68bNSvI+WBbwwAkUVcRHw==',key_name='tempest-keypair-1089424176',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b1e7099305f4571804612f3a3d8befb',ramdisk_id='',reservation_id='r-s927zouf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1555393357',owner_user_name='tempest-AttachVolumeShelveTestJSON-1555393357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f78365cc1e11444db345efc5fe3cc502',uuid=f1dc83ed-2b0e-4da0-9347-9c84ec56178e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "address": "fa:16:3e:c0:4f:9a", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c9992f-e2", "ovs_interfaceid": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Converting VIF {"id": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "address": "fa:16:3e:c0:4f:9a", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c9992f-e2", "ovs_interfaceid": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:4f:9a,bridge_name='br-int',has_traffic_filtering=True,id=66c9992f-e23d-4c4c-bac0-302c3cbf23b3,network=Network(773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66c9992f-e2') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG os_vif [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:4f:9a,bridge_name='br-int',has_traffic_filtering=True,id=66c9992f-e23d-4c4c-bac0-302c3cbf23b3,network=Network(773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66c9992f-e2') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5ccb27a7-f92b-5957-a8db-301bf8a26bae', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66c9992f-e2, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap66c9992f-e2, col_values=(('qos', UUID('fb687d41-aee6-4762-99ec-09878803bf1f')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap66c9992f-e2, col_values=(('external_ids', {'iface-id': '66c9992f-e23d-4c4c-bac0-302c3cbf23b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:4f:9a', 'vm-uuid': 'f1dc83ed-2b0e-4da0-9347-9c84ec56178e'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:21 user nova-compute[75745]: INFO os_vif [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:4f:9a,bridge_name='br-int',has_traffic_filtering=True,id=66c9992f-e23d-4c4c-bac0-302c3cbf23b3,network=Network(773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66c9992f-e2')
Dec 01 17:46:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] No VIF found with MAC fa:16:3e:c0:4f:9a, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG nova.network.neutron [req-659e0a21-8b86-40a8-aa3e-5490c43c8240 req-2a271ffd-8491-4d48-a08f-14411ebe54b5 service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Updated VIF entry in instance network info cache for port 66c9992f-e23d-4c4c-bac0-302c3cbf23b3. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG nova.network.neutron [req-659e0a21-8b86-40a8-aa3e-5490c43c8240 req-2a271ffd-8491-4d48-a08f-14411ebe54b5 service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Updating instance_info_cache with network_info: [{"id": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "address": "fa:16:3e:c0:4f:9a", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c9992f-e2", "ovs_interfaceid": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-659e0a21-8b86-40a8-aa3e-5490c43c8240 req-2a271ffd-8491-4d48-a08f-14411ebe54b5 service nova] Releasing lock "refresh_cache-f1dc83ed-2b0e-4da0-9347-9c84ec56178e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:46:21 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:46:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:22 user nova-compute[75745]: DEBUG nova.compute.manager [req-a11c096e-4bd4-4bfd-8501-a3affa484d71 req-e770e788-d0d6-4595-98c7-1b5f1d568e6e service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Received event network-vif-plugged-66c9992f-e23d-4c4c-bac0-302c3cbf23b3 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:46:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a11c096e-4bd4-4bfd-8501-a3affa484d71 req-e770e788-d0d6-4595-98c7-1b5f1d568e6e service nova] Acquiring lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:46:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a11c096e-4bd4-4bfd-8501-a3affa484d71 req-e770e788-d0d6-4595-98c7-1b5f1d568e6e service nova] Lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:46:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a11c096e-4bd4-4bfd-8501-a3affa484d71 req-e770e788-d0d6-4595-98c7-1b5f1d568e6e service nova] Lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:46:22 user nova-compute[75745]: DEBUG nova.compute.manager [req-a11c096e-4bd4-4bfd-8501-a3affa484d71 req-e770e788-d0d6-4595-98c7-1b5f1d568e6e service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] No waiting events found dispatching network-vif-plugged-66c9992f-e23d-4c4c-bac0-302c3cbf23b3 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:46:22 user nova-compute[75745]: WARNING nova.compute.manager [req-a11c096e-4bd4-4bfd-8501-a3affa484d71 req-e770e788-d0d6-4595-98c7-1b5f1d568e6e service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Received unexpected event network-vif-plugged-66c9992f-e23d-4c4c-bac0-302c3cbf23b3 for instance with vm_state building and task_state spawning.
Dec 01 17:46:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:24 user nova-compute[75745]: DEBUG nova.compute.manager [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:46:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:46:24 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Instance spawned successfully.
Dec 01 17:46:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:46:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:46:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:46:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:46:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:46:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:46:24 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:46:24 user nova-compute[75745]: INFO nova.compute.manager [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Took 5.25 seconds to spawn the instance on the hypervisor.
Dec 01 17:46:24 user nova-compute[75745]: DEBUG nova.compute.manager [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:46:24 user nova-compute[75745]: DEBUG nova.compute.manager [req-11a66384-a1ba-4db9-b4a0-2c092b7eaba9 req-f0100e4b-b22f-4c0a-a176-fe5f7d581006 service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Received event network-vif-plugged-66c9992f-e23d-4c4c-bac0-302c3cbf23b3 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:46:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-11a66384-a1ba-4db9-b4a0-2c092b7eaba9 req-f0100e4b-b22f-4c0a-a176-fe5f7d581006 service nova] Acquiring lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:46:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-11a66384-a1ba-4db9-b4a0-2c092b7eaba9 req-f0100e4b-b22f-4c0a-a176-fe5f7d581006 service nova] Lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:46:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-11a66384-a1ba-4db9-b4a0-2c092b7eaba9 req-f0100e4b-b22f-4c0a-a176-fe5f7d581006 service nova] Lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:46:24 user nova-compute[75745]: DEBUG nova.compute.manager [req-11a66384-a1ba-4db9-b4a0-2c092b7eaba9 req-f0100e4b-b22f-4c0a-a176-fe5f7d581006 service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] No waiting events found dispatching network-vif-plugged-66c9992f-e23d-4c4c-bac0-302c3cbf23b3 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:46:24 user nova-compute[75745]: WARNING nova.compute.manager [req-11a66384-a1ba-4db9-b4a0-2c092b7eaba9 req-f0100e4b-b22f-4c0a-a176-fe5f7d581006 service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Received unexpected event network-vif-plugged-66c9992f-e23d-4c4c-bac0-302c3cbf23b3 for instance with vm_state building and task_state spawning.
Dec 01 17:46:24 user nova-compute[75745]: INFO nova.compute.manager [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Took 5.79 seconds to build instance.
Dec 01 17:46:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-e501574d-c349-4f40-a51c-e2d0610d0dcb tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.884s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:46:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:26 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:46:26 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:46:26 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Didn't find any instances for network info cache update. {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 17:46:30 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "94b38732-ce72-400b-ac07-7228d68f232a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:46:30 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "94b38732-ce72-400b-ac07-7228d68f232a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:46:30 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "94b38732-ce72-400b-ac07-7228d68f232a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:46:30 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "94b38732-ce72-400b-ac07-7228d68f232a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:46:30 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "94b38732-ce72-400b-ac07-7228d68f232a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:46:30 user nova-compute[75745]: INFO nova.compute.manager [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Terminating instance
Dec 01 17:46:30 user nova-compute[75745]: DEBUG nova.compute.manager [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:46:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:30 user nova-compute[75745]: DEBUG nova.compute.manager [req-8e989fb3-c6bd-41b0-9087-2f6309c66b67 req-64bb1a9e-115c-4aff-aa00-a34583824446 service nova] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Received event network-vif-unplugged-3db872b3-b631-40d3-a6d6-d6c0020f43e3 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:46:30 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8e989fb3-c6bd-41b0-9087-2f6309c66b67 req-64bb1a9e-115c-4aff-aa00-a34583824446 service nova] Acquiring lock "94b38732-ce72-400b-ac07-7228d68f232a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:46:30 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8e989fb3-c6bd-41b0-9087-2f6309c66b67 req-64bb1a9e-115c-4aff-aa00-a34583824446 service nova] Lock "94b38732-ce72-400b-ac07-7228d68f232a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:46:30 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-8e989fb3-c6bd-41b0-9087-2f6309c66b67 req-64bb1a9e-115c-4aff-aa00-a34583824446 service nova] Lock "94b38732-ce72-400b-ac07-7228d68f232a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:46:30 user nova-compute[75745]: DEBUG nova.compute.manager [req-8e989fb3-c6bd-41b0-9087-2f6309c66b67 req-64bb1a9e-115c-4aff-aa00-a34583824446 service nova] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] No waiting events found dispatching network-vif-unplugged-3db872b3-b631-40d3-a6d6-d6c0020f43e3 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:46:30 user nova-compute[75745]: DEBUG nova.compute.manager [req-8e989fb3-c6bd-41b0-9087-2f6309c66b67 req-64bb1a9e-115c-4aff-aa00-a34583824446 service nova] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Received event network-vif-unplugged-3db872b3-b631-40d3-a6d6-d6c0020f43e3 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:46:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:30 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Instance destroyed successfully.
Dec 01 17:46:30 user nova-compute[75745]: DEBUG nova.objects.instance [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lazy-loading 'resources' on Instance uuid 94b38732-ce72-400b-ac07-7228d68f232a {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:46:30 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:44:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1948953569',display_name='tempest-TestVolumeBootPattern-server-1948953569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1948953569',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:44:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e92d35468e65461d8ac34cb6c1d19b68',ramdisk_id='',reservation_id='r-ew2k8lma',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1187866378',owner_user_name='tempest-TestVolumeBootPattern-1187866378-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:45:00Z,user_data=None,user_id='d79b4d42093f4a12aae4fb90bbbcba39',uuid=94b38732-ce72-400b-ac07-7228d68f232a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3db872b3-b631-40d3-a6d6-d6c0020f43e3", "address": "fa:16:3e:cd:b0:3b", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db872b3-b6", "ovs_interfaceid": "3db872b3-b631-40d3-a6d6-d6c0020f43e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:46:30 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Converting VIF {"id": "3db872b3-b631-40d3-a6d6-d6c0020f43e3", "address": "fa:16:3e:cd:b0:3b", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db872b3-b6", "ovs_interfaceid": "3db872b3-b631-40d3-a6d6-d6c0020f43e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:46:30 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:b0:3b,bridge_name='br-int',has_traffic_filtering=True,id=3db872b3-b631-40d3-a6d6-d6c0020f43e3,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3db872b3-b6') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:46:30 user nova-compute[75745]: DEBUG os_vif [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:b0:3b,bridge_name='br-int',has_traffic_filtering=True,id=3db872b3-b631-40d3-a6d6-d6c0020f43e3,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3db872b3-b6') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3db872b3-b6, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b261fce4-efcc-4141-954b-19a359500410) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:31 user nova-compute[75745]: INFO os_vif [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:b0:3b,bridge_name='br-int',has_traffic_filtering=True,id=3db872b3-b631-40d3-a6d6-d6c0020f43e3,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3db872b3-b6')
Dec 01 17:46:31 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uSgBIHcK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:46:31 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:46:31 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef1f910-4450-4f04-a850-147b3f5d0a9d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:46:31 user nova-compute[75745]: No targets found.
Dec 01 17:46:31 user nova-compute[75745]: iSNS:
Dec 01 17:46:31 user nova-compute[75745]: No targets found.
Dec 01 17:46:31 user nova-compute[75745]: STATIC:
Dec 01 17:46:31 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff
Dec 01 17:46:31 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:46:31 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:46:31 user nova-compute[75745]: FIRMWARE:
Dec 01 17:46:31 user nova-compute[75745]: No targets found.
Dec 01 17:46:31 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:46:31 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:46:31 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f3d70d-48da-44bc-ac9e-bc547617c2dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[51854f71-8988-4236-bd6e-838bbc16491f]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff (non-flash)
Dec 01 17:46:31 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff (non-flash)
Dec 01 17:46:31 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24d830d1b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff'): ({'sdc'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Removing single pathed devices sdc {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5434c4e-ab90-4bbc-8c25-c1e7b4cb8f3f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e615a63-1e0a-4dc8-8c2c-31e9ab6e2923]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Flushing IO for device /dev/sdc {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac57b58-fa50-46b5-8f94-818934008a44]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68595d0-a073-4c38-a066-59909f3a6c9d]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] SCSI volumes sdc have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO7cffd307-c882bca11b66d11f', '/dev/disk/by-id/scsi-26338383262636131', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7cffd307') {{(pid=86714) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 01 17:46:31 user nova-compute[75745]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO7cffd307-c882bca11b66d11f
Dec 01 17:46:31 user nova-compute[75745]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26338383262636131
Dec 01 17:46:31 user nova-compute[75745]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_7cffd307
Dec 01 17:46:31 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e2f66e-7edb-49a4-a5a6-267080b11330]: (4, None) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.039s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d57f977-c7dc-4ae2-8f85-7591520b6980]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d84d4b3-d9a5-4faa-aaf6-4f1a5b3d65a8]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff, portal: 172.16.0.220,3260]
Dec 01 17:46:31 user nova-compute[75745]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff, portal: 172.16.0.220,3260] successful.
Dec 01 17:46:31 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90cfbf01-9922-4b32-9126-c91b40b394ff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ecf69e-9e85-42a9-a9a5-dd30d691b41e]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] <== disconnect_volume: return (380ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:46:31 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Deleting instance files /opt/stack/data/nova/instances/94b38732-ce72-400b-ac07-7228d68f232a_del
Dec 01 17:46:31 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Deletion of /opt/stack/data/nova/instances/94b38732-ce72-400b-ac07-7228d68f232a_del complete
Dec 01 17:46:31 user nova-compute[75745]: INFO nova.compute.manager [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Took 1.41 seconds to destroy the instance on the hypervisor.
Dec 01 17:46:31 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:31 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:46:31 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Took 0.45 seconds to deallocate network for instance.
Dec 01 17:46:31 user nova-compute[75745]: DEBUG nova.compute.manager [req-efd64fad-16b4-4e34-ae6c-48f2b16daf04 req-532be109-a406-498d-9b67-5370f3b72a8a service nova] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Received event network-vif-deleted-3db872b3-b631-40d3-a6d6-d6c0020f43e3 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:46:32 user nova-compute[75745]: DEBUG nova.compute.manager [req-6fc78514-c20d-47c6-8449-d995db5812f5 req-e95592ca-8dcd-457a-89ba-b7539815ca21 service nova] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Received event network-vif-plugged-3db872b3-b631-40d3-a6d6-d6c0020f43e3 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:46:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6fc78514-c20d-47c6-8449-d995db5812f5 req-e95592ca-8dcd-457a-89ba-b7539815ca21 service nova] Acquiring lock "94b38732-ce72-400b-ac07-7228d68f232a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:46:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6fc78514-c20d-47c6-8449-d995db5812f5 req-e95592ca-8dcd-457a-89ba-b7539815ca21 service nova] Lock "94b38732-ce72-400b-ac07-7228d68f232a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:46:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6fc78514-c20d-47c6-8449-d995db5812f5 req-e95592ca-8dcd-457a-89ba-b7539815ca21 service nova] Lock "94b38732-ce72-400b-ac07-7228d68f232a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:46:32 user nova-compute[75745]: DEBUG nova.compute.manager [req-6fc78514-c20d-47c6-8449-d995db5812f5 req-e95592ca-8dcd-457a-89ba-b7539815ca21 service nova] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] No waiting events found dispatching network-vif-plugged-3db872b3-b631-40d3-a6d6-d6c0020f43e3 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:46:32 user nova-compute[75745]: WARNING nova.compute.manager [req-6fc78514-c20d-47c6-8449-d995db5812f5 req-e95592ca-8dcd-457a-89ba-b7539815ca21 service nova] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Received unexpected event network-vif-plugged-3db872b3-b631-40d3-a6d6-d6c0020f43e3 for instance with vm_state active and task_state deleting.
Dec 01 17:46:32 user nova-compute[75745]: DEBUG nova.compute.manager [req-6fc78514-c20d-47c6-8449-d995db5812f5 req-e95592ca-8dcd-457a-89ba-b7539815ca21 service nova] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Received event network-vif-plugged-3db872b3-b631-40d3-a6d6-d6c0020f43e3 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:46:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6fc78514-c20d-47c6-8449-d995db5812f5 req-e95592ca-8dcd-457a-89ba-b7539815ca21 service nova] Acquiring lock "94b38732-ce72-400b-ac07-7228d68f232a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:46:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6fc78514-c20d-47c6-8449-d995db5812f5 req-e95592ca-8dcd-457a-89ba-b7539815ca21 service nova] Lock "94b38732-ce72-400b-ac07-7228d68f232a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:46:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6fc78514-c20d-47c6-8449-d995db5812f5 req-e95592ca-8dcd-457a-89ba-b7539815ca21 service nova] Lock "94b38732-ce72-400b-ac07-7228d68f232a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:46:32 user nova-compute[75745]: DEBUG nova.compute.manager [req-6fc78514-c20d-47c6-8449-d995db5812f5 req-e95592ca-8dcd-457a-89ba-b7539815ca21 service nova] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] No waiting events found dispatching network-vif-plugged-3db872b3-b631-40d3-a6d6-d6c0020f43e3 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:46:32 user nova-compute[75745]: WARNING nova.compute.manager [req-6fc78514-c20d-47c6-8449-d995db5812f5 req-e95592ca-8dcd-457a-89ba-b7539815ca21 service nova] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Received unexpected event network-vif-plugged-3db872b3-b631-40d3-a6d6-d6c0020f43e3 for instance with vm_state active and task_state deleting.
Dec 01 17:46:32 user nova-compute[75745]: DEBUG nova.compute.manager [req-6fc78514-c20d-47c6-8449-d995db5812f5 req-e95592ca-8dcd-457a-89ba-b7539815ca21 service nova] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Received event network-vif-plugged-3db872b3-b631-40d3-a6d6-d6c0020f43e3 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:46:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6fc78514-c20d-47c6-8449-d995db5812f5 req-e95592ca-8dcd-457a-89ba-b7539815ca21 service nova] Acquiring lock "94b38732-ce72-400b-ac07-7228d68f232a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:46:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6fc78514-c20d-47c6-8449-d995db5812f5 req-e95592ca-8dcd-457a-89ba-b7539815ca21 service nova] Lock "94b38732-ce72-400b-ac07-7228d68f232a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:46:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6fc78514-c20d-47c6-8449-d995db5812f5 req-e95592ca-8dcd-457a-89ba-b7539815ca21 service nova] Lock "94b38732-ce72-400b-ac07-7228d68f232a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:46:32 user nova-compute[75745]: DEBUG nova.compute.manager [req-6fc78514-c20d-47c6-8449-d995db5812f5 req-e95592ca-8dcd-457a-89ba-b7539815ca21 service nova] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] No waiting events found dispatching network-vif-plugged-3db872b3-b631-40d3-a6d6-d6c0020f43e3 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:46:32 user nova-compute[75745]: WARNING nova.compute.manager [req-6fc78514-c20d-47c6-8449-d995db5812f5 req-e95592ca-8dcd-457a-89ba-b7539815ca21 service nova] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Received unexpected event network-vif-plugged-3db872b3-b631-40d3-a6d6-d6c0020f43e3 for instance with vm_state active and task_state deleting.
Dec 01 17:46:32 user nova-compute[75745]: DEBUG nova.compute.manager [req-6fc78514-c20d-47c6-8449-d995db5812f5 req-e95592ca-8dcd-457a-89ba-b7539815ca21 service nova] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Received event network-vif-unplugged-3db872b3-b631-40d3-a6d6-d6c0020f43e3 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:46:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6fc78514-c20d-47c6-8449-d995db5812f5 req-e95592ca-8dcd-457a-89ba-b7539815ca21 service nova] Acquiring lock "94b38732-ce72-400b-ac07-7228d68f232a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:46:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6fc78514-c20d-47c6-8449-d995db5812f5 req-e95592ca-8dcd-457a-89ba-b7539815ca21 service nova] Lock "94b38732-ce72-400b-ac07-7228d68f232a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:46:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6fc78514-c20d-47c6-8449-d995db5812f5 req-e95592ca-8dcd-457a-89ba-b7539815ca21 service nova] Lock "94b38732-ce72-400b-ac07-7228d68f232a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:46:32 user nova-compute[75745]: DEBUG nova.compute.manager [req-6fc78514-c20d-47c6-8449-d995db5812f5 req-e95592ca-8dcd-457a-89ba-b7539815ca21 service nova] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] No waiting events found dispatching network-vif-unplugged-3db872b3-b631-40d3-a6d6-d6c0020f43e3 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:46:32 user nova-compute[75745]: DEBUG nova.compute.manager [req-6fc78514-c20d-47c6-8449-d995db5812f5 req-e95592ca-8dcd-457a-89ba-b7539815ca21 service nova] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Received event network-vif-unplugged-3db872b3-b631-40d3-a6d6-d6c0020f43e3 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:46:32 user nova-compute[75745]: DEBUG nova.compute.manager [req-6fc78514-c20d-47c6-8449-d995db5812f5 req-e95592ca-8dcd-457a-89ba-b7539815ca21 service nova] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Received event network-vif-plugged-3db872b3-b631-40d3-a6d6-d6c0020f43e3 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:46:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6fc78514-c20d-47c6-8449-d995db5812f5 req-e95592ca-8dcd-457a-89ba-b7539815ca21 service nova] Acquiring lock "94b38732-ce72-400b-ac07-7228d68f232a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:46:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6fc78514-c20d-47c6-8449-d995db5812f5 req-e95592ca-8dcd-457a-89ba-b7539815ca21 service nova] Lock "94b38732-ce72-400b-ac07-7228d68f232a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:46:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6fc78514-c20d-47c6-8449-d995db5812f5 req-e95592ca-8dcd-457a-89ba-b7539815ca21 service nova] Lock "94b38732-ce72-400b-ac07-7228d68f232a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:46:32 user nova-compute[75745]: DEBUG nova.compute.manager [req-6fc78514-c20d-47c6-8449-d995db5812f5 req-e95592ca-8dcd-457a-89ba-b7539815ca21 service nova] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] No waiting events found dispatching network-vif-plugged-3db872b3-b631-40d3-a6d6-d6c0020f43e3 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:46:32 user nova-compute[75745]: WARNING nova.compute.manager [req-6fc78514-c20d-47c6-8449-d995db5812f5 req-e95592ca-8dcd-457a-89ba-b7539815ca21 service nova] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Received unexpected event network-vif-plugged-3db872b3-b631-40d3-a6d6-d6c0020f43e3 for instance with vm_state active and task_state deleting.
Dec 01 17:46:32 user nova-compute[75745]: INFO nova.compute.manager [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Took 0.80 seconds to detach 1 volumes for instance.
Dec 01 17:46:32 user nova-compute[75745]: DEBUG nova.compute.manager [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 94b38732-ce72-400b-ac07-7228d68f232a] Deleting volume: 90cfbf01-9922-4b32-9126-c91b40b394ff {{(pid=75745) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 01 17:46:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:46:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:46:32 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:46:32 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:46:32 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:46:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.138s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:46:33 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Deleted allocations for instance 94b38732-ce72-400b-ac07-7228d68f232a
Dec 01 17:46:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-be624f0e-f12c-4b43-93b0-f4b0e4c743d9 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "94b38732-ce72-400b-ac07-7228d68f232a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.046s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:46:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:41 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:46:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:47:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:47:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:47:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:47:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:47:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:47:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:47:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:47:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:47:08 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:47:08 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Cleaning up deleted instances {{(pid=75745) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 01 17:47:08 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] There are 0 instances to clean {{(pid=75745) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 01 17:47:10 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:47:10 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:47:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:47:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:47:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:47:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:47:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:47:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:47:11 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:47:12 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:47:12 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:47:13 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:47:15 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:47:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:47:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:47:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:47:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:47:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:47:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:47:18 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:47:18 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:47:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:47:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:47:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:47:18 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:47:18 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:47:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:47:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:47:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:47:19 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:47:19 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:47:19 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=8944MB free_disk=25.122161865234375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:47:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:47:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:47:19 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance f1dc83ed-2b0e-4da0-9347-9c84ec56178e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:47:19 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:47:19 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:47:19 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:47:19 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:47:19 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:47:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.207s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:47:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:47:23 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:47:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:47:26 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:47:26 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:47:26 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Rebuilding the list of instances to heal {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 17:47:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-f1dc83ed-2b0e-4da0-9347-9c84ec56178e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:47:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-f1dc83ed-2b0e-4da0-9347-9c84ec56178e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:47:26 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:47:26 user nova-compute[75745]: DEBUG nova.objects.instance [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lazy-loading 'info_cache' on Instance uuid f1dc83ed-2b0e-4da0-9347-9c84ec56178e {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:47:27 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Updating instance_info_cache with network_info: [{"id": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "address": "fa:16:3e:c0:4f:9a", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c9992f-e2", "ovs_interfaceid": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:47:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-f1dc83ed-2b0e-4da0-9347-9c84ec56178e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:47:27 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:47:29 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:47:29 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75745) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 01 17:47:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:47:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:47:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:47:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:47:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:47:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:47:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:47:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:47:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "c3473bf6-5a7b-4030-b7b7-fe7540ed9b35" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:47:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "c3473bf6-5a7b-4030-b7b7-fe7540ed9b35" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:47:37 user nova-compute[75745]: DEBUG nova.compute.manager [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:47:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:47:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:47:37 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:47:37 user nova-compute[75745]: INFO nova.compute.claims [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Claim successful on node user
Dec 01 17:47:37 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:47:37 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:47:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.202s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:47:37 user nova-compute[75745]: DEBUG nova.compute.manager [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:47:37 user nova-compute[75745]: DEBUG nova.compute.manager [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:47:37 user nova-compute[75745]: DEBUG nova.network.neutron [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:47:37 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:47:37 user nova-compute[75745]: DEBUG nova.compute.manager [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:47:37 user nova-compute[75745]: INFO nova.virt.block_device [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Booting with volume f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 at /dev/vda
Dec 01 17:47:37 user nova-compute[75745]: DEBUG nova.policy [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd79b4d42093f4a12aae4fb90bbbcba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d35468e65461d8ac34cb6c1d19b68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:47:37 user nova-compute[75745]: DEBUG os_brick.utils [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:47:37 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:47:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:47:38 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a8d07f-9bdb-4deb-a900-04f03cacde81]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:47:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:47:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:47:38 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78fce7b-2a37-4d15-810b-bdc9158c33d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:47:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:47:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:47:38 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[40409e66-f778-42c4-bafe-ab9e8aab1136]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:47:38 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e4508a-41b0-48f1-8a74-e9d94a3e2b8e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:47:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:47:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:47:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:47:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:47:38 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:47:38 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:47:38 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8b9783-3532-44a0-8742-106401c276cd]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:47:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:47:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:47:38 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:47:38 user nova-compute[75745]: DEBUG os_brick.utils [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:47:38 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Updating existing volume attachment record: fd2dac39-74be-4b1b-91dc-677df32478fd {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:47:38 user nova-compute[75745]: DEBUG nova.network.neutron [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Successfully created port: 8f4ec3a6-2554-41e7-8486-ace5cf717fc4 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:47:39 user nova-compute[75745]: DEBUG nova.network.neutron [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Successfully updated port: 8f4ec3a6-2554-41e7-8486-ace5cf717fc4 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:47:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "refresh_cache-c3473bf6-5a7b-4030-b7b7-fe7540ed9b35" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:47:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquired lock "refresh_cache-c3473bf6-5a7b-4030-b7b7-fe7540ed9b35" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:47:39 user nova-compute[75745]: DEBUG nova.network.neutron [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:47:39 user nova-compute[75745]: DEBUG nova.compute.manager [req-836a29e8-3d87-42f6-8dc5-543ef7af68b1 req-2838da97-7dde-47d1-9630-cebc12135972 service nova] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Received event network-changed-8f4ec3a6-2554-41e7-8486-ace5cf717fc4 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:47:39 user nova-compute[75745]: DEBUG nova.compute.manager [req-836a29e8-3d87-42f6-8dc5-543ef7af68b1 req-2838da97-7dde-47d1-9630-cebc12135972 service nova] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Refreshing instance network info cache due to event network-changed-8f4ec3a6-2554-41e7-8486-ace5cf717fc4. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:47:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-836a29e8-3d87-42f6-8dc5-543ef7af68b1 req-2838da97-7dde-47d1-9630-cebc12135972 service nova] Acquiring lock "refresh_cache-c3473bf6-5a7b-4030-b7b7-fe7540ed9b35" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:47:39 user nova-compute[75745]: DEBUG nova.network.neutron [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:47:39 user nova-compute[75745]: DEBUG nova.network.neutron [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Updating instance_info_cache with network_info: [{"id": "8f4ec3a6-2554-41e7-8486-ace5cf717fc4", "address": "fa:16:3e:a8:d2:36", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4ec3a6-25", "ovs_interfaceid": "8f4ec3a6-2554-41e7-8486-ace5cf717fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:47:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Releasing lock "refresh_cache-c3473bf6-5a7b-4030-b7b7-fe7540ed9b35" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:47:39 user nova-compute[75745]: DEBUG nova.compute.manager [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Instance network_info: |[{"id": "8f4ec3a6-2554-41e7-8486-ace5cf717fc4", "address": "fa:16:3e:a8:d2:36", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4ec3a6-25", "ovs_interfaceid": "8f4ec3a6-2554-41e7-8486-ace5cf717fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:47:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-836a29e8-3d87-42f6-8dc5-543ef7af68b1 req-2838da97-7dde-47d1-9630-cebc12135972 service nova] Acquired lock "refresh_cache-c3473bf6-5a7b-4030-b7b7-fe7540ed9b35" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:47:39 user nova-compute[75745]: DEBUG nova.network.neutron [req-836a29e8-3d87-42f6-8dc5-543ef7af68b1 req-2838da97-7dde-47d1-9630-cebc12135972 service nova] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Refreshing network info cache for port 8f4ec3a6-2554-41e7-8486-ace5cf717fc4 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:47:40 user nova-compute[75745]: DEBUG nova.network.neutron [req-836a29e8-3d87-42f6-8dc5-543ef7af68b1 req-2838da97-7dde-47d1-9630-cebc12135972 service nova] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Updated VIF entry in instance network info cache for port 8f4ec3a6-2554-41e7-8486-ace5cf717fc4. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:47:40 user nova-compute[75745]: DEBUG nova.network.neutron [req-836a29e8-3d87-42f6-8dc5-543ef7af68b1 req-2838da97-7dde-47d1-9630-cebc12135972 service nova] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Updating instance_info_cache with network_info: [{"id": "8f4ec3a6-2554-41e7-8486-ace5cf717fc4", "address": "fa:16:3e:a8:d2:36", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4ec3a6-25", "ovs_interfaceid": "8f4ec3a6-2554-41e7-8486-ace5cf717fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:47:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-836a29e8-3d87-42f6-8dc5-543ef7af68b1 req-2838da97-7dde-47d1-9630-cebc12135972 service nova] Releasing lock "refresh_cache-c3473bf6-5a7b-4030-b7b7-fe7540ed9b35" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:47:41 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:47:41 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:47:41 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:47:41 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:47:41 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:47:41 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG nova.compute.manager [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:47:46 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Creating image(s)
Dec 01 17:47:46 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Did not create local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Ensure instance console log exists: /opt/stack/data/nova/instances/c3473bf6-5a7b-4030-b7b7-fe7540ed9b35/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Start _get_guest_xml network_info=[{"id": "8f4ec3a6-2554-41e7-8486-ace5cf717fc4", "address": "fa:16:3e:a8:d2:36", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4ec3a6-25", "ovs_interfaceid": "8f4ec3a6-2554-41e7-8486-ace5cf717fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': 'fd2dac39-74be-4b1b-91dc-677df32478fd', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GASPMkWg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c3473bf6-5a7b-4030-b7b7-fe7540ed9b35', 'attached_at': '', 'detached_at': '', 'volume_id': 'f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6', 'serial': 'f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6'}, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:47:46 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:47:46 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:47:46 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GASPMkWg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:47:46 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:47:46 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:47:46 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:47:46 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:47:46 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:47:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65fa276-0d3e-41b0-94b2-3d5f11e0d5b8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:47:46 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[36903805-5cd8-4158-a568-cd911d912d3f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6] added
Dec 01 17:47:46 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cafaec-0d25-4415-a33e-f940f3196eb7]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6284673f-573f-4d25-bc77-34a26d8b9f07]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:47:46 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:47:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GASPMkWg {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:47:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GASPMkWg" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:47:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6960ad8d-c97c-40e7-8120-0b40d37e4138]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:47:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GASPMkWg'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:47:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:47:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:47:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c12b1de-5232-4c2c-b191-8a33ef7629ee]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:47:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:47:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:47:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:47:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6377b87e-ee5d-4c94-b0ea-7014e62a13db]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:47:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 01 17:47:47 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:47:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 01 17:47:47 user nova-compute[75745]:  {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:47:47 user nova-compute[75745]: WARNING os_brick.initiator.connectors.iscsi [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 01 17:47:47 user nova-compute[75745]: 
Dec 01 17:47:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:47:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:47:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8579c4-4040-4c55-8c8e-df324e04211f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:47:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6, portal: 172.16.0.220,3260]
Dec 01 17:47:47 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6, portal: 172.16.0.220,3260] successful.
Dec 01 17:47:47 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:47:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:47:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:47:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[433eb04b-20f5-4951-8e39-5245b3834fe8]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:47:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:47:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:47:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:47:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec92b6e-04b5-4039-b757-14330c4188d8]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:47:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 (non-flash)
Dec 01 17:47:47 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:47:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 (non-flash)
Dec 01 17:47:47 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:47:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:47:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:47:47 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:47:47 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:47:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:47:47 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:47:47 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[732f0c4a-957f-4df5-93e4-583fe6a7f16e]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:47:47 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:47:47 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GASPMkWg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:47:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:47:48 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26231633362306661', 'path': '/dev/sdb'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:47:48 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231633362306661', 'path': '/dev/sdb'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:47:48 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:47:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-135113284',display_name='tempest-TestVolumeBootPattern-volume-backed-server-135113284',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-135113284',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJnx+6/PDZwuBiTkHM9zct5ttV2HD0ea3IkAARKnwKi7z7nBmfG+sfcAufr8CLozRh3MtN3jis9PS0QUTjv71AY3b+9MmatxhGV7D3dE3tVAyZEi/mVlxy5FAU2vjw8nQ==',key_name='tempest-keypair-1802021362',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e92d35468e65461d8ac34cb6c1d19b68',ramdisk_id='',reservation_id='r-6o7o2sop',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1187866378',owner_user_name='tempest-TestVolumeBootPattern-1187866378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:47:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d79b4d42093f4a12aae4fb90bbbcba39',uuid=c3473bf6-5a7b-4030-b7b7-fe7540ed9b35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f4ec3a6-2554-41e7-8486-ace5cf717fc4", "address": "fa:16:3e:a8:d2:36", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4ec3a6-25", "ovs_interfaceid": "8f4ec3a6-2554-41e7-8486-ace5cf717fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:47:48 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Converting VIF {"id": "8f4ec3a6-2554-41e7-8486-ace5cf717fc4", "address": "fa:16:3e:a8:d2:36", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4ec3a6-25", "ovs_interfaceid": "8f4ec3a6-2554-41e7-8486-ace5cf717fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:47:48 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:d2:36,bridge_name='br-int',has_traffic_filtering=True,id=8f4ec3a6-2554-41e7-8486-ace5cf717fc4,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f4ec3a6-25') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:47:48 user nova-compute[75745]: DEBUG nova.objects.instance [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lazy-loading 'pci_devices' on Instance uuid c3473bf6-5a7b-4030-b7b7-fe7540ed9b35 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:47:48 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:47:48 user nova-compute[75745]:   <uuid>c3473bf6-5a7b-4030-b7b7-fe7540ed9b35</uuid>
Dec 01 17:47:48 user nova-compute[75745]:   <name>instance-00000030</name>
Dec 01 17:47:48 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:47:48 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:47:48 user nova-compute[75745]:   <metadata>
Dec 01 17:47:48 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:47:48 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:47:48 user nova-compute[75745]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-135113284</nova:name>
Dec 01 17:47:48 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:47:46</nova:creationTime>
Dec 01 17:47:48 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:47:48 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:47:48 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:47:48 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:47:48 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:47:48 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:47:48 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:47:48 user nova-compute[75745]:       <nova:owner>
Dec 01 17:47:48 user nova-compute[75745]:         <nova:user uuid="d79b4d42093f4a12aae4fb90bbbcba39">tempest-TestVolumeBootPattern-1187866378-project-member</nova:user>
Dec 01 17:47:48 user nova-compute[75745]:         <nova:project uuid="e92d35468e65461d8ac34cb6c1d19b68">tempest-TestVolumeBootPattern-1187866378</nova:project>
Dec 01 17:47:48 user nova-compute[75745]:       </nova:owner>
Dec 01 17:47:48 user nova-compute[75745]:       <nova:ports>
Dec 01 17:47:48 user nova-compute[75745]:         <nova:port uuid="8f4ec3a6-2554-41e7-8486-ace5cf717fc4">
Dec 01 17:47:48 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 01 17:47:48 user nova-compute[75745]:         </nova:port>
Dec 01 17:47:48 user nova-compute[75745]:       </nova:ports>
Dec 01 17:47:48 user nova-compute[75745]:     </nova:instance>
Dec 01 17:47:48 user nova-compute[75745]:   </metadata>
Dec 01 17:47:48 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:47:48 user nova-compute[75745]:     <system>
Dec 01 17:47:48 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:47:48 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:47:48 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:47:48 user nova-compute[75745]:       <entry name="serial">c3473bf6-5a7b-4030-b7b7-fe7540ed9b35</entry>
Dec 01 17:47:48 user nova-compute[75745]:       <entry name="uuid">c3473bf6-5a7b-4030-b7b7-fe7540ed9b35</entry>
Dec 01 17:47:48 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:47:48 user nova-compute[75745]:     </system>
Dec 01 17:47:48 user nova-compute[75745]:   </sysinfo>
Dec 01 17:47:48 user nova-compute[75745]:   <os>
Dec 01 17:47:48 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:47:48 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:47:48 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:47:48 user nova-compute[75745]:   </os>
Dec 01 17:47:48 user nova-compute[75745]:   <features>
Dec 01 17:47:48 user nova-compute[75745]:     <acpi/>
Dec 01 17:47:48 user nova-compute[75745]:     <apic/>
Dec 01 17:47:48 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:47:48 user nova-compute[75745]:   </features>
Dec 01 17:47:48 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:47:48 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:47:48 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:47:48 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:47:48 user nova-compute[75745]:   </clock>
Dec 01 17:47:48 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:47:48 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:47:48 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:47:48 user nova-compute[75745]:   </cpu>
Dec 01 17:47:48 user nova-compute[75745]:   <devices>
Dec 01 17:47:48 user nova-compute[75745]:     <disk type="block" device="disk">
Dec 01 17:47:48 user nova-compute[75745]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:47:48 user nova-compute[75745]:       <source dev="/dev/sdb"/>
Dec 01 17:47:48 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:47:48 user nova-compute[75745]:       <serial>f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6</serial>
Dec 01 17:47:48 user nova-compute[75745]:     </disk>
Dec 01 17:47:48 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:47:48 user nova-compute[75745]:       <mac address="fa:16:3e:a8:d2:36"/>
Dec 01 17:47:48 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:47:48 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:47:48 user nova-compute[75745]:       <target dev="tap8f4ec3a6-25"/>
Dec 01 17:47:48 user nova-compute[75745]:     </interface>
Dec 01 17:47:48 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:47:48 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/c3473bf6-5a7b-4030-b7b7-fe7540ed9b35/console.log" append="off"/>
Dec 01 17:47:48 user nova-compute[75745]:     </serial>
Dec 01 17:47:48 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:47:48 user nova-compute[75745]:     <video>
Dec 01 17:47:48 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:47:48 user nova-compute[75745]:     </video>
Dec 01 17:47:48 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:47:48 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:47:48 user nova-compute[75745]:     </rng>
Dec 01 17:47:48 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:47:48 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:47:48 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:47:48 user nova-compute[75745]:     </memballoon>
Dec 01 17:47:48 user nova-compute[75745]:   </devices>
Dec 01 17:47:48 user nova-compute[75745]: </domain>
Dec 01 17:47:48 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:47:48 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:47:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-135113284',display_name='tempest-TestVolumeBootPattern-volume-backed-server-135113284',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-135113284',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJnx+6/PDZwuBiTkHM9zct5ttV2HD0ea3IkAARKnwKi7z7nBmfG+sfcAufr8CLozRh3MtN3jis9PS0QUTjv71AY3b+9MmatxhGV7D3dE3tVAyZEi/mVlxy5FAU2vjw8nQ==',key_name='tempest-keypair-1802021362',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e92d35468e65461d8ac34cb6c1d19b68',ramdisk_id='',reservation_id='r-6o7o2sop',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1187866378',owner_user_name='tempest-TestVolumeBootPattern-1187866378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:47:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d79b4d42093f4a12aae4fb90bbbcba39',uuid=c3473bf6-5a7b-4030-b7b7-fe7540ed9b35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f4ec3a6-2554-41e7-8486-ace5cf717fc4", "address": "fa:16:3e:a8:d2:36", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4ec3a6-25", "ovs_interfaceid": "8f4ec3a6-2554-41e7-8486-ace5cf717fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:47:48 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Converting VIF {"id": "8f4ec3a6-2554-41e7-8486-ace5cf717fc4", "address": "fa:16:3e:a8:d2:36", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4ec3a6-25", "ovs_interfaceid": "8f4ec3a6-2554-41e7-8486-ace5cf717fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:47:48 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:d2:36,bridge_name='br-int',has_traffic_filtering=True,id=8f4ec3a6-2554-41e7-8486-ace5cf717fc4,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f4ec3a6-25') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:47:48 user nova-compute[75745]: DEBUG os_vif [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:d2:36,bridge_name='br-int',has_traffic_filtering=True,id=8f4ec3a6-2554-41e7-8486-ace5cf717fc4,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f4ec3a6-25') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:47:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:47:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:47:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:47:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:47:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e4538936-da2c-55e0-a434-128a2eeb4458', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:47:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:47:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:47:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:47:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f4ec3a6-25, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:47:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f4ec3a6-25, col_values=(('qos', UUID('b09caf8f-d7e8-4878-a79c-0d321262d845')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:47:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f4ec3a6-25, col_values=(('external_ids', {'iface-id': '8f4ec3a6-2554-41e7-8486-ace5cf717fc4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:d2:36', 'vm-uuid': 'c3473bf6-5a7b-4030-b7b7-fe7540ed9b35'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:47:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:47:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:47:48 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:47:48 user nova-compute[75745]: INFO os_vif [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:d2:36,bridge_name='br-int',has_traffic_filtering=True,id=8f4ec3a6-2554-41e7-8486-ace5cf717fc4,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f4ec3a6-25')
Dec 01 17:47:48 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:47:48 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] No VIF found with MAC fa:16:3e:a8:d2:36, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:47:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:47:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:47:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:47:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:47:49 user nova-compute[75745]: DEBUG nova.compute.manager [req-84b6522e-e5a8-4aed-a82e-506495429f53 req-4602e073-cce4-4541-bf3b-0ba56a64ef8d service nova] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Received event network-vif-plugged-8f4ec3a6-2554-41e7-8486-ace5cf717fc4 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:47:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-84b6522e-e5a8-4aed-a82e-506495429f53 req-4602e073-cce4-4541-bf3b-0ba56a64ef8d service nova] Acquiring lock "c3473bf6-5a7b-4030-b7b7-fe7540ed9b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:47:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-84b6522e-e5a8-4aed-a82e-506495429f53 req-4602e073-cce4-4541-bf3b-0ba56a64ef8d service nova] Lock "c3473bf6-5a7b-4030-b7b7-fe7540ed9b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:47:49 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-84b6522e-e5a8-4aed-a82e-506495429f53 req-4602e073-cce4-4541-bf3b-0ba56a64ef8d service nova] Lock "c3473bf6-5a7b-4030-b7b7-fe7540ed9b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:47:49 user nova-compute[75745]: DEBUG nova.compute.manager [req-84b6522e-e5a8-4aed-a82e-506495429f53 req-4602e073-cce4-4541-bf3b-0ba56a64ef8d service nova] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] No waiting events found dispatching network-vif-plugged-8f4ec3a6-2554-41e7-8486-ace5cf717fc4 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:47:49 user nova-compute[75745]: WARNING nova.compute.manager [req-84b6522e-e5a8-4aed-a82e-506495429f53 req-4602e073-cce4-4541-bf3b-0ba56a64ef8d service nova] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Received unexpected event network-vif-plugged-8f4ec3a6-2554-41e7-8486-ace5cf717fc4 for instance with vm_state building and task_state spawning.
Dec 01 17:47:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:47:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:47:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:47:51 user nova-compute[75745]: DEBUG nova.compute.manager [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:47:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:47:51 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Instance spawned successfully.
Dec 01 17:47:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:47:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:47:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:47:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:47:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:47:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:47:51 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:47:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-1a0f98be-bd80-4247-8684-1356a1a68306 req-7616a0e9-97be-4dad-aa45-e0646bd65875 service nova] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Received event network-vif-plugged-8f4ec3a6-2554-41e7-8486-ace5cf717fc4 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:47:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1a0f98be-bd80-4247-8684-1356a1a68306 req-7616a0e9-97be-4dad-aa45-e0646bd65875 service nova] Acquiring lock "c3473bf6-5a7b-4030-b7b7-fe7540ed9b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:47:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1a0f98be-bd80-4247-8684-1356a1a68306 req-7616a0e9-97be-4dad-aa45-e0646bd65875 service nova] Lock "c3473bf6-5a7b-4030-b7b7-fe7540ed9b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:47:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1a0f98be-bd80-4247-8684-1356a1a68306 req-7616a0e9-97be-4dad-aa45-e0646bd65875 service nova] Lock "c3473bf6-5a7b-4030-b7b7-fe7540ed9b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:47:51 user nova-compute[75745]: DEBUG nova.compute.manager [req-1a0f98be-bd80-4247-8684-1356a1a68306 req-7616a0e9-97be-4dad-aa45-e0646bd65875 service nova] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] No waiting events found dispatching network-vif-plugged-8f4ec3a6-2554-41e7-8486-ace5cf717fc4 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:47:51 user nova-compute[75745]: WARNING nova.compute.manager [req-1a0f98be-bd80-4247-8684-1356a1a68306 req-7616a0e9-97be-4dad-aa45-e0646bd65875 service nova] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Received unexpected event network-vif-plugged-8f4ec3a6-2554-41e7-8486-ace5cf717fc4 for instance with vm_state building and task_state spawning.
Dec 01 17:47:51 user nova-compute[75745]: INFO nova.compute.manager [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Took 4.99 seconds to spawn the instance on the hypervisor.
Dec 01 17:47:51 user nova-compute[75745]: DEBUG nova.compute.manager [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:47:51 user nova-compute[75745]: INFO nova.compute.manager [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Took 14.36 seconds to build instance.
Dec 01 17:47:51 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-0ed94fed-cd8e-4b89-94dd-894dcea3c037 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "c3473bf6-5a7b-4030-b7b7-fe7540ed9b35" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.457s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:47:53 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:47:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:47:58 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:48:03 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:48:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:48:08 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:48:09 user nova-compute[75745]: DEBUG nova.compute.manager [req-7ef6dcad-72e1-427a-93cf-b63808a60155 req-f59aee0b-65fd-4090-a5f2-7a555e8dd561 service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Received event network-changed-66c9992f-e23d-4c4c-bac0-302c3cbf23b3 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:48:09 user nova-compute[75745]: DEBUG nova.compute.manager [req-7ef6dcad-72e1-427a-93cf-b63808a60155 req-f59aee0b-65fd-4090-a5f2-7a555e8dd561 service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Refreshing instance network info cache due to event network-changed-66c9992f-e23d-4c4c-bac0-302c3cbf23b3. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:48:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7ef6dcad-72e1-427a-93cf-b63808a60155 req-f59aee0b-65fd-4090-a5f2-7a555e8dd561 service nova] Acquiring lock "refresh_cache-f1dc83ed-2b0e-4da0-9347-9c84ec56178e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:48:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7ef6dcad-72e1-427a-93cf-b63808a60155 req-f59aee0b-65fd-4090-a5f2-7a555e8dd561 service nova] Acquired lock "refresh_cache-f1dc83ed-2b0e-4da0-9347-9c84ec56178e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:48:09 user nova-compute[75745]: DEBUG nova.network.neutron [req-7ef6dcad-72e1-427a-93cf-b63808a60155 req-f59aee0b-65fd-4090-a5f2-7a555e8dd561 service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Refreshing network info cache for port 66c9992f-e23d-4c4c-bac0-302c3cbf23b3 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:48:10 user nova-compute[75745]: DEBUG nova.network.neutron [req-7ef6dcad-72e1-427a-93cf-b63808a60155 req-f59aee0b-65fd-4090-a5f2-7a555e8dd561 service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Updated VIF entry in instance network info cache for port 66c9992f-e23d-4c4c-bac0-302c3cbf23b3. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:48:10 user nova-compute[75745]: DEBUG nova.network.neutron [req-7ef6dcad-72e1-427a-93cf-b63808a60155 req-f59aee0b-65fd-4090-a5f2-7a555e8dd561 service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Updating instance_info_cache with network_info: [{"id": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "address": "fa:16:3e:c0:4f:9a", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c9992f-e2", "ovs_interfaceid": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:48:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7ef6dcad-72e1-427a-93cf-b63808a60155 req-f59aee0b-65fd-4090-a5f2-7a555e8dd561 service nova] Releasing lock "refresh_cache-f1dc83ed-2b0e-4da0-9347-9c84ec56178e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:48:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:48:11 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:48:12 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:48:12 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:48:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:48:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:48:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:48:13 user nova-compute[75745]: INFO nova.compute.manager [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Shelving
Dec 01 17:48:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:48:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:48:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:48:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:48:14 user nova-compute[75745]: DEBUG nova.compute.manager [req-c1d9fcc2-ce5c-4f51-a65c-c492f05d03c9 req-e3abfd29-bbb3-4e36-9dca-9ee5b9bdfdcd service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Received event network-vif-unplugged-66c9992f-e23d-4c4c-bac0-302c3cbf23b3 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:48:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c1d9fcc2-ce5c-4f51-a65c-c492f05d03c9 req-e3abfd29-bbb3-4e36-9dca-9ee5b9bdfdcd service nova] Acquiring lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:48:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c1d9fcc2-ce5c-4f51-a65c-c492f05d03c9 req-e3abfd29-bbb3-4e36-9dca-9ee5b9bdfdcd service nova] Lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:48:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c1d9fcc2-ce5c-4f51-a65c-c492f05d03c9 req-e3abfd29-bbb3-4e36-9dca-9ee5b9bdfdcd service nova] Lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:48:14 user nova-compute[75745]: DEBUG nova.compute.manager [req-c1d9fcc2-ce5c-4f51-a65c-c492f05d03c9 req-e3abfd29-bbb3-4e36-9dca-9ee5b9bdfdcd service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] No waiting events found dispatching network-vif-unplugged-66c9992f-e23d-4c4c-bac0-302c3cbf23b3 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:48:14 user nova-compute[75745]: WARNING nova.compute.manager [req-c1d9fcc2-ce5c-4f51-a65c-c492f05d03c9 req-e3abfd29-bbb3-4e36-9dca-9ee5b9bdfdcd service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Received unexpected event network-vif-unplugged-66c9992f-e23d-4c4c-bac0-302c3cbf23b3 for instance with vm_state active and task_state shelving.
Dec 01 17:48:14 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Instance destroyed successfully.
Dec 01 17:48:14 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Beginning cold snapshot process
Dec 01 17:48:14 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:48:14 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:48:14 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:48:14 user nova-compute[75745]: DEBUG nova.privsep.utils [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75745) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 17:48:14 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e/disk /opt/stack/data/nova/instances/snapshots/tmpb6w14lye/6022c510e1c84aa282e858284eb21bfa {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:48:15 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e/disk /opt/stack/data/nova/instances/snapshots/tmpb6w14lye/6022c510e1c84aa282e858284eb21bfa" returned: 0 in 0.692s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:48:15 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Snapshot extracted, beginning image upload
Dec 01 17:48:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:48:16 user nova-compute[75745]: DEBUG nova.compute.manager [req-201de5cd-d58c-447e-ad5b-808febeb7278 req-fca0e178-1098-4113-81dc-6f9b5258d774 service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Received event network-vif-plugged-66c9992f-e23d-4c4c-bac0-302c3cbf23b3 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:48:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-201de5cd-d58c-447e-ad5b-808febeb7278 req-fca0e178-1098-4113-81dc-6f9b5258d774 service nova] Acquiring lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:48:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-201de5cd-d58c-447e-ad5b-808febeb7278 req-fca0e178-1098-4113-81dc-6f9b5258d774 service nova] Lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:48:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-201de5cd-d58c-447e-ad5b-808febeb7278 req-fca0e178-1098-4113-81dc-6f9b5258d774 service nova] Lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:48:16 user nova-compute[75745]: DEBUG nova.compute.manager [req-201de5cd-d58c-447e-ad5b-808febeb7278 req-fca0e178-1098-4113-81dc-6f9b5258d774 service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] No waiting events found dispatching network-vif-plugged-66c9992f-e23d-4c4c-bac0-302c3cbf23b3 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:48:16 user nova-compute[75745]: WARNING nova.compute.manager [req-201de5cd-d58c-447e-ad5b-808febeb7278 req-fca0e178-1098-4113-81dc-6f9b5258d774 service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Received unexpected event network-vif-plugged-66c9992f-e23d-4c4c-bac0-302c3cbf23b3 for instance with vm_state active and task_state shelving_image_uploading.
Dec 01 17:48:18 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Snapshot image upload complete
Dec 01 17:48:18 user nova-compute[75745]: DEBUG nova.compute.manager [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:48:18 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:48:18 user nova-compute[75745]: INFO nova.compute.manager [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Shelve offloading
Dec 01 17:48:18 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Instance destroyed successfully.
Dec 01 17:48:18 user nova-compute[75745]: DEBUG nova.compute.manager [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:48:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "refresh_cache-f1dc83ed-2b0e-4da0-9347-9c84ec56178e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:48:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquired lock "refresh_cache-f1dc83ed-2b0e-4da0-9347-9c84ec56178e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:48:18 user nova-compute[75745]: DEBUG nova.network.neutron [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:48:18 user nova-compute[75745]: DEBUG nova.network.neutron [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Updating instance_info_cache with network_info: [{"id": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "address": "fa:16:3e:c0:4f:9a", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c9992f-e2", "ovs_interfaceid": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:48:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Releasing lock "refresh_cache-f1dc83ed-2b0e-4da0-9347-9c84ec56178e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:48:19 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Instance destroyed successfully.
Dec 01 17:48:19 user nova-compute[75745]: DEBUG nova.objects.instance [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lazy-loading 'resources' on Instance uuid f1dc83ed-2b0e-4da0-9347-9c84ec56178e {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1367548217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1367548217',id=47,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrJjzWe2dmCmfbeohRIk+Pm459FXB6ILb6KNT9dVtbXr/Rb7p3tqvYGiAgsb8bBqY0SFBblqW+doitJ7086KH0vAYypa1FPV1ZHGj93RrNMK68bNSvI+WBbwwAkUVcRHw==',key_name='tempest-keypair-1089424176',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:46:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2b1e7099305f4571804612f3a3d8befb',ramdisk_id='',reservation_id='r-s927zouf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1555393357',owner_user_name='tempest-AttachVolumeShelveTestJSON-1555393357-project-member',shelved_at='2023-12-01T17:48:18.317201',shelved_host='user',shelved_image_id='bb5af60b-fb4a-4de3-a9fc-53a28ca7e08b'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:48:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f78365cc1e11444db345efc5fe3cc502',uuid=f1dc83ed-2b0e-4da0-9347-9c84ec56178e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "address": "fa:16:3e:c0:4f:9a", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c9992f-e2", "ovs_interfaceid": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Converting VIF {"id": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "address": "fa:16:3e:c0:4f:9a", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c9992f-e2", "ovs_interfaceid": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:4f:9a,bridge_name='br-int',has_traffic_filtering=True,id=66c9992f-e23d-4c4c-bac0-302c3cbf23b3,network=Network(773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66c9992f-e2') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG os_vif [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:4f:9a,bridge_name='br-int',has_traffic_filtering=True,id=66c9992f-e23d-4c4c-bac0-302c3cbf23b3,network=Network(773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66c9992f-e2') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66c9992f-e2, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG nova.compute.manager [req-2db6e168-ae98-4bc0-a69f-6bd69eb75f17 req-aa84330d-051f-4656-843e-76d7ddeab2cd service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Received event network-changed-66c9992f-e23d-4c4c-bac0-302c3cbf23b3 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG nova.compute.manager [req-2db6e168-ae98-4bc0-a69f-6bd69eb75f17 req-aa84330d-051f-4656-843e-76d7ddeab2cd service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Refreshing instance network info cache due to event network-changed-66c9992f-e23d-4c4c-bac0-302c3cbf23b3. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2db6e168-ae98-4bc0-a69f-6bd69eb75f17 req-aa84330d-051f-4656-843e-76d7ddeab2cd service nova] Acquiring lock "refresh_cache-f1dc83ed-2b0e-4da0-9347-9c84ec56178e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2db6e168-ae98-4bc0-a69f-6bd69eb75f17 req-aa84330d-051f-4656-843e-76d7ddeab2cd service nova] Acquired lock "refresh_cache-f1dc83ed-2b0e-4da0-9347-9c84ec56178e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG nova.network.neutron [req-2db6e168-ae98-4bc0-a69f-6bd69eb75f17 req-aa84330d-051f-4656-843e-76d7ddeab2cd service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Refreshing network info cache for port 66c9992f-e23d-4c4c-bac0-302c3cbf23b3 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fb687d41-aee6-4762-99ec-09878803bf1f) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:48:19 user nova-compute[75745]: INFO os_vif [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:4f:9a,bridge_name='br-int',has_traffic_filtering=True,id=66c9992f-e23d-4c4c-bac0-302c3cbf23b3,network=Network(773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66c9992f-e2')
Dec 01 17:48:19 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Deleting instance files /opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e_del
Dec 01 17:48:19 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Deletion of /opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e_del complete
Dec 01 17:48:19 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Deleted allocations for instance f1dc83ed-2b0e-4da0-9347-9c84ec56178e
Dec 01 17:48:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG nova.objects.instance [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lazy-loading 'numa_topology' on Instance uuid f1dc83ed-2b0e-4da0-9347-9c84ec56178e {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG nova.objects.base [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Object Instance<f1dc83ed-2b0e-4da0-9347-9c84ec56178e> lazy-loaded attributes: resources,numa_topology {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Refreshing inventories for resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Updating ProviderTree inventory for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Updating inventory in ProviderTree for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Refreshing aggregate associations for resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9, aggregates: None {{(pid=75745) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Refreshing trait associations for resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9, traits: COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=75745) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG nova.network.neutron [req-2db6e168-ae98-4bc0-a69f-6bd69eb75f17 req-aa84330d-051f-4656-843e-76d7ddeab2cd service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Updated VIF entry in instance network info cache for port 66c9992f-e23d-4c4c-bac0-302c3cbf23b3. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG nova.network.neutron [req-2db6e168-ae98-4bc0-a69f-6bd69eb75f17 req-aa84330d-051f-4656-843e-76d7ddeab2cd service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Updating instance_info_cache with network_info: [{"id": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "address": "fa:16:3e:c0:4f:9a", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap66c9992f-e2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2db6e168-ae98-4bc0-a69f-6bd69eb75f17 req-aa84330d-051f-4656-843e-76d7ddeab2cd service nova] Releasing lock "refresh_cache-f1dc83ed-2b0e-4da0-9347-9c84ec56178e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.007s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1e67255d-40b4-4147-98aa-16e323c7456f tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.013s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:48:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:48:20 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:48:20 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:48:20 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=8875MB free_disk=25.091041564941406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:48:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:48:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:48:20 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance c3473bf6-5a7b-4030-b7b7-fe7540ed9b35 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:48:20 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:48:20 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:48:20 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:48:20 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:48:20 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:48:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:48:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:48:21 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:48:22 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:48:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:48:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:48:26 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:48:26 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:48:26 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Rebuilding the list of instances to heal {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 17:48:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-c3473bf6-5a7b-4030-b7b7-fe7540ed9b35" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:48:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-c3473bf6-5a7b-4030-b7b7-fe7540ed9b35" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:48:26 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:48:26 user nova-compute[75745]: DEBUG nova.objects.instance [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lazy-loading 'info_cache' on Instance uuid c3473bf6-5a7b-4030-b7b7-fe7540ed9b35 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:48:27 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Updating instance_info_cache with network_info: [{"id": "8f4ec3a6-2554-41e7-8486-ace5cf717fc4", "address": "fa:16:3e:a8:d2:36", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4ec3a6-25", "ovs_interfaceid": "8f4ec3a6-2554-41e7-8486-ace5cf717fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:48:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-c3473bf6-5a7b-4030-b7b7-fe7540ed9b35" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:48:27 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:48:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:48:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:48:38 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:48:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:48:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:48:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:48:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:48:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:48:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:48:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:48:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:48:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:48:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:48:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:49:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:49:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:49:12 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:49:13 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:49:13 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:49:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:49:14 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:49:14 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:49:15 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:49:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:49:19 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:49:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:49:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:49:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:49:19 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:49:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:49:20 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:49:20 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:49:20 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=8952MB free_disk=25.090465545654297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:49:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:49:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:49:20 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance c3473bf6-5a7b-4030-b7b7-fe7540ed9b35 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:49:20 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:49:20 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:49:20 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:49:20 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:49:20 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:49:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:49:22 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:49:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:49:24 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:49:27 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:49:27 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:49:27 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Rebuilding the list of instances to heal {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 17:49:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-c3473bf6-5a7b-4030-b7b7-fe7540ed9b35" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:49:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-c3473bf6-5a7b-4030-b7b7-fe7540ed9b35" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:49:28 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:49:28 user nova-compute[75745]: DEBUG nova.objects.instance [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lazy-loading 'info_cache' on Instance uuid c3473bf6-5a7b-4030-b7b7-fe7540ed9b35 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:49:28 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Updating instance_info_cache with network_info: [{"id": "8f4ec3a6-2554-41e7-8486-ace5cf717fc4", "address": "fa:16:3e:a8:d2:36", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4ec3a6-25", "ovs_interfaceid": "8f4ec3a6-2554-41e7-8486-ace5cf717fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:49:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-c3473bf6-5a7b-4030-b7b7-fe7540ed9b35" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:49:28 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:49:28 user nova-compute[75745]: DEBUG nova.compute.manager [req-4a757726-e260-4365-8425-fbc4d2ca8a11 req-071d9351-c78b-4e28-bf0b-b5469fd4a20e service nova] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Received event network-changed-8f4ec3a6-2554-41e7-8486-ace5cf717fc4 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:49:28 user nova-compute[75745]: DEBUG nova.compute.manager [req-4a757726-e260-4365-8425-fbc4d2ca8a11 req-071d9351-c78b-4e28-bf0b-b5469fd4a20e service nova] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Refreshing instance network info cache due to event network-changed-8f4ec3a6-2554-41e7-8486-ace5cf717fc4. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:49:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-4a757726-e260-4365-8425-fbc4d2ca8a11 req-071d9351-c78b-4e28-bf0b-b5469fd4a20e service nova] Acquiring lock "refresh_cache-c3473bf6-5a7b-4030-b7b7-fe7540ed9b35" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:49:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-4a757726-e260-4365-8425-fbc4d2ca8a11 req-071d9351-c78b-4e28-bf0b-b5469fd4a20e service nova] Acquired lock "refresh_cache-c3473bf6-5a7b-4030-b7b7-fe7540ed9b35" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:49:28 user nova-compute[75745]: DEBUG nova.network.neutron [req-4a757726-e260-4365-8425-fbc4d2ca8a11 req-071d9351-c78b-4e28-bf0b-b5469fd4a20e service nova] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Refreshing network info cache for port 8f4ec3a6-2554-41e7-8486-ace5cf717fc4 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:49:29 user nova-compute[75745]: DEBUG nova.network.neutron [req-4a757726-e260-4365-8425-fbc4d2ca8a11 req-071d9351-c78b-4e28-bf0b-b5469fd4a20e service nova] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Updated VIF entry in instance network info cache for port 8f4ec3a6-2554-41e7-8486-ace5cf717fc4. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:49:29 user nova-compute[75745]: DEBUG nova.network.neutron [req-4a757726-e260-4365-8425-fbc4d2ca8a11 req-071d9351-c78b-4e28-bf0b-b5469fd4a20e service nova] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Updating instance_info_cache with network_info: [{"id": "8f4ec3a6-2554-41e7-8486-ace5cf717fc4", "address": "fa:16:3e:a8:d2:36", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4ec3a6-25", "ovs_interfaceid": "8f4ec3a6-2554-41e7-8486-ace5cf717fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:49:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-4a757726-e260-4365-8425-fbc4d2ca8a11 req-071d9351-c78b-4e28-bf0b-b5469fd4a20e service nova] Releasing lock "refresh_cache-c3473bf6-5a7b-4030-b7b7-fe7540ed9b35" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:49:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:49:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:49:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:49:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:49:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:49:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "6e046ac0-e912-4831-a8d7-8749e1a00087" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:49:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "6e046ac0-e912-4831-a8d7-8749e1a00087" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:49:38 user nova-compute[75745]: DEBUG nova.compute.manager [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:49:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:49:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:49:38 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:49:38 user nova-compute[75745]: INFO nova.compute.claims [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Claim successful on node user
Dec 01 17:49:38 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:49:38 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:49:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.213s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:49:38 user nova-compute[75745]: DEBUG nova.compute.manager [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:49:38 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:49:38 user nova-compute[75745]: DEBUG nova.compute.manager [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:49:38 user nova-compute[75745]: DEBUG nova.network.neutron [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:49:38 user nova-compute[75745]: DEBUG nova.compute.manager [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:49:38 user nova-compute[75745]: INFO nova.virt.block_device [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Booting with volume snapshot 76361035-a34d-41cb-8e31-9093127936e9 at /dev/vda
Dec 01 17:49:38 user nova-compute[75745]: DEBUG nova.policy [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd79b4d42093f4a12aae4fb90bbbcba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d35468e65461d8ac34cb6c1d19b68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:49:39 user nova-compute[75745]: DEBUG nova.network.neutron [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Successfully created port: d99d66eb-0c4d-494a-86c8-3b694c4cb6d5 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:49:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:49:39 user nova-compute[75745]: DEBUG nova.network.neutron [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Successfully updated port: d99d66eb-0c4d-494a-86c8-3b694c4cb6d5 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:49:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "refresh_cache-6e046ac0-e912-4831-a8d7-8749e1a00087" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:49:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquired lock "refresh_cache-6e046ac0-e912-4831-a8d7-8749e1a00087" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:49:39 user nova-compute[75745]: DEBUG nova.network.neutron [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:49:40 user nova-compute[75745]: DEBUG nova.compute.manager [req-84afec49-ce2a-46ac-bc5a-b711f1d34a21 req-dc331e28-65d6-4831-afbf-3fbf98f707b1 service nova] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Received event network-changed-d99d66eb-0c4d-494a-86c8-3b694c4cb6d5 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:49:40 user nova-compute[75745]: DEBUG nova.compute.manager [req-84afec49-ce2a-46ac-bc5a-b711f1d34a21 req-dc331e28-65d6-4831-afbf-3fbf98f707b1 service nova] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Refreshing instance network info cache due to event network-changed-d99d66eb-0c4d-494a-86c8-3b694c4cb6d5. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:49:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-84afec49-ce2a-46ac-bc5a-b711f1d34a21 req-dc331e28-65d6-4831-afbf-3fbf98f707b1 service nova] Acquiring lock "refresh_cache-6e046ac0-e912-4831-a8d7-8749e1a00087" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:49:40 user nova-compute[75745]: DEBUG nova.network.neutron [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:49:40 user nova-compute[75745]: DEBUG nova.network.neutron [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Updating instance_info_cache with network_info: [{"id": "d99d66eb-0c4d-494a-86c8-3b694c4cb6d5", "address": "fa:16:3e:c1:00:0f", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99d66eb-0c", "ovs_interfaceid": "d99d66eb-0c4d-494a-86c8-3b694c4cb6d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:49:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Releasing lock "refresh_cache-6e046ac0-e912-4831-a8d7-8749e1a00087" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:49:40 user nova-compute[75745]: DEBUG nova.compute.manager [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Instance network_info: |[{"id": "d99d66eb-0c4d-494a-86c8-3b694c4cb6d5", "address": "fa:16:3e:c1:00:0f", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99d66eb-0c", "ovs_interfaceid": "d99d66eb-0c4d-494a-86c8-3b694c4cb6d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:49:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-84afec49-ce2a-46ac-bc5a-b711f1d34a21 req-dc331e28-65d6-4831-afbf-3fbf98f707b1 service nova] Acquired lock "refresh_cache-6e046ac0-e912-4831-a8d7-8749e1a00087" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:49:40 user nova-compute[75745]: DEBUG nova.network.neutron [req-84afec49-ce2a-46ac-bc5a-b711f1d34a21 req-dc331e28-65d6-4831-afbf-3fbf98f707b1 service nova] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Refreshing network info cache for port d99d66eb-0c4d-494a-86c8-3b694c4cb6d5 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:49:40 user nova-compute[75745]: DEBUG nova.network.neutron [req-84afec49-ce2a-46ac-bc5a-b711f1d34a21 req-dc331e28-65d6-4831-afbf-3fbf98f707b1 service nova] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Updated VIF entry in instance network info cache for port d99d66eb-0c4d-494a-86c8-3b694c4cb6d5. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:49:40 user nova-compute[75745]: DEBUG nova.network.neutron [req-84afec49-ce2a-46ac-bc5a-b711f1d34a21 req-dc331e28-65d6-4831-afbf-3fbf98f707b1 service nova] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Updating instance_info_cache with network_info: [{"id": "d99d66eb-0c4d-494a-86c8-3b694c4cb6d5", "address": "fa:16:3e:c1:00:0f", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99d66eb-0c", "ovs_interfaceid": "d99d66eb-0c4d-494a-86c8-3b694c4cb6d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:49:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-84afec49-ce2a-46ac-bc5a-b711f1d34a21 req-dc331e28-65d6-4831-afbf-3fbf98f707b1 service nova] Releasing lock "refresh_cache-6e046ac0-e912-4831-a8d7-8749e1a00087" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:49:44 user nova-compute[75745]: DEBUG os_brick.utils [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:49:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:49:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:49:44 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb418e6-0c13-4921-afd6-f8c7a2b012c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:49:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:49:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:49:44 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbe1057-442f-4690-96b2-e15b3da17b85]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:49:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:49:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:49:44 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba8b360-96d1-4341-bdd1-8ad1e45b6f26]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:49:44 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe18d46-d255-4b3f-86bc-fc35c5671e72]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:49:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:49:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:49:44 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:49:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:49:44 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:49:44 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:49:44 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2864e90b-d1fa-4a85-a8c7-8a69a5eec8d5]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:49:44 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:49:44 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:49:44 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:49:44 user nova-compute[75745]: DEBUG os_brick.utils [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:49:44 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Updating existing volume attachment record: b971b771-49e4-4992-b99d-2a2b4d200331 {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:49:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:49:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:49:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG nova.compute.manager [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:49:53 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Creating image(s)
Dec 01 17:49:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Did not create local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Ensure instance console log exists: /opt/stack/data/nova/instances/6e046ac0-e912-4831-a8d7-8749e1a00087/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Start _get_guest_xml network_info=[{"id": "d99d66eb-0c4d-494a-86c8-3b694c4cb6d5", "address": "fa:16:3e:c1:00:0f", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99d66eb-0c", "ovs_interfaceid": "d99d66eb-0c4d-494a-86c8-3b694c4cb6d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-12-01T17:49:31Z,direct_url=<?>,disk_format='qcow2',id=d4df7e2d-cad9-4339-a0bd-897146b69b68,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-239603842',owner='e92d35468e65461d8ac34cb6c1d19b68',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-12-01T17:49:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': 'b971b771-49e4-4992-b99d-2a2b4d200331', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'digsEkJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6e046ac0-e912-4831-a8d7-8749e1a00087', 'attached_at': '', 'detached_at': '', 'volume_id': 'f3ceef5b-4508-44e2-852c-cf2ae1014521', 'serial': 'f3ceef5b-4508-44e2-852c-cf2ae1014521'}, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:49:53 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:49:53 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:49:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-12-01T17:49:31Z,direct_url=<?>,disk_format='qcow2',id=d4df7e2d-cad9-4339-a0bd-897146b69b68,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-239603842',owner='e92d35468e65461d8ac34cb6c1d19b68',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-12-01T17:49:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'digsEkJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:49:53 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:49:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:49:53 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:49:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:49:53 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:49:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8ef544-9b09-41b8-bd98-c7c94d332b29]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:49:53 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfa81b4-2ea6-4ab3-b59d-60bcbe0713ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521] added
Dec 01 17:49:53 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e26dc49-a4d3-4ed2-bff8-2b05912959f4]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[90975d75-c28f-4e14-b405-9ad8add0975c]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v digsEkJb {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v digsEkJb" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[103b4059-9688-438b-ab72-fcd209ff850b]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'digsEkJb'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[786468c2-5d66-4e41-965b-fad781aa5342]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b4a7c7-3604-468a-999e-5afa7ebbe9bb]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 (non-flash)
Dec 01 17:49:53 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 (non-flash)
Dec 01 17:49:53 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d018bfa-7faf-40a1-8c45-f3efa9102568]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521, portal: 172.16.0.220,3260]
Dec 01 17:49:53 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521, portal: 172.16.0.220,3260] successful.
Dec 01 17:49:53 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c286bcc4-4c06-494d-9f33-a024b1ec2dad]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e229364-ea13-474a-951a-060ab4924535]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 (non-flash)
Dec 01 17:49:53 user nova-compute[75745]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521 (non-flash)
Dec 01 17:49:53 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 (non-flash)
Dec 01 17:49:53 user nova-compute[75745]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521 (non-flash)
Dec 01 17:49:53 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fa3d75-7b78-4334-96b0-79559b102069]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:49:53 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'digsEkJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:49:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:49:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:49:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:49:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:49:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:49:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:49:54 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:49:54 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23336333732623165', 'path': '/dev/sdc'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:49:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336333732623165', 'path': '/dev/sdc'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:49:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:49:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1650834994',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1650834994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1650834994',id=49,image_ref='d4df7e2d-cad9-4339-a0bd-897146b69b68',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDoZOw6YyEQm8B0X3ZA7iOvwm75SHRorxPTB/r5U4poOku+Gx+dOcBsfS9HdfrXiasVzwV5OAuCroXrKSU4xu0ZNDQm6iGo0PI77vYywd7nrgQky9a5cAm/ymiw83rgJUg==',key_name='tempest-keypair-1917351613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e92d35468e65461d8ac34cb6c1d19b68',ramdisk_id='',reservation_id='r-bvtaeepn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1187866378',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1187866378-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1187866378',owner_user_name='tempest-TestVolumeBootPattern-1187866378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:49:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d79b4d42093f4a12aae4fb90bbbcba39',uuid=6e046ac0-e912-4831-a8d7-8749e1a00087,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d99d66eb-0c4d-494a-86c8-3b694c4cb6d5", "address": "fa:16:3e:c1:00:0f", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99d66eb-0c", "ovs_interfaceid": "d99d66eb-0c4d-494a-86c8-3b694c4cb6d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:49:54 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Converting VIF {"id": "d99d66eb-0c4d-494a-86c8-3b694c4cb6d5", "address": "fa:16:3e:c1:00:0f", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99d66eb-0c", "ovs_interfaceid": "d99d66eb-0c4d-494a-86c8-3b694c4cb6d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:49:54 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:00:0f,bridge_name='br-int',has_traffic_filtering=True,id=d99d66eb-0c4d-494a-86c8-3b694c4cb6d5,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99d66eb-0c') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:49:54 user nova-compute[75745]: DEBUG nova.objects.instance [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e046ac0-e912-4831-a8d7-8749e1a00087 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:49:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:49:54 user nova-compute[75745]:   <uuid>6e046ac0-e912-4831-a8d7-8749e1a00087</uuid>
Dec 01 17:49:54 user nova-compute[75745]:   <name>instance-00000031</name>
Dec 01 17:49:54 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:49:54 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:49:54 user nova-compute[75745]:   <metadata>
Dec 01 17:49:54 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:49:54 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:49:54 user nova-compute[75745]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1650834994</nova:name>
Dec 01 17:49:54 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:49:53</nova:creationTime>
Dec 01 17:49:54 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:49:54 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:49:54 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:49:54 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:49:54 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:49:54 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:49:54 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:49:54 user nova-compute[75745]:       <nova:owner>
Dec 01 17:49:54 user nova-compute[75745]:         <nova:user uuid="d79b4d42093f4a12aae4fb90bbbcba39">tempest-TestVolumeBootPattern-1187866378-project-member</nova:user>
Dec 01 17:49:54 user nova-compute[75745]:         <nova:project uuid="e92d35468e65461d8ac34cb6c1d19b68">tempest-TestVolumeBootPattern-1187866378</nova:project>
Dec 01 17:49:54 user nova-compute[75745]:       </nova:owner>
Dec 01 17:49:54 user nova-compute[75745]:       <nova:root type="image" uuid="d4df7e2d-cad9-4339-a0bd-897146b69b68"/>
Dec 01 17:49:54 user nova-compute[75745]:       <nova:ports>
Dec 01 17:49:54 user nova-compute[75745]:         <nova:port uuid="d99d66eb-0c4d-494a-86c8-3b694c4cb6d5">
Dec 01 17:49:54 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 01 17:49:54 user nova-compute[75745]:         </nova:port>
Dec 01 17:49:54 user nova-compute[75745]:       </nova:ports>
Dec 01 17:49:54 user nova-compute[75745]:     </nova:instance>
Dec 01 17:49:54 user nova-compute[75745]:   </metadata>
Dec 01 17:49:54 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:49:54 user nova-compute[75745]:     <system>
Dec 01 17:49:54 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:49:54 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:49:54 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:49:54 user nova-compute[75745]:       <entry name="serial">6e046ac0-e912-4831-a8d7-8749e1a00087</entry>
Dec 01 17:49:54 user nova-compute[75745]:       <entry name="uuid">6e046ac0-e912-4831-a8d7-8749e1a00087</entry>
Dec 01 17:49:54 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:49:54 user nova-compute[75745]:     </system>
Dec 01 17:49:54 user nova-compute[75745]:   </sysinfo>
Dec 01 17:49:54 user nova-compute[75745]:   <os>
Dec 01 17:49:54 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:49:54 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:49:54 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:49:54 user nova-compute[75745]:   </os>
Dec 01 17:49:54 user nova-compute[75745]:   <features>
Dec 01 17:49:54 user nova-compute[75745]:     <acpi/>
Dec 01 17:49:54 user nova-compute[75745]:     <apic/>
Dec 01 17:49:54 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:49:54 user nova-compute[75745]:   </features>
Dec 01 17:49:54 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:49:54 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:49:54 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:49:54 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:49:54 user nova-compute[75745]:   </clock>
Dec 01 17:49:54 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:49:54 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:49:54 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:49:54 user nova-compute[75745]:   </cpu>
Dec 01 17:49:54 user nova-compute[75745]:   <devices>
Dec 01 17:49:54 user nova-compute[75745]:     <disk type="block" device="disk">
Dec 01 17:49:54 user nova-compute[75745]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:49:54 user nova-compute[75745]:       <source dev="/dev/sdc"/>
Dec 01 17:49:54 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:49:54 user nova-compute[75745]:       <serial>f3ceef5b-4508-44e2-852c-cf2ae1014521</serial>
Dec 01 17:49:54 user nova-compute[75745]:     </disk>
Dec 01 17:49:54 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:49:54 user nova-compute[75745]:       <mac address="fa:16:3e:c1:00:0f"/>
Dec 01 17:49:54 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:49:54 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:49:54 user nova-compute[75745]:       <target dev="tapd99d66eb-0c"/>
Dec 01 17:49:54 user nova-compute[75745]:     </interface>
Dec 01 17:49:54 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:49:54 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/6e046ac0-e912-4831-a8d7-8749e1a00087/console.log" append="off"/>
Dec 01 17:49:54 user nova-compute[75745]:     </serial>
Dec 01 17:49:54 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:49:54 user nova-compute[75745]:     <video>
Dec 01 17:49:54 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:49:54 user nova-compute[75745]:     </video>
Dec 01 17:49:54 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:49:54 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:49:54 user nova-compute[75745]:     </rng>
Dec 01 17:49:54 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:49:54 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:49:54 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:49:54 user nova-compute[75745]:     </memballoon>
Dec 01 17:49:54 user nova-compute[75745]:   </devices>
Dec 01 17:49:54 user nova-compute[75745]: </domain>
Dec 01 17:49:54 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:49:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:49:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1650834994',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1650834994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1650834994',id=49,image_ref='d4df7e2d-cad9-4339-a0bd-897146b69b68',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDoZOw6YyEQm8B0X3ZA7iOvwm75SHRorxPTB/r5U4poOku+Gx+dOcBsfS9HdfrXiasVzwV5OAuCroXrKSU4xu0ZNDQm6iGo0PI77vYywd7nrgQky9a5cAm/ymiw83rgJUg==',key_name='tempest-keypair-1917351613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e92d35468e65461d8ac34cb6c1d19b68',ramdisk_id='',reservation_id='r-bvtaeepn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1187866378',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1187866378-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1187866378',owner_user_name='tempest-TestVolumeBootPattern-1187866378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:49:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d79b4d42093f4a12aae4fb90bbbcba39',uuid=6e046ac0-e912-4831-a8d7-8749e1a00087,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d99d66eb-0c4d-494a-86c8-3b694c4cb6d5", "address": "fa:16:3e:c1:00:0f", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99d66eb-0c", "ovs_interfaceid": "d99d66eb-0c4d-494a-86c8-3b694c4cb6d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:49:54 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Converting VIF {"id": "d99d66eb-0c4d-494a-86c8-3b694c4cb6d5", "address": "fa:16:3e:c1:00:0f", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99d66eb-0c", "ovs_interfaceid": "d99d66eb-0c4d-494a-86c8-3b694c4cb6d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:49:54 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:00:0f,bridge_name='br-int',has_traffic_filtering=True,id=d99d66eb-0c4d-494a-86c8-3b694c4cb6d5,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99d66eb-0c') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:49:54 user nova-compute[75745]: DEBUG os_vif [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:00:0f,bridge_name='br-int',has_traffic_filtering=True,id=d99d66eb-0c4d-494a-86c8-3b694c4cb6d5,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99d66eb-0c') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:49:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:49:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:49:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:49:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:49:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec6a425a-c9de-52fb-aa7f-20ed1a401986', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:49:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:49:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:49:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:49:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd99d66eb-0c, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:49:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd99d66eb-0c, col_values=(('qos', UUID('f2a6bd1c-32bc-4a8f-941d-1ce1b8ec23a3')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:49:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd99d66eb-0c, col_values=(('external_ids', {'iface-id': 'd99d66eb-0c4d-494a-86c8-3b694c4cb6d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:00:0f', 'vm-uuid': '6e046ac0-e912-4831-a8d7-8749e1a00087'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:49:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:49:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:49:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:49:54 user nova-compute[75745]: INFO os_vif [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:00:0f,bridge_name='br-int',has_traffic_filtering=True,id=d99d66eb-0c4d-494a-86c8-3b694c4cb6d5,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99d66eb-0c')
Dec 01 17:49:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:49:54 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] No VIF found with MAC fa:16:3e:c1:00:0f, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:49:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:49:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:49:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:49:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-c9a48fd3-3819-4948-9649-3dcb0572fcbd req-0ed7a0f3-5874-43cc-ae85-4732645797cb service nova] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Received event network-vif-plugged-d99d66eb-0c4d-494a-86c8-3b694c4cb6d5 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:49:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c9a48fd3-3819-4948-9649-3dcb0572fcbd req-0ed7a0f3-5874-43cc-ae85-4732645797cb service nova] Acquiring lock "6e046ac0-e912-4831-a8d7-8749e1a00087-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:49:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c9a48fd3-3819-4948-9649-3dcb0572fcbd req-0ed7a0f3-5874-43cc-ae85-4732645797cb service nova] Lock "6e046ac0-e912-4831-a8d7-8749e1a00087-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:49:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-c9a48fd3-3819-4948-9649-3dcb0572fcbd req-0ed7a0f3-5874-43cc-ae85-4732645797cb service nova] Lock "6e046ac0-e912-4831-a8d7-8749e1a00087-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:49:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-c9a48fd3-3819-4948-9649-3dcb0572fcbd req-0ed7a0f3-5874-43cc-ae85-4732645797cb service nova] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] No waiting events found dispatching network-vif-plugged-d99d66eb-0c4d-494a-86c8-3b694c4cb6d5 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:49:56 user nova-compute[75745]: WARNING nova.compute.manager [req-c9a48fd3-3819-4948-9649-3dcb0572fcbd req-0ed7a0f3-5874-43cc-ae85-4732645797cb service nova] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Received unexpected event network-vif-plugged-d99d66eb-0c4d-494a-86c8-3b694c4cb6d5 for instance with vm_state building and task_state spawning.
Dec 01 17:49:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:49:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:49:57 user nova-compute[75745]: DEBUG nova.compute.manager [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:49:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:49:57 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Instance spawned successfully.
Dec 01 17:49:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:49:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:49:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:49:58 user nova-compute[75745]: INFO nova.compute.manager [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Took 4.81 seconds to spawn the instance on the hypervisor.
Dec 01 17:49:58 user nova-compute[75745]: DEBUG nova.compute.manager [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:49:58 user nova-compute[75745]: INFO nova.compute.manager [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Took 19.88 seconds to build instance.
Dec 01 17:49:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-d37500e4-da60-4e30-b846-49d1c16ea1e8 req-1968c52a-7e03-497a-90b6-3fc1771614f2 service nova] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Received event network-vif-plugged-d99d66eb-0c4d-494a-86c8-3b694c4cb6d5 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:49:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d37500e4-da60-4e30-b846-49d1c16ea1e8 req-1968c52a-7e03-497a-90b6-3fc1771614f2 service nova] Acquiring lock "6e046ac0-e912-4831-a8d7-8749e1a00087-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:49:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d37500e4-da60-4e30-b846-49d1c16ea1e8 req-1968c52a-7e03-497a-90b6-3fc1771614f2 service nova] Lock "6e046ac0-e912-4831-a8d7-8749e1a00087-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:49:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d37500e4-da60-4e30-b846-49d1c16ea1e8 req-1968c52a-7e03-497a-90b6-3fc1771614f2 service nova] Lock "6e046ac0-e912-4831-a8d7-8749e1a00087-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:49:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-d37500e4-da60-4e30-b846-49d1c16ea1e8 req-1968c52a-7e03-497a-90b6-3fc1771614f2 service nova] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] No waiting events found dispatching network-vif-plugged-d99d66eb-0c4d-494a-86c8-3b694c4cb6d5 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:49:58 user nova-compute[75745]: WARNING nova.compute.manager [req-d37500e4-da60-4e30-b846-49d1c16ea1e8 req-1968c52a-7e03-497a-90b6-3fc1771614f2 service nova] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Received unexpected event network-vif-plugged-d99d66eb-0c4d-494a-86c8-3b694c4cb6d5 for instance with vm_state active and task_state None.
Dec 01 17:49:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-81ce6df7-eb67-4c86-b7e9-16534ce324e1 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "6e046ac0-e912-4831-a8d7-8749e1a00087" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.974s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:49:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:50:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:50:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:50:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:50:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:50:06 user nova-compute[75745]: INFO nova.compute.manager [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Unshelving
Dec 01 17:50:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:50:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:50:06 user nova-compute[75745]: DEBUG nova.objects.instance [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lazy-loading 'pci_requests' on Instance uuid f1dc83ed-2b0e-4da0-9347-9c84ec56178e {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:50:06 user nova-compute[75745]: DEBUG nova.objects.instance [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lazy-loading 'numa_topology' on Instance uuid f1dc83ed-2b0e-4da0-9347-9c84ec56178e {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:50:06 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:50:06 user nova-compute[75745]: INFO nova.compute.claims [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Claim successful on node user
Dec 01 17:50:06 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:50:06 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:50:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.277s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:50:06 user nova-compute[75745]: INFO nova.network.neutron [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Updating port 66c9992f-e23d-4c4c-bac0-302c3cbf23b3 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Dec 01 17:50:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "refresh_cache-f1dc83ed-2b0e-4da0-9347-9c84ec56178e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:50:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquired lock "refresh_cache-f1dc83ed-2b0e-4da0-9347-9c84ec56178e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:50:07 user nova-compute[75745]: DEBUG nova.network.neutron [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:50:07 user nova-compute[75745]: DEBUG nova.compute.manager [req-b10261a9-781b-4ccb-89d3-2e1b0ca2c520 req-40682c39-05bd-46a6-8b4e-f0206a7f8611 service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Received event network-changed-66c9992f-e23d-4c4c-bac0-302c3cbf23b3 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:50:07 user nova-compute[75745]: DEBUG nova.compute.manager [req-b10261a9-781b-4ccb-89d3-2e1b0ca2c520 req-40682c39-05bd-46a6-8b4e-f0206a7f8611 service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Refreshing instance network info cache due to event network-changed-66c9992f-e23d-4c4c-bac0-302c3cbf23b3. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:50:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b10261a9-781b-4ccb-89d3-2e1b0ca2c520 req-40682c39-05bd-46a6-8b4e-f0206a7f8611 service nova] Acquiring lock "refresh_cache-f1dc83ed-2b0e-4da0-9347-9c84ec56178e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:50:07 user nova-compute[75745]: DEBUG nova.network.neutron [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Updating instance_info_cache with network_info: [{"id": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "address": "fa:16:3e:c0:4f:9a", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c9992f-e2", "ovs_interfaceid": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:50:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Releasing lock "refresh_cache-f1dc83ed-2b0e-4da0-9347-9c84ec56178e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:50:07 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:50:07 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Creating image(s)
Dec 01 17:50:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:50:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "/opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:50:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "/opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:50:07 user nova-compute[75745]: DEBUG nova.objects.instance [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lazy-loading 'trusted_certs' on Instance uuid f1dc83ed-2b0e-4da0-9347-9c84ec56178e {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:50:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b10261a9-781b-4ccb-89d3-2e1b0ca2c520 req-40682c39-05bd-46a6-8b4e-f0206a7f8611 service nova] Acquired lock "refresh_cache-f1dc83ed-2b0e-4da0-9347-9c84ec56178e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:50:07 user nova-compute[75745]: DEBUG nova.network.neutron [req-b10261a9-781b-4ccb-89d3-2e1b0ca2c520 req-40682c39-05bd-46a6-8b4e-f0206a7f8611 service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Refreshing network info cache for port 66c9992f-e23d-4c4c-bac0-302c3cbf23b3 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:50:07 user nova-compute[75745]: DEBUG nova.objects.base [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Object Instance<f1dc83ed-2b0e-4da0-9347-9c84ec56178e> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:50:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "036b6d23300465f714b381469da4c2bf32dc2cda" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:50:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "036b6d23300465f714b381469da4c2bf32dc2cda" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:50:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/036b6d23300465f714b381469da4c2bf32dc2cda.part --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:50:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/036b6d23300465f714b381469da4c2bf32dc2cda.part --force-share --output=json" returned: 0 in 0.180s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:50:09 user nova-compute[75745]: DEBUG nova.virt.images [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] bb5af60b-fb4a-4de3-a9fc-53a28ca7e08b was qcow2, converting to raw {{(pid=75745) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 01 17:50:09 user nova-compute[75745]: DEBUG nova.privsep.utils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75745) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 17:50:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/036b6d23300465f714b381469da4c2bf32dc2cda.part /opt/stack/data/nova/instances/_base/036b6d23300465f714b381469da4c2bf32dc2cda.converted {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:50:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/036b6d23300465f714b381469da4c2bf32dc2cda.part /opt/stack/data/nova/instances/_base/036b6d23300465f714b381469da4c2bf32dc2cda.converted" returned: 0 in 0.338s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:50:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/036b6d23300465f714b381469da4c2bf32dc2cda.converted --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:50:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:50:09 user nova-compute[75745]: DEBUG nova.network.neutron [req-b10261a9-781b-4ccb-89d3-2e1b0ca2c520 req-40682c39-05bd-46a6-8b4e-f0206a7f8611 service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Updated VIF entry in instance network info cache for port 66c9992f-e23d-4c4c-bac0-302c3cbf23b3. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:50:09 user nova-compute[75745]: DEBUG nova.network.neutron [req-b10261a9-781b-4ccb-89d3-2e1b0ca2c520 req-40682c39-05bd-46a6-8b4e-f0206a7f8611 service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Updating instance_info_cache with network_info: [{"id": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "address": "fa:16:3e:c0:4f:9a", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c9992f-e2", "ovs_interfaceid": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:50:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-b10261a9-781b-4ccb-89d3-2e1b0ca2c520 req-40682c39-05bd-46a6-8b4e-f0206a7f8611 service nova] Releasing lock "refresh_cache-f1dc83ed-2b0e-4da0-9347-9c84ec56178e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:50:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/036b6d23300465f714b381469da4c2bf32dc2cda.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:50:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "036b6d23300465f714b381469da4c2bf32dc2cda" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.862s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:50:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/036b6d23300465f714b381469da4c2bf32dc2cda --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:50:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/036b6d23300465f714b381469da4c2bf32dc2cda --force-share --output=json" returned: 0 in 0.169s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:50:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "036b6d23300465f714b381469da4c2bf32dc2cda" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:50:09 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "036b6d23300465f714b381469da4c2bf32dc2cda" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:50:09 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/036b6d23300465f714b381469da4c2bf32dc2cda --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:50:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/036b6d23300465f714b381469da4c2bf32dc2cda --force-share --output=json" returned: 0 in 0.184s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:50:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/036b6d23300465f714b381469da4c2bf32dc2cda,backing_fmt=raw /opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e/disk 1073741824 {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:50:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/036b6d23300465f714b381469da4c2bf32dc2cda,backing_fmt=raw /opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e/disk 1073741824" returned: 0 in 0.049s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:50:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "036b6d23300465f714b381469da4c2bf32dc2cda" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:50:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/036b6d23300465f714b381469da4c2bf32dc2cda --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:50:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/036b6d23300465f714b381469da4c2bf32dc2cda --force-share --output=json" returned: 0 in 0.171s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:50:10 user nova-compute[75745]: DEBUG nova.objects.instance [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lazy-loading 'migration_context' on Instance uuid f1dc83ed-2b0e-4da0-9347-9c84ec56178e {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:50:10 user nova-compute[75745]: DEBUG nova.objects.base [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Object Instance<f1dc83ed-2b0e-4da0-9347-9c84ec56178e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:50:10 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Rebasing disk image.
Dec 01 17:50:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:50:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf --force-share --output=json" returned: 0 in 0.175s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:50:10 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf -F raw /opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e/disk {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/c8853abafd3b960abf164c2d738731e067f690bf -F raw /opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e/disk" returned: 0 in 1.888s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Created local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Ensure instance console log exists: /opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Start _get_guest_xml network_info=[{"id": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "address": "fa:16:3e:c0:4f:9a", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c9992f-e2", "ovs_interfaceid": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='bfb8d826002bef28dc267b158d0c23e1',container_format='bare',created_at=2023-12-01T17:48:14Z,direct_url=<?>,disk_format='qcow2',id=bb5af60b-fb4a-4de3-a9fc-53a28ca7e08b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1367548217-shelved',owner='2b1e7099305f4571804612f3a3d8befb',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-12-01T17:48:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'size': 0, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'image_id': '695c84b8-d08d-488d-9841-cc1da92fb985'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:50:12 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:50:12 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:50:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='bfb8d826002bef28dc267b158d0c23e1',container_format='bare',created_at=2023-12-01T17:48:14Z,direct_url=<?>,disk_format='qcow2',id=bb5af60b-fb4a-4de3-a9fc-53a28ca7e08b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1367548217-shelved',owner='2b1e7099305f4571804612f3a3d8befb',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-12-01T17:48:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG nova.objects.instance [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lazy-loading 'vcpu_model' on Instance uuid f1dc83ed-2b0e-4da0-9347-9c84ec56178e {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG nova.objects.base [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Object Instance<f1dc83ed-2b0e-4da0-9347-9c84ec56178e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T17:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1367548217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1367548217',id=47,image_ref='bb5af60b-fb4a-4de3-a9fc-53a28ca7e08b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1089424176',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:46:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2b1e7099305f4571804612f3a3d8befb',ramdisk_id='',reservation_id='r-s927zouf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1555393357',owner_user_name='tempest-AttachVolumeShelveTestJSON-1555393357-project-member',shelved_at='2023-12-01T17:48:18.317201',shelved_host='user',shelved_image_id='bb5af60b-fb4a-4de3-a9fc-53a28ca7e08b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:50:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f78365cc1e11444db345efc5fe3cc502',uuid=f1dc83ed-2b0e-4da0-9347-9c84ec56178e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "address": "fa:16:3e:c0:4f:9a", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c9992f-e2", "ovs_interfaceid": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Converting VIF {"id": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "address": "fa:16:3e:c0:4f:9a", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c9992f-e2", "ovs_interfaceid": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:4f:9a,bridge_name='br-int',has_traffic_filtering=True,id=66c9992f-e23d-4c4c-bac0-302c3cbf23b3,network=Network(773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66c9992f-e2') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG nova.objects.instance [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lazy-loading 'pci_devices' on Instance uuid f1dc83ed-2b0e-4da0-9347-9c84ec56178e {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG nova.objects.base [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Object Instance<f1dc83ed-2b0e-4da0-9347-9c84ec56178e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75745) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:50:12 user nova-compute[75745]:   <uuid>f1dc83ed-2b0e-4da0-9347-9c84ec56178e</uuid>
Dec 01 17:50:12 user nova-compute[75745]:   <name>instance-0000002f</name>
Dec 01 17:50:12 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:50:12 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:50:12 user nova-compute[75745]:   <metadata>
Dec 01 17:50:12 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:50:12 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:50:12 user nova-compute[75745]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1367548217</nova:name>
Dec 01 17:50:12 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:50:12</nova:creationTime>
Dec 01 17:50:12 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:50:12 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:50:12 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:50:12 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:50:12 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:50:12 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:50:12 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:50:12 user nova-compute[75745]:       <nova:owner>
Dec 01 17:50:12 user nova-compute[75745]:         <nova:user uuid="f78365cc1e11444db345efc5fe3cc502">tempest-AttachVolumeShelveTestJSON-1555393357-project-member</nova:user>
Dec 01 17:50:12 user nova-compute[75745]:         <nova:project uuid="2b1e7099305f4571804612f3a3d8befb">tempest-AttachVolumeShelveTestJSON-1555393357</nova:project>
Dec 01 17:50:12 user nova-compute[75745]:       </nova:owner>
Dec 01 17:50:12 user nova-compute[75745]:       <nova:root type="image" uuid="bb5af60b-fb4a-4de3-a9fc-53a28ca7e08b"/>
Dec 01 17:50:12 user nova-compute[75745]:       <nova:ports>
Dec 01 17:50:12 user nova-compute[75745]:         <nova:port uuid="66c9992f-e23d-4c4c-bac0-302c3cbf23b3">
Dec 01 17:50:12 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 01 17:50:12 user nova-compute[75745]:         </nova:port>
Dec 01 17:50:12 user nova-compute[75745]:       </nova:ports>
Dec 01 17:50:12 user nova-compute[75745]:     </nova:instance>
Dec 01 17:50:12 user nova-compute[75745]:   </metadata>
Dec 01 17:50:12 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:50:12 user nova-compute[75745]:     <system>
Dec 01 17:50:12 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:50:12 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:50:12 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:50:12 user nova-compute[75745]:       <entry name="serial">f1dc83ed-2b0e-4da0-9347-9c84ec56178e</entry>
Dec 01 17:50:12 user nova-compute[75745]:       <entry name="uuid">f1dc83ed-2b0e-4da0-9347-9c84ec56178e</entry>
Dec 01 17:50:12 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:50:12 user nova-compute[75745]:     </system>
Dec 01 17:50:12 user nova-compute[75745]:   </sysinfo>
Dec 01 17:50:12 user nova-compute[75745]:   <os>
Dec 01 17:50:12 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:50:12 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:50:12 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:50:12 user nova-compute[75745]:   </os>
Dec 01 17:50:12 user nova-compute[75745]:   <features>
Dec 01 17:50:12 user nova-compute[75745]:     <acpi/>
Dec 01 17:50:12 user nova-compute[75745]:     <apic/>
Dec 01 17:50:12 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:50:12 user nova-compute[75745]:   </features>
Dec 01 17:50:12 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:50:12 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:50:12 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:50:12 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:50:12 user nova-compute[75745]:   </clock>
Dec 01 17:50:12 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:50:12 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:50:12 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:50:12 user nova-compute[75745]:   </cpu>
Dec 01 17:50:12 user nova-compute[75745]:   <devices>
Dec 01 17:50:12 user nova-compute[75745]:     <disk type="file" device="disk">
Dec 01 17:50:12 user nova-compute[75745]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 17:50:12 user nova-compute[75745]:       <source file="/opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e/disk"/>
Dec 01 17:50:12 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:50:12 user nova-compute[75745]:     </disk>
Dec 01 17:50:12 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:50:12 user nova-compute[75745]:       <mac address="fa:16:3e:c0:4f:9a"/>
Dec 01 17:50:12 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:50:12 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:50:12 user nova-compute[75745]:       <target dev="tap66c9992f-e2"/>
Dec 01 17:50:12 user nova-compute[75745]:     </interface>
Dec 01 17:50:12 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:50:12 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e/console.log" append="off"/>
Dec 01 17:50:12 user nova-compute[75745]:     </serial>
Dec 01 17:50:12 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:50:12 user nova-compute[75745]:     <video>
Dec 01 17:50:12 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:50:12 user nova-compute[75745]:     </video>
Dec 01 17:50:12 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:50:12 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:50:12 user nova-compute[75745]:     </rng>
Dec 01 17:50:12 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:50:12 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:50:12 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:50:12 user nova-compute[75745]:     </memballoon>
Dec 01 17:50:12 user nova-compute[75745]:   </devices>
Dec 01 17:50:12 user nova-compute[75745]: </domain>
Dec 01 17:50:12 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T17:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1367548217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1367548217',id=47,image_ref='bb5af60b-fb4a-4de3-a9fc-53a28ca7e08b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1089424176',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:46:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2b1e7099305f4571804612f3a3d8befb',ramdisk_id='',reservation_id='r-s927zouf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1555393357',owner_user_name='tempest-AttachVolumeShelveTestJSON-1555393357-project-member',shelved_at='2023-12-01T17:48:18.317201',shelved_host='user',shelved_image_id='bb5af60b-fb4a-4de3-a9fc-53a28ca7e08b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:50:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f78365cc1e11444db345efc5fe3cc502',uuid=f1dc83ed-2b0e-4da0-9347-9c84ec56178e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "address": "fa:16:3e:c0:4f:9a", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c9992f-e2", "ovs_interfaceid": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Converting VIF {"id": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "address": "fa:16:3e:c0:4f:9a", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c9992f-e2", "ovs_interfaceid": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:4f:9a,bridge_name='br-int',has_traffic_filtering=True,id=66c9992f-e23d-4c4c-bac0-302c3cbf23b3,network=Network(773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66c9992f-e2') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG os_vif [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:4f:9a,bridge_name='br-int',has_traffic_filtering=True,id=66c9992f-e23d-4c4c-bac0-302c3cbf23b3,network=Network(773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66c9992f-e2') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5ccb27a7-f92b-5957-a8db-301bf8a26bae', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66c9992f-e2, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap66c9992f-e2, col_values=(('qos', UUID('90cf754d-8a3f-4195-ad21-6b4edcb39da4')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap66c9992f-e2, col_values=(('external_ids', {'iface-id': '66c9992f-e23d-4c4c-bac0-302c3cbf23b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:4f:9a', 'vm-uuid': 'f1dc83ed-2b0e-4da0-9347-9c84ec56178e'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:50:12 user nova-compute[75745]: INFO os_vif [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:4f:9a,bridge_name='br-int',has_traffic_filtering=True,id=66c9992f-e23d-4c4c-bac0-302c3cbf23b3,network=Network(773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66c9992f-e2')
Dec 01 17:50:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:50:12 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] No VIF found with MAC fa:16:3e:c0:4f:9a, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:50:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:50:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:50:13 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:50:14 user nova-compute[75745]: DEBUG nova.compute.manager [req-1e58b960-e190-4710-b75b-534c5f22b9bd req-535eef11-2f3c-42b7-8f65-e02a24cde33f service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Received event network-vif-plugged-66c9992f-e23d-4c4c-bac0-302c3cbf23b3 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:50:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1e58b960-e190-4710-b75b-534c5f22b9bd req-535eef11-2f3c-42b7-8f65-e02a24cde33f service nova] Acquiring lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:50:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1e58b960-e190-4710-b75b-534c5f22b9bd req-535eef11-2f3c-42b7-8f65-e02a24cde33f service nova] Lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:50:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-1e58b960-e190-4710-b75b-534c5f22b9bd req-535eef11-2f3c-42b7-8f65-e02a24cde33f service nova] Lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:50:14 user nova-compute[75745]: DEBUG nova.compute.manager [req-1e58b960-e190-4710-b75b-534c5f22b9bd req-535eef11-2f3c-42b7-8f65-e02a24cde33f service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] No waiting events found dispatching network-vif-plugged-66c9992f-e23d-4c4c-bac0-302c3cbf23b3 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:50:14 user nova-compute[75745]: WARNING nova.compute.manager [req-1e58b960-e190-4710-b75b-534c5f22b9bd req-535eef11-2f3c-42b7-8f65-e02a24cde33f service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Received unexpected event network-vif-plugged-66c9992f-e23d-4c4c-bac0-302c3cbf23b3 for instance with vm_state shelved_offloaded and task_state spawning.
Dec 01 17:50:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:50:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:50:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:50:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:50:14 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:50:14 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:50:14 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:50:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:50:15 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:50:15 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:50:15 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:50:16 user nova-compute[75745]: DEBUG nova.compute.manager [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:50:16 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:50:16 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Instance spawned successfully.
Dec 01 17:50:16 user nova-compute[75745]: DEBUG nova.compute.manager [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:50:16 user nova-compute[75745]: DEBUG nova.compute.manager [req-85ede7d8-0a6c-49b9-a9ca-0e2186ee0b6e req-f2434d19-b15d-4240-a26b-dc50eea2117f service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Received event network-vif-plugged-66c9992f-e23d-4c4c-bac0-302c3cbf23b3 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:50:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-85ede7d8-0a6c-49b9-a9ca-0e2186ee0b6e req-f2434d19-b15d-4240-a26b-dc50eea2117f service nova] Acquiring lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:50:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-85ede7d8-0a6c-49b9-a9ca-0e2186ee0b6e req-f2434d19-b15d-4240-a26b-dc50eea2117f service nova] Lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:50:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-85ede7d8-0a6c-49b9-a9ca-0e2186ee0b6e req-f2434d19-b15d-4240-a26b-dc50eea2117f service nova] Lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:50:16 user nova-compute[75745]: DEBUG nova.compute.manager [req-85ede7d8-0a6c-49b9-a9ca-0e2186ee0b6e req-f2434d19-b15d-4240-a26b-dc50eea2117f service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] No waiting events found dispatching network-vif-plugged-66c9992f-e23d-4c4c-bac0-302c3cbf23b3 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:50:16 user nova-compute[75745]: WARNING nova.compute.manager [req-85ede7d8-0a6c-49b9-a9ca-0e2186ee0b6e req-f2434d19-b15d-4240-a26b-dc50eea2117f service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Received unexpected event network-vif-plugged-66c9992f-e23d-4c4c-bac0-302c3cbf23b3 for instance with vm_state shelved_offloaded and task_state spawning.
Dec 01 17:50:16 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-2aa48d7d-7e01-4785-9e6e-b4f3b63ea8f4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 9.989s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:50:17 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:50:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:50:20 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:50:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:50:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:50:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:50:20 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:50:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:50:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:50:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:50:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:50:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:50:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:50:21 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:50:21 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:50:21 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=8784MB free_disk=25.062915802001953GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:50:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:50:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:50:21 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance c3473bf6-5a7b-4030-b7b7-fe7540ed9b35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:50:21 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 6e046ac0-e912-4831-a8d7-8749e1a00087 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:50:21 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance f1dc83ed-2b0e-4da0-9347-9c84ec56178e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:50:21 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:50:21 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:50:21 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:50:21 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:50:21 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:50:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.254s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:50:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:50:22 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:50:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:50:26 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:50:27 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:50:29 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:50:29 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:50:29 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Rebuilding the list of instances to heal {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 17:50:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-c3473bf6-5a7b-4030-b7b7-fe7540ed9b35" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:50:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-c3473bf6-5a7b-4030-b7b7-fe7540ed9b35" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:50:29 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:50:29 user nova-compute[75745]: DEBUG nova.objects.instance [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lazy-loading 'info_cache' on Instance uuid c3473bf6-5a7b-4030-b7b7-fe7540ed9b35 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:50:30 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Updating instance_info_cache with network_info: [{"id": "8f4ec3a6-2554-41e7-8486-ace5cf717fc4", "address": "fa:16:3e:a8:d2:36", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4ec3a6-25", "ovs_interfaceid": "8f4ec3a6-2554-41e7-8486-ace5cf717fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:50:30 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-c3473bf6-5a7b-4030-b7b7-fe7540ed9b35" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:50:30 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:50:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:50:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:50:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:50:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:50:40 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:50:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:50:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:50:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:50:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:50:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:50:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:51:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:51:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:51:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:51:15 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:51:15 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:51:15 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:51:15 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:51:16 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:51:16 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:51:17 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:51:20 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:51:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:51:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:51:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:51:20 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:51:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:51:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:51:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:51:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e/disk --force-share --output=json {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:51:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:51:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:51:21 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:51:21 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:51:21 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=8756MB free_disk=25.062049865722656GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:51:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:51:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:51:21 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance c3473bf6-5a7b-4030-b7b7-fe7540ed9b35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:51:21 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 6e046ac0-e912-4831-a8d7-8749e1a00087 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:51:21 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance f1dc83ed-2b0e-4da0-9347-9c84ec56178e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:51:21 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:51:21 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:51:22 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:51:22 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:51:22 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:51:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.240s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:51:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:51:24 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:51:27 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:51:28 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:51:29 user nova-compute[75745]: DEBUG nova.compute.manager [req-6041c6ff-3f14-4841-b35a-8bbbcfb5d3e6 req-d1f21cec-624b-43cb-96b6-c42ecbef9d18 service nova] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Received event network-changed-d99d66eb-0c4d-494a-86c8-3b694c4cb6d5 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:51:29 user nova-compute[75745]: DEBUG nova.compute.manager [req-6041c6ff-3f14-4841-b35a-8bbbcfb5d3e6 req-d1f21cec-624b-43cb-96b6-c42ecbef9d18 service nova] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Refreshing instance network info cache due to event network-changed-d99d66eb-0c4d-494a-86c8-3b694c4cb6d5. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:51:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6041c6ff-3f14-4841-b35a-8bbbcfb5d3e6 req-d1f21cec-624b-43cb-96b6-c42ecbef9d18 service nova] Acquiring lock "refresh_cache-6e046ac0-e912-4831-a8d7-8749e1a00087" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:51:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6041c6ff-3f14-4841-b35a-8bbbcfb5d3e6 req-d1f21cec-624b-43cb-96b6-c42ecbef9d18 service nova] Acquired lock "refresh_cache-6e046ac0-e912-4831-a8d7-8749e1a00087" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:51:29 user nova-compute[75745]: DEBUG nova.network.neutron [req-6041c6ff-3f14-4841-b35a-8bbbcfb5d3e6 req-d1f21cec-624b-43cb-96b6-c42ecbef9d18 service nova] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Refreshing network info cache for port d99d66eb-0c4d-494a-86c8-3b694c4cb6d5 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:51:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "6e046ac0-e912-4831-a8d7-8749e1a00087" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:51:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "6e046ac0-e912-4831-a8d7-8749e1a00087" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:51:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "6e046ac0-e912-4831-a8d7-8749e1a00087-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:51:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "6e046ac0-e912-4831-a8d7-8749e1a00087-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:51:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "6e046ac0-e912-4831-a8d7-8749e1a00087-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:51:29 user nova-compute[75745]: INFO nova.compute.manager [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Terminating instance
Dec 01 17:51:29 user nova-compute[75745]: DEBUG nova.compute.manager [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:51:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:51:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:51:29 user nova-compute[75745]: DEBUG nova.network.neutron [req-6041c6ff-3f14-4841-b35a-8bbbcfb5d3e6 req-d1f21cec-624b-43cb-96b6-c42ecbef9d18 service nova] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Updated VIF entry in instance network info cache for port d99d66eb-0c4d-494a-86c8-3b694c4cb6d5. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:51:29 user nova-compute[75745]: DEBUG nova.network.neutron [req-6041c6ff-3f14-4841-b35a-8bbbcfb5d3e6 req-d1f21cec-624b-43cb-96b6-c42ecbef9d18 service nova] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Updating instance_info_cache with network_info: [{"id": "d99d66eb-0c4d-494a-86c8-3b694c4cb6d5", "address": "fa:16:3e:c1:00:0f", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99d66eb-0c", "ovs_interfaceid": "d99d66eb-0c4d-494a-86c8-3b694c4cb6d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:51:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-6041c6ff-3f14-4841-b35a-8bbbcfb5d3e6 req-d1f21cec-624b-43cb-96b6-c42ecbef9d18 service nova] Releasing lock "refresh_cache-6e046ac0-e912-4831-a8d7-8749e1a00087" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:51:29 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:51:29 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:51:29 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Skipping network cache update for instance because it is being deleted. {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Dec 01 17:51:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-f1dc83ed-2b0e-4da0-9347-9c84ec56178e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:51:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-f1dc83ed-2b0e-4da0-9347-9c84ec56178e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:51:29 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:51:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:51:30 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Instance destroyed successfully.
Dec 01 17:51:30 user nova-compute[75745]: DEBUG nova.objects.instance [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lazy-loading 'resources' on Instance uuid 6e046ac0-e912-4831-a8d7-8749e1a00087 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:49:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1650834994',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1650834994',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1650834994',id=49,image_ref='d4df7e2d-cad9-4339-a0bd-897146b69b68',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDoZOw6YyEQm8B0X3ZA7iOvwm75SHRorxPTB/r5U4poOku+Gx+dOcBsfS9HdfrXiasVzwV5OAuCroXrKSU4xu0ZNDQm6iGo0PI77vYywd7nrgQky9a5cAm/ymiw83rgJUg==',key_name='tempest-keypair-1917351613',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:49:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e92d35468e65461d8ac34cb6c1d19b68',ramdisk_id='',reservation_id='r-bvtaeepn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1187866378',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1187866378-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1187866378',owner_user_name='tempest-TestVolumeBootPattern-1187866378-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:49:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d79b4d42093f4a12aae4fb90bbbcba39',uuid=6e046ac0-e912-4831-a8d7-8749e1a00087,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d99d66eb-0c4d-494a-86c8-3b694c4cb6d5", "address": "fa:16:3e:c1:00:0f", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99d66eb-0c", "ovs_interfaceid": "d99d66eb-0c4d-494a-86c8-3b694c4cb6d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Converting VIF {"id": "d99d66eb-0c4d-494a-86c8-3b694c4cb6d5", "address": "fa:16:3e:c1:00:0f", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd99d66eb-0c", "ovs_interfaceid": "d99d66eb-0c4d-494a-86c8-3b694c4cb6d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:00:0f,bridge_name='br-int',has_traffic_filtering=True,id=d99d66eb-0c4d-494a-86c8-3b694c4cb6d5,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99d66eb-0c') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG os_vif [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:00:0f,bridge_name='br-int',has_traffic_filtering=True,id=d99d66eb-0c4d-494a-86c8-3b694c4cb6d5,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99d66eb-0c') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Updating instance_info_cache with network_info: [{"id": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "address": "fa:16:3e:c0:4f:9a", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c9992f-e2", "ovs_interfaceid": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd99d66eb-0c, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2a6bd1c-32bc-4a8f-941d-1ce1b8ec23a3) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-f1dc83ed-2b0e-4da0-9347-9c84ec56178e" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:51:30 user nova-compute[75745]: INFO os_vif [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:00:0f,bridge_name='br-int',has_traffic_filtering=True,id=d99d66eb-0c4d-494a-86c8-3b694c4cb6d5,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd99d66eb-0c')
Dec 01 17:51:30 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'digsEkJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:51:30 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:51:30 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e343ca-b01a-40d7-b963-dcea03fffbeb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:51:30 user nova-compute[75745]: No targets found.
Dec 01 17:51:30 user nova-compute[75745]: iSNS:
Dec 01 17:51:30 user nova-compute[75745]: No targets found.
Dec 01 17:51:30 user nova-compute[75745]: STATIC:
Dec 01 17:51:30 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6
Dec 01 17:51:30 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:51:30 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:51:30 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521
Dec 01 17:51:30 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:51:30 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:51:30 user nova-compute[75745]: FIRMWARE:
Dec 01 17:51:30 user nova-compute[75745]: No targets found.
Dec 01 17:51:30 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:51:30 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:51:30 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7cb982-b83d-469b-a14d-994ca6d1575c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[53bfe73d-f5ab-451d-9e66-d31b666cfad5]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 (non-flash)
Dec 01 17:51:30 user nova-compute[75745]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521 (non-flash)
Dec 01 17:51:30 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 (non-flash)
Dec 01 17:51:30 user nova-compute[75745]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521 (non-flash)
Dec 01 17:51:30 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24d830dd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521'): ({'sdc'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Removing single pathed devices sdc {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[422e2ddd-b7f3-4c6d-822e-b4a66188559c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[043fd732-51e1-46ca-a906-fe571527825b]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Flushing IO for device /dev/sdc {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3d7b02-61ce-4f8e-b735-9b18dc9235c9]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3212d06-e8e1-4fa6-9937-dcdea23e4f4e]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] SCSI volumes sdc have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8457519-bdc6-4882-803c-7cba28ab6adb]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[93dccbde-6502-4eb7-bd8f-a818db6599fc]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521, portal: 172.16.0.220,3260]
Dec 01 17:51:30 user nova-compute[75745]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521, portal: 172.16.0.220,3260] successful.
Dec 01 17:51:30 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3ceef5b-4508-44e2-852c-cf2ae1014521 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[116b485b-8001-4093-b8af-5b0ba3a5ba49]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] <== disconnect_volume: return (292ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:51:30 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:51:31 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Deleting instance files /opt/stack/data/nova/instances/6e046ac0-e912-4831-a8d7-8749e1a00087_del
Dec 01 17:51:31 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Deletion of /opt/stack/data/nova/instances/6e046ac0-e912-4831-a8d7-8749e1a00087_del complete
Dec 01 17:51:31 user nova-compute[75745]: INFO nova.compute.manager [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Took 1.38 seconds to destroy the instance on the hypervisor.
Dec 01 17:51:31 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:51:31 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:51:31 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:51:31 user nova-compute[75745]: DEBUG nova.compute.manager [req-3d5003d4-fe3e-49ed-8f2b-3d6c374cffd5 req-bd58452a-4b1a-4956-81ab-5947b0693eb5 service nova] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Received event network-vif-unplugged-d99d66eb-0c4d-494a-86c8-3b694c4cb6d5 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:51:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3d5003d4-fe3e-49ed-8f2b-3d6c374cffd5 req-bd58452a-4b1a-4956-81ab-5947b0693eb5 service nova] Acquiring lock "6e046ac0-e912-4831-a8d7-8749e1a00087-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:51:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3d5003d4-fe3e-49ed-8f2b-3d6c374cffd5 req-bd58452a-4b1a-4956-81ab-5947b0693eb5 service nova] Lock "6e046ac0-e912-4831-a8d7-8749e1a00087-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:51:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3d5003d4-fe3e-49ed-8f2b-3d6c374cffd5 req-bd58452a-4b1a-4956-81ab-5947b0693eb5 service nova] Lock "6e046ac0-e912-4831-a8d7-8749e1a00087-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:51:31 user nova-compute[75745]: DEBUG nova.compute.manager [req-3d5003d4-fe3e-49ed-8f2b-3d6c374cffd5 req-bd58452a-4b1a-4956-81ab-5947b0693eb5 service nova] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] No waiting events found dispatching network-vif-unplugged-d99d66eb-0c4d-494a-86c8-3b694c4cb6d5 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:51:31 user nova-compute[75745]: DEBUG nova.compute.manager [req-3d5003d4-fe3e-49ed-8f2b-3d6c374cffd5 req-bd58452a-4b1a-4956-81ab-5947b0693eb5 service nova] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Received event network-vif-unplugged-d99d66eb-0c4d-494a-86c8-3b694c4cb6d5 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:51:31 user nova-compute[75745]: DEBUG nova.compute.manager [req-3d5003d4-fe3e-49ed-8f2b-3d6c374cffd5 req-bd58452a-4b1a-4956-81ab-5947b0693eb5 service nova] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Received event network-vif-plugged-d99d66eb-0c4d-494a-86c8-3b694c4cb6d5 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:51:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3d5003d4-fe3e-49ed-8f2b-3d6c374cffd5 req-bd58452a-4b1a-4956-81ab-5947b0693eb5 service nova] Acquiring lock "6e046ac0-e912-4831-a8d7-8749e1a00087-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:51:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3d5003d4-fe3e-49ed-8f2b-3d6c374cffd5 req-bd58452a-4b1a-4956-81ab-5947b0693eb5 service nova] Lock "6e046ac0-e912-4831-a8d7-8749e1a00087-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:51:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3d5003d4-fe3e-49ed-8f2b-3d6c374cffd5 req-bd58452a-4b1a-4956-81ab-5947b0693eb5 service nova] Lock "6e046ac0-e912-4831-a8d7-8749e1a00087-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:51:31 user nova-compute[75745]: DEBUG nova.compute.manager [req-3d5003d4-fe3e-49ed-8f2b-3d6c374cffd5 req-bd58452a-4b1a-4956-81ab-5947b0693eb5 service nova] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] No waiting events found dispatching network-vif-plugged-d99d66eb-0c4d-494a-86c8-3b694c4cb6d5 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:51:31 user nova-compute[75745]: WARNING nova.compute.manager [req-3d5003d4-fe3e-49ed-8f2b-3d6c374cffd5 req-bd58452a-4b1a-4956-81ab-5947b0693eb5 service nova] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Received unexpected event network-vif-plugged-d99d66eb-0c4d-494a-86c8-3b694c4cb6d5 for instance with vm_state active and task_state deleting.
Dec 01 17:51:31 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:51:31 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Took 0.72 seconds to deallocate network for instance.
Dec 01 17:51:31 user nova-compute[75745]: DEBUG nova.compute.manager [req-3f4ba054-9276-4477-858f-98b272f2f280 req-27c01ef6-32c3-4c34-b1b8-9de524aefdf3 service nova] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Received event network-vif-deleted-d99d66eb-0c4d-494a-86c8-3b694c4cb6d5 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:51:32 user nova-compute[75745]: INFO nova.compute.manager [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Took 0.80 seconds to detach 1 volumes for instance.
Dec 01 17:51:32 user nova-compute[75745]: DEBUG nova.compute.manager [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 6e046ac0-e912-4831-a8d7-8749e1a00087] Deleting volume: f3ceef5b-4508-44e2-852c-cf2ae1014521 {{(pid=75745) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 01 17:51:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:51:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:51:32 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:51:32 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:51:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:51:32 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Deleted allocations for instance 6e046ac0-e912-4831-a8d7-8749e1a00087
Dec 01 17:51:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-1e2af078-41c6-40ed-a49c-c10f819c3fc5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "6e046ac0-e912-4831-a8d7-8749e1a00087" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.330s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:51:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:51:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:51:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:51:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:51:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:51:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-45f78da6-cdd5-40c4-b867-6383769813d4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:51:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-45f78da6-cdd5-40c4-b867-6383769813d4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:51:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-45f78da6-cdd5-40c4-b867-6383769813d4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:51:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-45f78da6-cdd5-40c4-b867-6383769813d4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:51:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-45f78da6-cdd5-40c4-b867-6383769813d4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:51:56 user nova-compute[75745]: INFO nova.compute.manager [None req-45f78da6-cdd5-40c4-b867-6383769813d4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Terminating instance
Dec 01 17:51:56 user nova-compute[75745]: DEBUG nova.compute.manager [None req-45f78da6-cdd5-40c4-b867-6383769813d4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:51:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:51:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:51:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:51:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:51:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-2e86067b-da29-4197-9e74-1234700f94cc req-2c608895-fa61-4553-917c-321bb00bb7d9 service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Received event network-vif-unplugged-66c9992f-e23d-4c4c-bac0-302c3cbf23b3 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:51:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2e86067b-da29-4197-9e74-1234700f94cc req-2c608895-fa61-4553-917c-321bb00bb7d9 service nova] Acquiring lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:51:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2e86067b-da29-4197-9e74-1234700f94cc req-2c608895-fa61-4553-917c-321bb00bb7d9 service nova] Lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:51:56 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2e86067b-da29-4197-9e74-1234700f94cc req-2c608895-fa61-4553-917c-321bb00bb7d9 service nova] Lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:51:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-2e86067b-da29-4197-9e74-1234700f94cc req-2c608895-fa61-4553-917c-321bb00bb7d9 service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] No waiting events found dispatching network-vif-unplugged-66c9992f-e23d-4c4c-bac0-302c3cbf23b3 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:51:56 user nova-compute[75745]: DEBUG nova.compute.manager [req-2e86067b-da29-4197-9e74-1234700f94cc req-2c608895-fa61-4553-917c-321bb00bb7d9 service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Received event network-vif-unplugged-66c9992f-e23d-4c4c-bac0-302c3cbf23b3 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:51:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:51:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:51:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:51:57 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Instance destroyed successfully.
Dec 01 17:51:57 user nova-compute[75745]: DEBUG nova.objects.instance [None req-45f78da6-cdd5-40c4-b867-6383769813d4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lazy-loading 'resources' on Instance uuid f1dc83ed-2b0e-4da0-9347-9c84ec56178e {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:51:57 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-45f78da6-cdd5-40c4-b867-6383769813d4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T17:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1367548217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1367548217',id=47,image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrJjzWe2dmCmfbeohRIk+Pm459FXB6ILb6KNT9dVtbXr/Rb7p3tqvYGiAgsb8bBqY0SFBblqW+doitJ7086KH0vAYypa1FPV1ZHGj93RrNMK68bNSvI+WBbwwAkUVcRHw==',key_name='tempest-keypair-1089424176',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:50:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b1e7099305f4571804612f3a3d8befb',ramdisk_id='',reservation_id='r-s927zouf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='695c84b8-d08d-488d-9841-cc1da92fb985',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1555393357',owner_user_name='tempest-AttachVolumeShelveTestJSON-1555393357-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:50:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f78365cc1e11444db345efc5fe3cc502',uuid=f1dc83ed-2b0e-4da0-9347-9c84ec56178e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "address": "fa:16:3e:c0:4f:9a", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c9992f-e2", "ovs_interfaceid": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:51:57 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-45f78da6-cdd5-40c4-b867-6383769813d4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Converting VIF {"id": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "address": "fa:16:3e:c0:4f:9a", "network": {"id": "773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1620922038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1e7099305f4571804612f3a3d8befb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66c9992f-e2", "ovs_interfaceid": "66c9992f-e23d-4c4c-bac0-302c3cbf23b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:51:57 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-45f78da6-cdd5-40c4-b867-6383769813d4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:4f:9a,bridge_name='br-int',has_traffic_filtering=True,id=66c9992f-e23d-4c4c-bac0-302c3cbf23b3,network=Network(773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66c9992f-e2') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:51:57 user nova-compute[75745]: DEBUG os_vif [None req-45f78da6-cdd5-40c4-b867-6383769813d4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:4f:9a,bridge_name='br-int',has_traffic_filtering=True,id=66c9992f-e23d-4c4c-bac0-302c3cbf23b3,network=Network(773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66c9992f-e2') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:51:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:51:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66c9992f-e2, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:51:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:51:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:51:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:51:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=90cf754d-8a3f-4195-ad21-6b4edcb39da4) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:51:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:51:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:51:57 user nova-compute[75745]: INFO os_vif [None req-45f78da6-cdd5-40c4-b867-6383769813d4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:4f:9a,bridge_name='br-int',has_traffic_filtering=True,id=66c9992f-e23d-4c4c-bac0-302c3cbf23b3,network=Network(773bf1ff-2f3e-4d8f-afc2-3d6b2ad5debc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66c9992f-e2')
Dec 01 17:51:57 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-45f78da6-cdd5-40c4-b867-6383769813d4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Deleting instance files /opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e_del
Dec 01 17:51:57 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-45f78da6-cdd5-40c4-b867-6383769813d4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Deletion of /opt/stack/data/nova/instances/f1dc83ed-2b0e-4da0-9347-9c84ec56178e_del complete
Dec 01 17:51:57 user nova-compute[75745]: INFO nova.compute.manager [None req-45f78da6-cdd5-40c4-b867-6383769813d4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Took 0.69 seconds to destroy the instance on the hypervisor.
Dec 01 17:51:57 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-45f78da6-cdd5-40c4-b867-6383769813d4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:51:57 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:51:57 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:51:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:51:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:51:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:51:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:51:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:51:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:51:57 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:51:57 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Took 0.70 seconds to deallocate network for instance.
Dec 01 17:51:57 user nova-compute[75745]: DEBUG nova.compute.manager [req-d8db9e1f-7b0c-49dc-92c5-29b8b3d563b6 req-75143563-7a2d-4323-82e2-d191a7809961 service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Received event network-vif-deleted-66c9992f-e23d-4c4c-bac0-302c3cbf23b3 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:51:57 user nova-compute[75745]: INFO nova.compute.manager [req-d8db9e1f-7b0c-49dc-92c5-29b8b3d563b6 req-75143563-7a2d-4323-82e2-d191a7809961 service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Neutron deleted interface 66c9992f-e23d-4c4c-bac0-302c3cbf23b3; detaching it from the instance and deleting it from the info cache
Dec 01 17:51:57 user nova-compute[75745]: DEBUG nova.network.neutron [req-d8db9e1f-7b0c-49dc-92c5-29b8b3d563b6 req-75143563-7a2d-4323-82e2-d191a7809961 service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:51:57 user nova-compute[75745]: DEBUG nova.compute.manager [req-d8db9e1f-7b0c-49dc-92c5-29b8b3d563b6 req-75143563-7a2d-4323-82e2-d191a7809961 service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Detach interface failed, port_id=66c9992f-e23d-4c4c-bac0-302c3cbf23b3, reason: Instance f1dc83ed-2b0e-4da0-9347-9c84ec56178e could not be found. {{(pid=75745) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 17:51:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-45f78da6-cdd5-40c4-b867-6383769813d4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:51:57 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-45f78da6-cdd5-40c4-b867-6383769813d4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:51:58 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-45f78da6-cdd5-40c4-b867-6383769813d4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:51:58 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-45f78da6-cdd5-40c4-b867-6383769813d4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:51:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-45f78da6-cdd5-40c4-b867-6383769813d4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.139s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:51:58 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-45f78da6-cdd5-40c4-b867-6383769813d4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Deleted allocations for instance f1dc83ed-2b0e-4da0-9347-9c84ec56178e
Dec 01 17:51:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-45f78da6-cdd5-40c4-b867-6383769813d4 tempest-AttachVolumeShelveTestJSON-1555393357 tempest-AttachVolumeShelveTestJSON-1555393357-project-member] Lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.717s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:51:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-7c966a95-9cd5-4438-8b4a-9464ad5d11a1 req-d9345b18-a287-4612-ac87-f05b735d0478 service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Received event network-vif-plugged-66c9992f-e23d-4c4c-bac0-302c3cbf23b3 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:51:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7c966a95-9cd5-4438-8b4a-9464ad5d11a1 req-d9345b18-a287-4612-ac87-f05b735d0478 service nova] Acquiring lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:51:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7c966a95-9cd5-4438-8b4a-9464ad5d11a1 req-d9345b18-a287-4612-ac87-f05b735d0478 service nova] Lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:51:58 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-7c966a95-9cd5-4438-8b4a-9464ad5d11a1 req-d9345b18-a287-4612-ac87-f05b735d0478 service nova] Lock "f1dc83ed-2b0e-4da0-9347-9c84ec56178e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:51:58 user nova-compute[75745]: DEBUG nova.compute.manager [req-7c966a95-9cd5-4438-8b4a-9464ad5d11a1 req-d9345b18-a287-4612-ac87-f05b735d0478 service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] No waiting events found dispatching network-vif-plugged-66c9992f-e23d-4c4c-bac0-302c3cbf23b3 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:51:58 user nova-compute[75745]: WARNING nova.compute.manager [req-7c966a95-9cd5-4438-8b4a-9464ad5d11a1 req-d9345b18-a287-4612-ac87-f05b735d0478 service nova] [instance: f1dc83ed-2b0e-4da0-9347-9c84ec56178e] Received unexpected event network-vif-plugged-66c9992f-e23d-4c4c-bac0-302c3cbf23b3 for instance with vm_state deleted and task_state None.
Dec 01 17:52:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:52:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:52:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:52:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:52:16 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:52:16 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:52:16 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:52:17 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:52:17 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:52:17 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:52:17 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:52:17 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:52:18 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:52:18 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Cleaning up deleted instances {{(pid=75745) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 01 17:52:18 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] There are 0 instances to clean {{(pid=75745) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 01 17:52:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:52:22 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:52:22 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:52:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:52:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:52:22 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:52:22 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:52:23 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:52:23 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:52:23 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:52:23 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=8928MB free_disk=25.08898162841797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:52:23 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:52:23 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:52:23 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance c3473bf6-5a7b-4030-b7b7-fe7540ed9b35 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:52:23 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:52:23 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:52:23 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:52:23 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:52:23 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:52:23 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:52:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "c3473bf6-5a7b-4030-b7b7-fe7540ed9b35" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:52:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "c3473bf6-5a7b-4030-b7b7-fe7540ed9b35" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:52:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "c3473bf6-5a7b-4030-b7b7-fe7540ed9b35-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:52:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "c3473bf6-5a7b-4030-b7b7-fe7540ed9b35-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:52:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "c3473bf6-5a7b-4030-b7b7-fe7540ed9b35-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:52:24 user nova-compute[75745]: INFO nova.compute.manager [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Terminating instance
Dec 01 17:52:24 user nova-compute[75745]: DEBUG nova.compute.manager [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:52:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:52:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:52:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:52:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:52:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:52:24 user nova-compute[75745]: DEBUG nova.compute.manager [req-75ba4d78-dbe3-4bd5-b992-bfe07aa27e7d req-7b8ce289-654b-4d65-90cc-6dcd77a438ce service nova] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Received event network-vif-unplugged-8f4ec3a6-2554-41e7-8486-ace5cf717fc4 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:52:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-75ba4d78-dbe3-4bd5-b992-bfe07aa27e7d req-7b8ce289-654b-4d65-90cc-6dcd77a438ce service nova] Acquiring lock "c3473bf6-5a7b-4030-b7b7-fe7540ed9b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:52:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-75ba4d78-dbe3-4bd5-b992-bfe07aa27e7d req-7b8ce289-654b-4d65-90cc-6dcd77a438ce service nova] Lock "c3473bf6-5a7b-4030-b7b7-fe7540ed9b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:52:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-75ba4d78-dbe3-4bd5-b992-bfe07aa27e7d req-7b8ce289-654b-4d65-90cc-6dcd77a438ce service nova] Lock "c3473bf6-5a7b-4030-b7b7-fe7540ed9b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:52:24 user nova-compute[75745]: DEBUG nova.compute.manager [req-75ba4d78-dbe3-4bd5-b992-bfe07aa27e7d req-7b8ce289-654b-4d65-90cc-6dcd77a438ce service nova] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] No waiting events found dispatching network-vif-unplugged-8f4ec3a6-2554-41e7-8486-ace5cf717fc4 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:52:24 user nova-compute[75745]: DEBUG nova.compute.manager [req-75ba4d78-dbe3-4bd5-b992-bfe07aa27e7d req-7b8ce289-654b-4d65-90cc-6dcd77a438ce service nova] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Received event network-vif-unplugged-8f4ec3a6-2554-41e7-8486-ace5cf717fc4 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:52:25 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Instance destroyed successfully.
Dec 01 17:52:25 user nova-compute[75745]: DEBUG nova.objects.instance [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lazy-loading 'resources' on Instance uuid c3473bf6-5a7b-4030-b7b7-fe7540ed9b35 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:47:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-135113284',display_name='tempest-TestVolumeBootPattern-volume-backed-server-135113284',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-135113284',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJnx+6/PDZwuBiTkHM9zct5ttV2HD0ea3IkAARKnwKi7z7nBmfG+sfcAufr8CLozRh3MtN3jis9PS0QUTjv71AY3b+9MmatxhGV7D3dE3tVAyZEi/mVlxy5FAU2vjw8nQ==',key_name='tempest-keypair-1802021362',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:47:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e92d35468e65461d8ac34cb6c1d19b68',ramdisk_id='',reservation_id='r-6o7o2sop',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1187866378',owner_user_name='tempest-TestVolumeBootPattern-1187866378-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:47:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d79b4d42093f4a12aae4fb90bbbcba39',uuid=c3473bf6-5a7b-4030-b7b7-fe7540ed9b35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f4ec3a6-2554-41e7-8486-ace5cf717fc4", "address": "fa:16:3e:a8:d2:36", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4ec3a6-25", "ovs_interfaceid": "8f4ec3a6-2554-41e7-8486-ace5cf717fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Converting VIF {"id": "8f4ec3a6-2554-41e7-8486-ace5cf717fc4", "address": "fa:16:3e:a8:d2:36", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4ec3a6-25", "ovs_interfaceid": "8f4ec3a6-2554-41e7-8486-ace5cf717fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:d2:36,bridge_name='br-int',has_traffic_filtering=True,id=8f4ec3a6-2554-41e7-8486-ace5cf717fc4,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f4ec3a6-25') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG os_vif [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:d2:36,bridge_name='br-int',has_traffic_filtering=True,id=8f4ec3a6-2554-41e7-8486-ace5cf717fc4,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f4ec3a6-25') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f4ec3a6-25, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b09caf8f-d7e8-4878-a79c-0d321262d845) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:52:25 user nova-compute[75745]: INFO os_vif [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:d2:36,bridge_name='br-int',has_traffic_filtering=True,id=8f4ec3a6-2554-41e7-8486-ace5cf717fc4,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f4ec3a6-25')
Dec 01 17:52:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GASPMkWg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:52:25 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:52:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[65264056-c92c-43d0-9b18-3ad7c64f51b8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:52:25 user nova-compute[75745]: No targets found.
Dec 01 17:52:25 user nova-compute[75745]: iSNS:
Dec 01 17:52:25 user nova-compute[75745]: No targets found.
Dec 01 17:52:25 user nova-compute[75745]: STATIC:
Dec 01 17:52:25 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6
Dec 01 17:52:25 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:52:25 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:52:25 user nova-compute[75745]: FIRMWARE:
Dec 01 17:52:25 user nova-compute[75745]: No targets found.
Dec 01 17:52:25 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:52:25 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:52:25 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[41739d48-134c-4c03-b453-9a916da3b5bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b08cbb-64cb-4e3b-b309-1eac2336c912]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 (non-flash)
Dec 01 17:52:25 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 (non-flash)
Dec 01 17:52:25 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24985cd990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6'): ({'sdb'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Removing single pathed devices sdb {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8fea4f-37a8-4276-9a78-e6070c979af5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89d18be-026b-4fd0-aa5c-c8f5f9282643]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Flushing IO for device /dev/sdb {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7532f5f1-416a-4fe4-803e-1bcad68f8af6]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.067s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78b5b1e-b88f-44b9-831e-2ef46d9738a5]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] SCSI volumes sdb have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[108f58d4-73c9-4ea8-9919-7cf42e4ee615]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[20516061-26a0-4e6a-a005-f768ad0b515f]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6, portal: 172.16.0.220,3260]
Dec 01 17:52:25 user nova-compute[75745]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6, portal: 172.16.0.220,3260] successful.
Dec 01 17:52:25 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[18dc415f-7291-4621-b0f9-58b07b9903d5]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] <== disconnect_volume: return (303ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:52:25 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Deleting instance files /opt/stack/data/nova/instances/c3473bf6-5a7b-4030-b7b7-fe7540ed9b35_del
Dec 01 17:52:25 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Deletion of /opt/stack/data/nova/instances/c3473bf6-5a7b-4030-b7b7-fe7540ed9b35_del complete
Dec 01 17:52:25 user nova-compute[75745]: INFO nova.compute.manager [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Took 1.19 seconds to destroy the instance on the hypervisor.
Dec 01 17:52:25 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:52:25 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:52:26 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:52:26 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Took 0.68 seconds to deallocate network for instance.
Dec 01 17:52:26 user nova-compute[75745]: DEBUG nova.compute.manager [req-6a3074ca-77d7-4611-96f6-49b1a78f2edd req-7d47a1d3-0921-4b06-9774-0cebb357bf1b service nova] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Received event network-vif-deleted-8f4ec3a6-2554-41e7-8486-ace5cf717fc4 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:52:26 user nova-compute[75745]: DEBUG nova.compute.manager [req-5c417464-57b1-4862-b5d7-c66de123451a req-8eb265be-bf3a-481d-a243-0f6ed7907de4 service nova] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Received event network-vif-plugged-8f4ec3a6-2554-41e7-8486-ace5cf717fc4 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:52:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5c417464-57b1-4862-b5d7-c66de123451a req-8eb265be-bf3a-481d-a243-0f6ed7907de4 service nova] Acquiring lock "c3473bf6-5a7b-4030-b7b7-fe7540ed9b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:52:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5c417464-57b1-4862-b5d7-c66de123451a req-8eb265be-bf3a-481d-a243-0f6ed7907de4 service nova] Lock "c3473bf6-5a7b-4030-b7b7-fe7540ed9b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:52:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5c417464-57b1-4862-b5d7-c66de123451a req-8eb265be-bf3a-481d-a243-0f6ed7907de4 service nova] Lock "c3473bf6-5a7b-4030-b7b7-fe7540ed9b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:52:26 user nova-compute[75745]: DEBUG nova.compute.manager [req-5c417464-57b1-4862-b5d7-c66de123451a req-8eb265be-bf3a-481d-a243-0f6ed7907de4 service nova] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] No waiting events found dispatching network-vif-plugged-8f4ec3a6-2554-41e7-8486-ace5cf717fc4 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:52:26 user nova-compute[75745]: WARNING nova.compute.manager [req-5c417464-57b1-4862-b5d7-c66de123451a req-8eb265be-bf3a-481d-a243-0f6ed7907de4 service nova] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Received unexpected event network-vif-plugged-8f4ec3a6-2554-41e7-8486-ace5cf717fc4 for instance with vm_state active and task_state deleting.
Dec 01 17:52:26 user nova-compute[75745]: INFO nova.compute.manager [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Took 0.75 seconds to detach 1 volumes for instance.
Dec 01 17:52:26 user nova-compute[75745]: DEBUG nova.compute.manager [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: c3473bf6-5a7b-4030-b7b7-fe7540ed9b35] Deleting volume: f3861458-fdc3-46ef-8bf2-1ab4fdaa8da6 {{(pid=75745) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 01 17:52:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:52:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:52:27 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:52:27 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:52:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.113s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:52:27 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Deleted allocations for instance c3473bf6-5a7b-4030-b7b7-fe7540ed9b35
Dec 01 17:52:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-4d7f2f5d-c109-4052-bee8-5c36b16a3959 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "c3473bf6-5a7b-4030-b7b7-fe7540ed9b35" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:52:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:52:30 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:52:30 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:52:30 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Rebuilding the list of instances to heal {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 17:52:30 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Didn't find any instances for network info cache update. {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 17:52:30 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:52:33 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:52:33 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75745) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 01 17:52:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:52:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:52:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:52:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:52:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:52:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:52:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:52:41 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:52:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:52:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:52:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:52:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:52:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:52:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:52:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:52:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:52:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:52:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:52:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:52:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:52:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:52:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:52:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:53:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:53:01 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:53:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:53:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:53:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:53:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:53:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:53:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:53:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:53:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:53:16 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:53:17 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:53:17 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:53:17 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:53:18 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:53:18 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:53:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:53:23 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:53:24 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:53:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:53:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:53:24 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:53:24 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:53:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:53:25 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:53:25 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:53:25 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=9068MB free_disk=25.078510284423828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:53:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:53:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:53:25 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:53:25 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:53:25 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Refreshing inventories for resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 01 17:53:25 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Updating ProviderTree inventory for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 01 17:53:25 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Updating inventory in ProviderTree for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 01 17:53:25 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Refreshing aggregate associations for resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9, aggregates: None {{(pid=75745) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 01 17:53:25 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Refreshing trait associations for resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9, traits: COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=75745) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 01 17:53:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "09dc760e-2c5b-44d3-981a-6b74ae111a05" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:53:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "09dc760e-2c5b-44d3-981a-6b74ae111a05" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:53:25 user nova-compute[75745]: DEBUG nova.compute.manager [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:53:25 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:53:25 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:53:25 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:53:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.485s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:53:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:53:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:53:25 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:53:25 user nova-compute[75745]: INFO nova.compute.claims [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Claim successful on node user
Dec 01 17:53:25 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:53:25 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:53:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.195s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:53:26 user nova-compute[75745]: DEBUG nova.compute.manager [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:53:26 user nova-compute[75745]: DEBUG nova.compute.manager [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:53:26 user nova-compute[75745]: DEBUG nova.network.neutron [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:53:26 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:53:26 user nova-compute[75745]: DEBUG nova.compute.manager [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:53:26 user nova-compute[75745]: DEBUG nova.policy [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd79b4d42093f4a12aae4fb90bbbcba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d35468e65461d8ac34cb6c1d19b68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:53:26 user nova-compute[75745]: INFO nova.virt.block_device [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Booting with volume f2678ee9-b674-4e35-a627-ff6605e0d657 at /dev/vda
Dec 01 17:53:26 user nova-compute[75745]: DEBUG os_brick.utils [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:53:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:53:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:53:26 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b33248-a402-4e6c-b593-9b9e9174c1a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:53:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:53:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:53:26 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5fd2b8-6a13-4f7d-84c2-4815e46e3bea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:53:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:53:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:53:26 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f028671a-198f-4690-b256-4eb6d40c708f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:53:26 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9afe6a-9bad-40b4-bc70-200d856c509a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:53:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:53:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:53:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:53:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:53:26 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:53:26 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:53:26 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[041c6008-0029-4b05-81b7-aab38f43448d]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:53:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:53:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:53:26 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:53:26 user nova-compute[75745]: DEBUG os_brick.utils [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:53:26 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Updating existing volume attachment record: ae9f8833-aba6-43b8-a7b5-a49535470664 {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:53:26 user nova-compute[75745]: DEBUG nova.network.neutron [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Successfully created port: 2b6acdbb-741c-4c93-96af-7a2a2a7e8426 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:53:27 user nova-compute[75745]: DEBUG nova.network.neutron [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Successfully updated port: 2b6acdbb-741c-4c93-96af-7a2a2a7e8426 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:53:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "refresh_cache-09dc760e-2c5b-44d3-981a-6b74ae111a05" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:53:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquired lock "refresh_cache-09dc760e-2c5b-44d3-981a-6b74ae111a05" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:53:27 user nova-compute[75745]: DEBUG nova.network.neutron [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:53:27 user nova-compute[75745]: DEBUG nova.compute.manager [req-38b51a82-bef5-457e-a7fc-12272db56230 req-d72f9f7a-e3c9-4d43-bb4f-5edc440f4cd4 service nova] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Received event network-changed-2b6acdbb-741c-4c93-96af-7a2a2a7e8426 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:53:27 user nova-compute[75745]: DEBUG nova.compute.manager [req-38b51a82-bef5-457e-a7fc-12272db56230 req-d72f9f7a-e3c9-4d43-bb4f-5edc440f4cd4 service nova] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Refreshing instance network info cache due to event network-changed-2b6acdbb-741c-4c93-96af-7a2a2a7e8426. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:53:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-38b51a82-bef5-457e-a7fc-12272db56230 req-d72f9f7a-e3c9-4d43-bb4f-5edc440f4cd4 service nova] Acquiring lock "refresh_cache-09dc760e-2c5b-44d3-981a-6b74ae111a05" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:53:27 user nova-compute[75745]: DEBUG nova.network.neutron [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:53:28 user nova-compute[75745]: DEBUG nova.network.neutron [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Updating instance_info_cache with network_info: [{"id": "2b6acdbb-741c-4c93-96af-7a2a2a7e8426", "address": "fa:16:3e:e7:f2:f0", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6acdbb-74", "ovs_interfaceid": "2b6acdbb-741c-4c93-96af-7a2a2a7e8426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:53:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Releasing lock "refresh_cache-09dc760e-2c5b-44d3-981a-6b74ae111a05" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:53:28 user nova-compute[75745]: DEBUG nova.compute.manager [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Instance network_info: |[{"id": "2b6acdbb-741c-4c93-96af-7a2a2a7e8426", "address": "fa:16:3e:e7:f2:f0", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6acdbb-74", "ovs_interfaceid": "2b6acdbb-741c-4c93-96af-7a2a2a7e8426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:53:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-38b51a82-bef5-457e-a7fc-12272db56230 req-d72f9f7a-e3c9-4d43-bb4f-5edc440f4cd4 service nova] Acquired lock "refresh_cache-09dc760e-2c5b-44d3-981a-6b74ae111a05" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:53:28 user nova-compute[75745]: DEBUG nova.network.neutron [req-38b51a82-bef5-457e-a7fc-12272db56230 req-d72f9f7a-e3c9-4d43-bb4f-5edc440f4cd4 service nova] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Refreshing network info cache for port 2b6acdbb-741c-4c93-96af-7a2a2a7e8426 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:53:28 user nova-compute[75745]: DEBUG nova.network.neutron [req-38b51a82-bef5-457e-a7fc-12272db56230 req-d72f9f7a-e3c9-4d43-bb4f-5edc440f4cd4 service nova] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Updated VIF entry in instance network info cache for port 2b6acdbb-741c-4c93-96af-7a2a2a7e8426. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:53:28 user nova-compute[75745]: DEBUG nova.network.neutron [req-38b51a82-bef5-457e-a7fc-12272db56230 req-d72f9f7a-e3c9-4d43-bb4f-5edc440f4cd4 service nova] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Updating instance_info_cache with network_info: [{"id": "2b6acdbb-741c-4c93-96af-7a2a2a7e8426", "address": "fa:16:3e:e7:f2:f0", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6acdbb-74", "ovs_interfaceid": "2b6acdbb-741c-4c93-96af-7a2a2a7e8426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:53:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-38b51a82-bef5-457e-a7fc-12272db56230 req-d72f9f7a-e3c9-4d43-bb4f-5edc440f4cd4 service nova] Releasing lock "refresh_cache-09dc760e-2c5b-44d3-981a-6b74ae111a05" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:53:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:53:30 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:53:30 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:53:30 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Rebuilding the list of instances to heal {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 17:53:30 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Skipping network cache update for instance because it is Building. {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Dec 01 17:53:30 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Didn't find any instances for network info cache update. {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 17:53:30 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG nova.compute.manager [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:53:35 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Creating image(s)
Dec 01 17:53:35 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Did not create local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Ensure instance console log exists: /opt/stack/data/nova/instances/09dc760e-2c5b-44d3-981a-6b74ae111a05/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Start _get_guest_xml network_info=[{"id": "2b6acdbb-741c-4c93-96af-7a2a2a7e8426", "address": "fa:16:3e:e7:f2:f0", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6acdbb-74", "ovs_interfaceid": "2b6acdbb-741c-4c93-96af-7a2a2a7e8426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': 'ae9f8833-aba6-43b8-a7b5-a49535470664', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gaGDeKsc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '09dc760e-2c5b-44d3-981a-6b74ae111a05', 'attached_at': '', 'detached_at': '', 'volume_id': 'f2678ee9-b674-4e35-a627-ff6605e0d657', 'serial': 'f2678ee9-b674-4e35-a627-ff6605e0d657'}, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:53:35 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:53:35 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:53:35 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gaGDeKsc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:53:35 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:53:35 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:53:35 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:53:35 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:53:35 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:53:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[1347a590-1fb3-428b-80bf-235ac5bd5d10]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:53:35 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ebbdb1-ab7f-4292-bb30-879225a7a441]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657] added
Dec 01 17:53:35 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df7cd26-d913-4294-94ac-96029ccbe23d]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da970e7-4b2f-4d35-98b5-2b90b47a1da1]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gaGDeKsc {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gaGDeKsc" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bab7116-fd72-41a9-8cfa-8c102b31b8bf]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gaGDeKsc'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4286f83d-d5c1-467b-9a3b-f0d89db5eaa3]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[867e931f-7a60-4f84-a3ea-610a85272428]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 01 17:53:35 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 01 17:53:35 user nova-compute[75745]:  {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:53:35 user nova-compute[75745]: WARNING os_brick.initiator.connectors.iscsi [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 01 17:53:35 user nova-compute[75745]: 
Dec 01 17:53:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c48831-e02f-4519-ab15-6fcbe89592e4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657, portal: 172.16.0.220,3260]
Dec 01 17:53:35 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657, portal: 172.16.0.220,3260] successful.
Dec 01 17:53:35 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d2b7fd-13a0-4840-adcc-c6fea517f897]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5c9018-4ee3-45ee-a253-b82aaab8eea2]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 (non-flash)
Dec 01 17:53:35 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 (non-flash)
Dec 01 17:53:35 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7c9ec3-a34b-4e87-8d84-38aaf8e02a84]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:53:35 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gaGDeKsc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:53:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:53:36 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23761646330656532', 'path': '/dev/sdb'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:53:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761646330656532', 'path': '/dev/sdb'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:53:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:53:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-619583383',display_name='tempest-TestVolumeBootPattern-server-619583383',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-619583383',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaGASNmHMCwnU2klLf0QfxQKkLaqg8lTAnsQ0Y5f6gp+OHE5KzZXuaQ49yykKxI1uI1o6gFpR5UTiAPuJn79NKCW5llBvns9e77ft4Xdyu8bdbX9KVQYq2mh7DdUS5MFQ==',key_name='tempest-TestVolumeBootPattern-1177500877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e92d35468e65461d8ac34cb6c1d19b68',ramdisk_id='',reservation_id='r-kegvpllw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1187866378',owner_user_name='tempest-TestVolumeBootPattern-1187866378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:53:26Z,user_data=None,user_id='d79b4d42093f4a12aae4fb90bbbcba39',uuid=09dc760e-2c5b-44d3-981a-6b74ae111a05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b6acdbb-741c-4c93-96af-7a2a2a7e8426", "address": "fa:16:3e:e7:f2:f0", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6acdbb-74", "ovs_interfaceid": "2b6acdbb-741c-4c93-96af-7a2a2a7e8426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:53:36 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Converting VIF {"id": "2b6acdbb-741c-4c93-96af-7a2a2a7e8426", "address": "fa:16:3e:e7:f2:f0", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6acdbb-74", "ovs_interfaceid": "2b6acdbb-741c-4c93-96af-7a2a2a7e8426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:53:36 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:f2:f0,bridge_name='br-int',has_traffic_filtering=True,id=2b6acdbb-741c-4c93-96af-7a2a2a7e8426,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b6acdbb-74') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:53:36 user nova-compute[75745]: DEBUG nova.objects.instance [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lazy-loading 'pci_devices' on Instance uuid 09dc760e-2c5b-44d3-981a-6b74ae111a05 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:53:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:53:36 user nova-compute[75745]:   <uuid>09dc760e-2c5b-44d3-981a-6b74ae111a05</uuid>
Dec 01 17:53:36 user nova-compute[75745]:   <name>instance-00000032</name>
Dec 01 17:53:36 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:53:36 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:53:36 user nova-compute[75745]:   <metadata>
Dec 01 17:53:36 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:53:36 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:53:36 user nova-compute[75745]:       <nova:name>tempest-TestVolumeBootPattern-server-619583383</nova:name>
Dec 01 17:53:36 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:53:35</nova:creationTime>
Dec 01 17:53:36 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:53:36 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:53:36 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:53:36 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:53:36 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:53:36 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:53:36 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:53:36 user nova-compute[75745]:       <nova:owner>
Dec 01 17:53:36 user nova-compute[75745]:         <nova:user uuid="d79b4d42093f4a12aae4fb90bbbcba39">tempest-TestVolumeBootPattern-1187866378-project-member</nova:user>
Dec 01 17:53:36 user nova-compute[75745]:         <nova:project uuid="e92d35468e65461d8ac34cb6c1d19b68">tempest-TestVolumeBootPattern-1187866378</nova:project>
Dec 01 17:53:36 user nova-compute[75745]:       </nova:owner>
Dec 01 17:53:36 user nova-compute[75745]:       <nova:ports>
Dec 01 17:53:36 user nova-compute[75745]:         <nova:port uuid="2b6acdbb-741c-4c93-96af-7a2a2a7e8426">
Dec 01 17:53:36 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 01 17:53:36 user nova-compute[75745]:         </nova:port>
Dec 01 17:53:36 user nova-compute[75745]:       </nova:ports>
Dec 01 17:53:36 user nova-compute[75745]:     </nova:instance>
Dec 01 17:53:36 user nova-compute[75745]:   </metadata>
Dec 01 17:53:36 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:53:36 user nova-compute[75745]:     <system>
Dec 01 17:53:36 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:53:36 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:53:36 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:53:36 user nova-compute[75745]:       <entry name="serial">09dc760e-2c5b-44d3-981a-6b74ae111a05</entry>
Dec 01 17:53:36 user nova-compute[75745]:       <entry name="uuid">09dc760e-2c5b-44d3-981a-6b74ae111a05</entry>
Dec 01 17:53:36 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:53:36 user nova-compute[75745]:     </system>
Dec 01 17:53:36 user nova-compute[75745]:   </sysinfo>
Dec 01 17:53:36 user nova-compute[75745]:   <os>
Dec 01 17:53:36 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:53:36 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:53:36 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:53:36 user nova-compute[75745]:   </os>
Dec 01 17:53:36 user nova-compute[75745]:   <features>
Dec 01 17:53:36 user nova-compute[75745]:     <acpi/>
Dec 01 17:53:36 user nova-compute[75745]:     <apic/>
Dec 01 17:53:36 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:53:36 user nova-compute[75745]:   </features>
Dec 01 17:53:36 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:53:36 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:53:36 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:53:36 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:53:36 user nova-compute[75745]:   </clock>
Dec 01 17:53:36 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:53:36 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:53:36 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:53:36 user nova-compute[75745]:   </cpu>
Dec 01 17:53:36 user nova-compute[75745]:   <devices>
Dec 01 17:53:36 user nova-compute[75745]:     <disk type="block" device="disk">
Dec 01 17:53:36 user nova-compute[75745]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:53:36 user nova-compute[75745]:       <source dev="/dev/sdb"/>
Dec 01 17:53:36 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:53:36 user nova-compute[75745]:       <serial>f2678ee9-b674-4e35-a627-ff6605e0d657</serial>
Dec 01 17:53:36 user nova-compute[75745]:     </disk>
Dec 01 17:53:36 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:53:36 user nova-compute[75745]:       <mac address="fa:16:3e:e7:f2:f0"/>
Dec 01 17:53:36 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:53:36 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:53:36 user nova-compute[75745]:       <target dev="tap2b6acdbb-74"/>
Dec 01 17:53:36 user nova-compute[75745]:     </interface>
Dec 01 17:53:36 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:53:36 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/09dc760e-2c5b-44d3-981a-6b74ae111a05/console.log" append="off"/>
Dec 01 17:53:36 user nova-compute[75745]:     </serial>
Dec 01 17:53:36 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:53:36 user nova-compute[75745]:     <video>
Dec 01 17:53:36 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:53:36 user nova-compute[75745]:     </video>
Dec 01 17:53:36 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:53:36 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:53:36 user nova-compute[75745]:     </rng>
Dec 01 17:53:36 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:53:36 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:53:36 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:53:36 user nova-compute[75745]:     </memballoon>
Dec 01 17:53:36 user nova-compute[75745]:   </devices>
Dec 01 17:53:36 user nova-compute[75745]: </domain>
Dec 01 17:53:36 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:53:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:53:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-619583383',display_name='tempest-TestVolumeBootPattern-server-619583383',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-619583383',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaGASNmHMCwnU2klLf0QfxQKkLaqg8lTAnsQ0Y5f6gp+OHE5KzZXuaQ49yykKxI1uI1o6gFpR5UTiAPuJn79NKCW5llBvns9e77ft4Xdyu8bdbX9KVQYq2mh7DdUS5MFQ==',key_name='tempest-TestVolumeBootPattern-1177500877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e92d35468e65461d8ac34cb6c1d19b68',ramdisk_id='',reservation_id='r-kegvpllw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1187866378',owner_user_name='tempest-TestVolumeBootPattern-1187866378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:53:26Z,user_data=None,user_id='d79b4d42093f4a12aae4fb90bbbcba39',uuid=09dc760e-2c5b-44d3-981a-6b74ae111a05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b6acdbb-741c-4c93-96af-7a2a2a7e8426", "address": "fa:16:3e:e7:f2:f0", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6acdbb-74", "ovs_interfaceid": "2b6acdbb-741c-4c93-96af-7a2a2a7e8426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:53:36 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Converting VIF {"id": "2b6acdbb-741c-4c93-96af-7a2a2a7e8426", "address": "fa:16:3e:e7:f2:f0", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6acdbb-74", "ovs_interfaceid": "2b6acdbb-741c-4c93-96af-7a2a2a7e8426", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:53:36 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:f2:f0,bridge_name='br-int',has_traffic_filtering=True,id=2b6acdbb-741c-4c93-96af-7a2a2a7e8426,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b6acdbb-74') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:53:36 user nova-compute[75745]: DEBUG os_vif [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:f2:f0,bridge_name='br-int',has_traffic_filtering=True,id=2b6acdbb-741c-4c93-96af-7a2a2a7e8426,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b6acdbb-74') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:53:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:53:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:53:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:53:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:53:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1b5ad86a-f26b-504a-968b-395e120393b2', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:53:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:53:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:53:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:53:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b6acdbb-74, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:53:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b6acdbb-74, col_values=(('qos', UUID('32a39407-ae47-424c-a36a-43eaff566f2c')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:53:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b6acdbb-74, col_values=(('external_ids', {'iface-id': '2b6acdbb-741c-4c93-96af-7a2a2a7e8426', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:f2:f0', 'vm-uuid': '09dc760e-2c5b-44d3-981a-6b74ae111a05'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:53:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:53:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:53:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:53:36 user nova-compute[75745]: INFO os_vif [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:f2:f0,bridge_name='br-int',has_traffic_filtering=True,id=2b6acdbb-741c-4c93-96af-7a2a2a7e8426,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b6acdbb-74')
Dec 01 17:53:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:53:36 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] No VIF found with MAC fa:16:3e:e7:f2:f0, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:53:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:53:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:53:38 user nova-compute[75745]: DEBUG nova.compute.manager [req-38cf106a-6a24-4663-969e-0b47e7f8297d req-1f1af223-caa0-49ae-a844-0348ccba68b9 service nova] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Received event network-vif-plugged-2b6acdbb-741c-4c93-96af-7a2a2a7e8426 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:53:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-38cf106a-6a24-4663-969e-0b47e7f8297d req-1f1af223-caa0-49ae-a844-0348ccba68b9 service nova] Acquiring lock "09dc760e-2c5b-44d3-981a-6b74ae111a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:53:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-38cf106a-6a24-4663-969e-0b47e7f8297d req-1f1af223-caa0-49ae-a844-0348ccba68b9 service nova] Lock "09dc760e-2c5b-44d3-981a-6b74ae111a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:53:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-38cf106a-6a24-4663-969e-0b47e7f8297d req-1f1af223-caa0-49ae-a844-0348ccba68b9 service nova] Lock "09dc760e-2c5b-44d3-981a-6b74ae111a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:53:38 user nova-compute[75745]: DEBUG nova.compute.manager [req-38cf106a-6a24-4663-969e-0b47e7f8297d req-1f1af223-caa0-49ae-a844-0348ccba68b9 service nova] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] No waiting events found dispatching network-vif-plugged-2b6acdbb-741c-4c93-96af-7a2a2a7e8426 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:53:38 user nova-compute[75745]: WARNING nova.compute.manager [req-38cf106a-6a24-4663-969e-0b47e7f8297d req-1f1af223-caa0-49ae-a844-0348ccba68b9 service nova] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Received unexpected event network-vif-plugged-2b6acdbb-741c-4c93-96af-7a2a2a7e8426 for instance with vm_state building and task_state spawning.
Dec 01 17:53:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:53:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:53:38 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:53:40 user nova-compute[75745]: DEBUG nova.compute.manager [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:53:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:53:40 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Instance spawned successfully.
Dec 01 17:53:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:53:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:53:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:53:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:53:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:53:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:53:40 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:53:40 user nova-compute[75745]: INFO nova.compute.manager [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Took 5.02 seconds to spawn the instance on the hypervisor.
Dec 01 17:53:40 user nova-compute[75745]: DEBUG nova.compute.manager [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:53:40 user nova-compute[75745]: INFO nova.compute.manager [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Took 14.64 seconds to build instance.
Dec 01 17:53:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-b26e4166-71e5-4f4d-8fdb-cc6ac2dee237 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "09dc760e-2c5b-44d3-981a-6b74ae111a05" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.739s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:53:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:53:40 user nova-compute[75745]: DEBUG nova.compute.manager [req-69bb3b4c-5564-47f8-ba31-1c11258b7c5b req-305aa429-b502-4e5a-8f22-b36e2a0ac130 service nova] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Received event network-vif-plugged-2b6acdbb-741c-4c93-96af-7a2a2a7e8426 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:53:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-69bb3b4c-5564-47f8-ba31-1c11258b7c5b req-305aa429-b502-4e5a-8f22-b36e2a0ac130 service nova] Acquiring lock "09dc760e-2c5b-44d3-981a-6b74ae111a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:53:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-69bb3b4c-5564-47f8-ba31-1c11258b7c5b req-305aa429-b502-4e5a-8f22-b36e2a0ac130 service nova] Lock "09dc760e-2c5b-44d3-981a-6b74ae111a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:53:40 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-69bb3b4c-5564-47f8-ba31-1c11258b7c5b req-305aa429-b502-4e5a-8f22-b36e2a0ac130 service nova] Lock "09dc760e-2c5b-44d3-981a-6b74ae111a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:53:40 user nova-compute[75745]: DEBUG nova.compute.manager [req-69bb3b4c-5564-47f8-ba31-1c11258b7c5b req-305aa429-b502-4e5a-8f22-b36e2a0ac130 service nova] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] No waiting events found dispatching network-vif-plugged-2b6acdbb-741c-4c93-96af-7a2a2a7e8426 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:53:40 user nova-compute[75745]: WARNING nova.compute.manager [req-69bb3b4c-5564-47f8-ba31-1c11258b7c5b req-305aa429-b502-4e5a-8f22-b36e2a0ac130 service nova] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Received unexpected event network-vif-plugged-2b6acdbb-741c-4c93-96af-7a2a2a7e8426 for instance with vm_state active and task_state None.
Dec 01 17:53:41 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:53:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:53:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:53:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:53:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:54:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:54:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:54:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:54:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:54:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:54:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:54:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:54:16 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:54:17 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:54:17 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:54:19 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:54:20 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:54:20 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:54:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:54:25 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:54:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:54:26 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:54:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:54:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:54:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:54:26 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:54:26 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:54:27 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:54:27 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:54:27 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=8936MB free_disk=25.07598114013672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:54:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:54:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:54:27 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance 09dc760e-2c5b-44d3-981a-6b74ae111a05 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:54:27 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:54:27 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:54:27 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:54:27 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:54:27 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:54:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:54:30 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:54:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:54:31 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:54:31 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:54:31 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Rebuilding the list of instances to heal {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 17:54:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-09dc760e-2c5b-44d3-981a-6b74ae111a05" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:54:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-09dc760e-2c5b-44d3-981a-6b74ae111a05" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:54:31 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:54:31 user nova-compute[75745]: DEBUG nova.objects.instance [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lazy-loading 'info_cache' on Instance uuid 09dc760e-2c5b-44d3-981a-6b74ae111a05 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:54:32 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Updating instance_info_cache with network_info: [{"id": "2b6acdbb-741c-4c93-96af-7a2a2a7e8426", "address": "fa:16:3e:e7:f2:f0", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6acdbb-74", "ovs_interfaceid": "2b6acdbb-741c-4c93-96af-7a2a2a7e8426", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:54:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-09dc760e-2c5b-44d3-981a-6b74ae111a05" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:54:32 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:54:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:54:41 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:54:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:54:47 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:54:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:54:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:55:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:55:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:55:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:55:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:55:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:55:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:55:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:55:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:55:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:55:17 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:55:17 user nova-compute[75745]: DEBUG nova.compute.manager [req-9a54bd84-b7ef-4165-83fe-100f0c4b1520 req-84b750f9-d792-4524-80fe-0ca7420b0e93 service nova] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Received event network-changed-2b6acdbb-741c-4c93-96af-7a2a2a7e8426 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:55:17 user nova-compute[75745]: DEBUG nova.compute.manager [req-9a54bd84-b7ef-4165-83fe-100f0c4b1520 req-84b750f9-d792-4524-80fe-0ca7420b0e93 service nova] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Refreshing instance network info cache due to event network-changed-2b6acdbb-741c-4c93-96af-7a2a2a7e8426. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:55:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-9a54bd84-b7ef-4165-83fe-100f0c4b1520 req-84b750f9-d792-4524-80fe-0ca7420b0e93 service nova] Acquiring lock "refresh_cache-09dc760e-2c5b-44d3-981a-6b74ae111a05" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:55:17 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-9a54bd84-b7ef-4165-83fe-100f0c4b1520 req-84b750f9-d792-4524-80fe-0ca7420b0e93 service nova] Acquired lock "refresh_cache-09dc760e-2c5b-44d3-981a-6b74ae111a05" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:55:17 user nova-compute[75745]: DEBUG nova.network.neutron [req-9a54bd84-b7ef-4165-83fe-100f0c4b1520 req-84b750f9-d792-4524-80fe-0ca7420b0e93 service nova] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Refreshing network info cache for port 2b6acdbb-741c-4c93-96af-7a2a2a7e8426 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:55:18 user nova-compute[75745]: DEBUG nova.network.neutron [req-9a54bd84-b7ef-4165-83fe-100f0c4b1520 req-84b750f9-d792-4524-80fe-0ca7420b0e93 service nova] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Updated VIF entry in instance network info cache for port 2b6acdbb-741c-4c93-96af-7a2a2a7e8426. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:55:18 user nova-compute[75745]: DEBUG nova.network.neutron [req-9a54bd84-b7ef-4165-83fe-100f0c4b1520 req-84b750f9-d792-4524-80fe-0ca7420b0e93 service nova] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Updating instance_info_cache with network_info: [{"id": "2b6acdbb-741c-4c93-96af-7a2a2a7e8426", "address": "fa:16:3e:e7:f2:f0", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6acdbb-74", "ovs_interfaceid": "2b6acdbb-741c-4c93-96af-7a2a2a7e8426", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:55:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-9a54bd84-b7ef-4165-83fe-100f0c4b1520 req-84b750f9-d792-4524-80fe-0ca7420b0e93 service nova] Releasing lock "refresh_cache-09dc760e-2c5b-44d3-981a-6b74ae111a05" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:55:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "09dc760e-2c5b-44d3-981a-6b74ae111a05" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:55:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "09dc760e-2c5b-44d3-981a-6b74ae111a05" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:55:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "09dc760e-2c5b-44d3-981a-6b74ae111a05-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:55:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "09dc760e-2c5b-44d3-981a-6b74ae111a05-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:55:18 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "09dc760e-2c5b-44d3-981a-6b74ae111a05-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:55:18 user nova-compute[75745]: INFO nova.compute.manager [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Terminating instance
Dec 01 17:55:18 user nova-compute[75745]: DEBUG nova.compute.manager [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 17:55:18 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:55:18 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:55:18 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:55:18 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:55:18 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:55:18 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:55:18 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:55:19 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Instance destroyed successfully.
Dec 01 17:55:19 user nova-compute[75745]: DEBUG nova.objects.instance [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lazy-loading 'resources' on Instance uuid 09dc760e-2c5b-44d3-981a-6b74ae111a05 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:53:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-619583383',display_name='tempest-TestVolumeBootPattern-server-619583383',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-619583383',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaGASNmHMCwnU2klLf0QfxQKkLaqg8lTAnsQ0Y5f6gp+OHE5KzZXuaQ49yykKxI1uI1o6gFpR5UTiAPuJn79NKCW5llBvns9e77ft4Xdyu8bdbX9KVQYq2mh7DdUS5MFQ==',key_name='tempest-TestVolumeBootPattern-1177500877',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:53:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e92d35468e65461d8ac34cb6c1d19b68',ramdisk_id='',reservation_id='r-kegvpllw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1187866378',owner_user_name='tempest-TestVolumeBootPattern-1187866378-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:53:40Z,user_data=None,user_id='d79b4d42093f4a12aae4fb90bbbcba39',uuid=09dc760e-2c5b-44d3-981a-6b74ae111a05,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b6acdbb-741c-4c93-96af-7a2a2a7e8426", "address": "fa:16:3e:e7:f2:f0", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6acdbb-74", "ovs_interfaceid": "2b6acdbb-741c-4c93-96af-7a2a2a7e8426", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Converting VIF {"id": "2b6acdbb-741c-4c93-96af-7a2a2a7e8426", "address": "fa:16:3e:e7:f2:f0", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6acdbb-74", "ovs_interfaceid": "2b6acdbb-741c-4c93-96af-7a2a2a7e8426", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:f2:f0,bridge_name='br-int',has_traffic_filtering=True,id=2b6acdbb-741c-4c93-96af-7a2a2a7e8426,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b6acdbb-74') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG os_vif [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:f2:f0,bridge_name='br-int',has_traffic_filtering=True,id=2b6acdbb-741c-4c93-96af-7a2a2a7e8426,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b6acdbb-74') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b6acdbb-74, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=32a39407-ae47-424c-a36a-43eaff566f2c) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:55:19 user nova-compute[75745]: INFO os_vif [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:f2:f0,bridge_name='br-int',has_traffic_filtering=True,id=2b6acdbb-741c-4c93-96af-7a2a2a7e8426,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b6acdbb-74')
Dec 01 17:55:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gaGDeKsc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:55:19 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:55:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c551c25-c776-4707-a53b-8381fca3329c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 17:55:19 user nova-compute[75745]: No targets found.
Dec 01 17:55:19 user nova-compute[75745]: iSNS:
Dec 01 17:55:19 user nova-compute[75745]: No targets found.
Dec 01 17:55:19 user nova-compute[75745]: STATIC:
Dec 01 17:55:19 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657
Dec 01 17:55:19 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 17:55:19 user nova-compute[75745]:                 Iface Name: default
Dec 01 17:55:19 user nova-compute[75745]: FIRMWARE:
Dec 01 17:55:19 user nova-compute[75745]: No targets found.
Dec 01 17:55:19 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 17:55:19 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 17:55:19 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9c7e7d-82ff-4e91-a254-57da077d65ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4474c362-7055-48c8-8f64-92bea410e8de]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 (non-flash)
Dec 01 17:55:19 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 (non-flash)
Dec 01 17:55:19 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b87dfbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657'): ({'sdb'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Removing single pathed devices sdb {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[49934149-b8d4-45bb-b6a5-1294bd11add4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9dc1cd-8ecc-4edb-803e-36fc73faf9e2]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Flushing IO for device /dev/sdb {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b95f870-3de7-4dc0-a798-381e786959a9]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6696e0b-672e-4e62-ad30-609c1247cd23]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] SCSI volumes sdb have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[54010646-298d-4b65-8a3b-8f3df4ea2d44]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2015d920-119d-4994-b1d8-d343cd8c56de]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657, portal: 172.16.0.220,3260]
Dec 01 17:55:19 user nova-compute[75745]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657, portal: 172.16.0.220,3260] successful.
Dec 01 17:55:19 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10cdb5e-321f-4802-8adf-907331254693]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] <== disconnect_volume: return (282ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 17:55:19 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Deleting instance files /opt/stack/data/nova/instances/09dc760e-2c5b-44d3-981a-6b74ae111a05_del
Dec 01 17:55:19 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Deletion of /opt/stack/data/nova/instances/09dc760e-2c5b-44d3-981a-6b74ae111a05_del complete
Dec 01 17:55:19 user nova-compute[75745]: INFO nova.compute.manager [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Took 1.13 seconds to destroy the instance on the hypervisor.
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG nova.compute.manager [req-e48a5805-9a3a-47ec-a648-1e75be17367a req-93af57f7-5362-4d6c-b663-4164e968088c service nova] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Received event network-vif-unplugged-2b6acdbb-741c-4c93-96af-7a2a2a7e8426 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e48a5805-9a3a-47ec-a648-1e75be17367a req-93af57f7-5362-4d6c-b663-4164e968088c service nova] Acquiring lock "09dc760e-2c5b-44d3-981a-6b74ae111a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e48a5805-9a3a-47ec-a648-1e75be17367a req-93af57f7-5362-4d6c-b663-4164e968088c service nova] Lock "09dc760e-2c5b-44d3-981a-6b74ae111a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e48a5805-9a3a-47ec-a648-1e75be17367a req-93af57f7-5362-4d6c-b663-4164e968088c service nova] Lock "09dc760e-2c5b-44d3-981a-6b74ae111a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG nova.compute.manager [req-e48a5805-9a3a-47ec-a648-1e75be17367a req-93af57f7-5362-4d6c-b663-4164e968088c service nova] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] No waiting events found dispatching network-vif-unplugged-2b6acdbb-741c-4c93-96af-7a2a2a7e8426 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG nova.compute.manager [req-e48a5805-9a3a-47ec-a648-1e75be17367a req-93af57f7-5362-4d6c-b663-4164e968088c service nova] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Received event network-vif-unplugged-2b6acdbb-741c-4c93-96af-7a2a2a7e8426 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG nova.compute.manager [req-e48a5805-9a3a-47ec-a648-1e75be17367a req-93af57f7-5362-4d6c-b663-4164e968088c service nova] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Received event network-vif-plugged-2b6acdbb-741c-4c93-96af-7a2a2a7e8426 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e48a5805-9a3a-47ec-a648-1e75be17367a req-93af57f7-5362-4d6c-b663-4164e968088c service nova] Acquiring lock "09dc760e-2c5b-44d3-981a-6b74ae111a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e48a5805-9a3a-47ec-a648-1e75be17367a req-93af57f7-5362-4d6c-b663-4164e968088c service nova] Lock "09dc760e-2c5b-44d3-981a-6b74ae111a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-e48a5805-9a3a-47ec-a648-1e75be17367a req-93af57f7-5362-4d6c-b663-4164e968088c service nova] Lock "09dc760e-2c5b-44d3-981a-6b74ae111a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:55:19 user nova-compute[75745]: DEBUG nova.compute.manager [req-e48a5805-9a3a-47ec-a648-1e75be17367a req-93af57f7-5362-4d6c-b663-4164e968088c service nova] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] No waiting events found dispatching network-vif-plugged-2b6acdbb-741c-4c93-96af-7a2a2a7e8426 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:55:19 user nova-compute[75745]: WARNING nova.compute.manager [req-e48a5805-9a3a-47ec-a648-1e75be17367a req-93af57f7-5362-4d6c-b663-4164e968088c service nova] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Received unexpected event network-vif-plugged-2b6acdbb-741c-4c93-96af-7a2a2a7e8426 for instance with vm_state active and task_state deleting.
Dec 01 17:55:20 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:55:20 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Took 0.63 seconds to deallocate network for instance.
Dec 01 17:55:20 user nova-compute[75745]: DEBUG nova.compute.manager [req-2adadf22-f834-4f98-97ea-64bd24499c52 req-29217a64-0dec-40f8-ba24-b2e5d12e611a service nova] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Received event network-vif-deleted-2b6acdbb-741c-4c93-96af-7a2a2a7e8426 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:55:20 user nova-compute[75745]: INFO nova.compute.manager [req-2adadf22-f834-4f98-97ea-64bd24499c52 req-29217a64-0dec-40f8-ba24-b2e5d12e611a service nova] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Neutron deleted interface 2b6acdbb-741c-4c93-96af-7a2a2a7e8426; detaching it from the instance and deleting it from the info cache
Dec 01 17:55:20 user nova-compute[75745]: DEBUG nova.network.neutron [req-2adadf22-f834-4f98-97ea-64bd24499c52 req-29217a64-0dec-40f8-ba24-b2e5d12e611a service nova] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:55:20 user nova-compute[75745]: DEBUG nova.compute.manager [req-2adadf22-f834-4f98-97ea-64bd24499c52 req-29217a64-0dec-40f8-ba24-b2e5d12e611a service nova] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Detach interface failed, port_id=2b6acdbb-741c-4c93-96af-7a2a2a7e8426, reason: Instance 09dc760e-2c5b-44d3-981a-6b74ae111a05 could not be found. {{(pid=75745) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 17:55:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:55:21 user nova-compute[75745]: INFO nova.compute.manager [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: 09dc760e-2c5b-44d3-981a-6b74ae111a05] Took 0.81 seconds to detach 1 volumes for instance.
Dec 01 17:55:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:55:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:55:21 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:55:21 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:55:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.110s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:55:21 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Deleted allocations for instance 09dc760e-2c5b-44d3-981a-6b74ae111a05
Dec 01 17:55:21 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-10bee657-37d1-4c2d-b40f-47261b9cd223 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "09dc760e-2c5b-44d3-981a-6b74ae111a05" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.861s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:55:21 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:55:22 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:55:24 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:55:26 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:55:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:55:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:55:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:55:26 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:55:27 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:55:27 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:55:27 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=9089MB free_disk=25.075153350830078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:55:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:55:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:55:27 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:55:27 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:55:27 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:55:27 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:55:27 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:55:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.134s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:55:28 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:55:29 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:55:29 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:55:32 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:55:32 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:55:32 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Rebuilding the list of instances to heal {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 17:55:32 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Didn't find any instances for network info cache update. {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 17:55:34 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:55:39 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:55:44 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:55:49 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:55:54 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:55:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:56:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:56:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:56:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:56:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:56:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:56:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:56:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:56:09 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:56:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:56:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:56:10 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:56:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:56:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:56:10 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:56:10 user nova-compute[75745]: INFO nova.compute.claims [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Claim successful on node user
Dec 01 17:56:10 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:56:10 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:56:10 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.195s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:56:10 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:56:10 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:56:10 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:56:10 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:56:10 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:56:10 user nova-compute[75745]: INFO nova.virt.block_device [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Booting with volume f2678ee9-b674-4e35-a627-ff6605e0d657 at /dev/vda
Dec 01 17:56:11 user nova-compute[75745]: DEBUG nova.policy [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd79b4d42093f4a12aae4fb90bbbcba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d35468e65461d8ac34cb6c1d19b68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:56:11 user nova-compute[75745]: DEBUG os_brick.utils [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:56:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:56:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:56:11 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb42e82c-2828-4d18-b574-c5f0a2b06be1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:56:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:56:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:56:11 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4b4d54-0cf0-4fa3-b54d-f22fbef72a48]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:56:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:56:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:56:11 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[55db976e-be13-411b-9c99-a1d62cb0ebab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:56:11 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[997afc34-cf70-470e-a947-f0d670dec7e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:56:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:56:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:56:11 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:56:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:56:11 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:56:11 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:56:11 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8330ee0-9d64-4a7c-a1d0-2517831c4635]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:56:11 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:56:11 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:56:11 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:56:11 user nova-compute[75745]: DEBUG os_brick.utils [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:56:11 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Updating existing volume attachment record: a95d735e-2d48-4405-99a4-a4c3f2cd1107 {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:56:11 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Successfully created port: 63b53252-4217-4127-b17d-a240d2b1a565 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:56:12 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Successfully updated port: 63b53252-4217-4127-b17d-a240d2b1a565 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:56:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "refresh_cache-e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:56:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquired lock "refresh_cache-e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:56:12 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:56:12 user nova-compute[75745]: DEBUG nova.compute.manager [req-734989c1-c6c8-42cd-ae04-ffbd4c9a869a req-52eed238-b06b-4bdd-af97-8398f3fb129b service nova] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Received event network-changed-63b53252-4217-4127-b17d-a240d2b1a565 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:56:12 user nova-compute[75745]: DEBUG nova.compute.manager [req-734989c1-c6c8-42cd-ae04-ffbd4c9a869a req-52eed238-b06b-4bdd-af97-8398f3fb129b service nova] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Refreshing instance network info cache due to event network-changed-63b53252-4217-4127-b17d-a240d2b1a565. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:56:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-734989c1-c6c8-42cd-ae04-ffbd4c9a869a req-52eed238-b06b-4bdd-af97-8398f3fb129b service nova] Acquiring lock "refresh_cache-e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:56:12 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:56:12 user nova-compute[75745]: DEBUG nova.network.neutron [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Updating instance_info_cache with network_info: [{"id": "63b53252-4217-4127-b17d-a240d2b1a565", "address": "fa:16:3e:31:eb:bd", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b53252-42", "ovs_interfaceid": "63b53252-4217-4127-b17d-a240d2b1a565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:56:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Releasing lock "refresh_cache-e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:56:12 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Instance network_info: |[{"id": "63b53252-4217-4127-b17d-a240d2b1a565", "address": "fa:16:3e:31:eb:bd", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b53252-42", "ovs_interfaceid": "63b53252-4217-4127-b17d-a240d2b1a565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:56:12 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-734989c1-c6c8-42cd-ae04-ffbd4c9a869a req-52eed238-b06b-4bdd-af97-8398f3fb129b service nova] Acquired lock "refresh_cache-e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:56:12 user nova-compute[75745]: DEBUG nova.network.neutron [req-734989c1-c6c8-42cd-ae04-ffbd4c9a869a req-52eed238-b06b-4bdd-af97-8398f3fb129b service nova] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Refreshing network info cache for port 63b53252-4217-4127-b17d-a240d2b1a565 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:56:13 user nova-compute[75745]: DEBUG nova.network.neutron [req-734989c1-c6c8-42cd-ae04-ffbd4c9a869a req-52eed238-b06b-4bdd-af97-8398f3fb129b service nova] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Updated VIF entry in instance network info cache for port 63b53252-4217-4127-b17d-a240d2b1a565. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:56:13 user nova-compute[75745]: DEBUG nova.network.neutron [req-734989c1-c6c8-42cd-ae04-ffbd4c9a869a req-52eed238-b06b-4bdd-af97-8398f3fb129b service nova] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Updating instance_info_cache with network_info: [{"id": "63b53252-4217-4127-b17d-a240d2b1a565", "address": "fa:16:3e:31:eb:bd", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b53252-42", "ovs_interfaceid": "63b53252-4217-4127-b17d-a240d2b1a565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:56:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-734989c1-c6c8-42cd-ae04-ffbd4c9a869a req-52eed238-b06b-4bdd-af97-8398f3fb129b service nova] Releasing lock "refresh_cache-e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:56:14 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:56:18 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:56:19 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:56:20 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Creating image(s)
Dec 01 17:56:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Did not create local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Ensure instance console log exists: /opt/stack/data/nova/instances/e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Start _get_guest_xml network_info=[{"id": "63b53252-4217-4127-b17d-a240d2b1a565", "address": "fa:16:3e:31:eb:bd", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b53252-42", "ovs_interfaceid": "63b53252-4217-4127-b17d-a240d2b1a565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': 'a95d735e-2d48-4405-99a4-a4c3f2cd1107', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gaGDeKsc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0', 'attached_at': '', 'detached_at': '', 'volume_id': 'f2678ee9-b674-4e35-a627-ff6605e0d657', 'serial': 'f2678ee9-b674-4e35-a627-ff6605e0d657'}, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:56:20 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:56:20 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:56:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gaGDeKsc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:56:20 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:56:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:56:20 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:56:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:56:20 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67b4d33-e2db-4cb2-8bb4-c51caa3286e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:56:20 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd257237-8a31-412d-bd68-8942c6d09771]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657] added
Dec 01 17:56:20 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[109f06f3-34cd-42b3-a4cf-b1c922a3e248]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[00aa5c3b-a97a-441a-98b0-60c5ada0dbcf]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gaGDeKsc {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gaGDeKsc" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[210a0605-eb6d-4cb6-8d62-049d630ed1f5]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gaGDeKsc'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca5e31c-1150-4720-9f81-395a924930dd]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea3b684-9d08-4266-af57-46f36b618ce9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 01 17:56:20 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 01 17:56:20 user nova-compute[75745]:  {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:56:20 user nova-compute[75745]: WARNING os_brick.initiator.connectors.iscsi [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 01 17:56:20 user nova-compute[75745]: 
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bf2b55-3c73-4f6a-9bc1-69ccd0dd68ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657, portal: 172.16.0.220,3260]
Dec 01 17:56:20 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657, portal: 172.16.0.220,3260] successful.
Dec 01 17:56:20 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d42bb3c-f18d-4cb9-8b39-ce8fdd2abace]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb1358a-0f08-49f7-a9e2-1f9945792cff]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 (non-flash)
Dec 01 17:56:20 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 (non-flash)
Dec 01 17:56:20 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[25367742-cd47-4b63-af57-addf44be0f80]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gaGDeKsc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:56:20 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:56:21 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:56:21 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23761646330656532', 'path': '/dev/sdb'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:56:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761646330656532', 'path': '/dev/sdb'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:56:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:56:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-322196136',display_name='tempest-TestVolumeBootPattern-server-322196136',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-322196136',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaGASNmHMCwnU2klLf0QfxQKkLaqg8lTAnsQ0Y5f6gp+OHE5KzZXuaQ49yykKxI1uI1o6gFpR5UTiAPuJn79NKCW5llBvns9e77ft4Xdyu8bdbX9KVQYq2mh7DdUS5MFQ==',key_name='tempest-TestVolumeBootPattern-1177500877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e92d35468e65461d8ac34cb6c1d19b68',ramdisk_id='',reservation_id='r-z1un3bqc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1187866378',owner_user_name='tempest-TestVolumeBootPattern-1187866378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:56:11Z,user_data=None,user_id='d79b4d42093f4a12aae4fb90bbbcba39',uuid=e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63b53252-4217-4127-b17d-a240d2b1a565", "address": "fa:16:3e:31:eb:bd", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b53252-42", "ovs_interfaceid": "63b53252-4217-4127-b17d-a240d2b1a565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:56:21 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Converting VIF {"id": "63b53252-4217-4127-b17d-a240d2b1a565", "address": "fa:16:3e:31:eb:bd", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b53252-42", "ovs_interfaceid": "63b53252-4217-4127-b17d-a240d2b1a565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:56:21 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:eb:bd,bridge_name='br-int',has_traffic_filtering=True,id=63b53252-4217-4127-b17d-a240d2b1a565,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63b53252-42') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:56:21 user nova-compute[75745]: DEBUG nova.objects.instance [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lazy-loading 'pci_devices' on Instance uuid e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:56:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:56:21 user nova-compute[75745]:   <uuid>e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0</uuid>
Dec 01 17:56:21 user nova-compute[75745]:   <name>instance-00000033</name>
Dec 01 17:56:21 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:56:21 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:56:21 user nova-compute[75745]:   <metadata>
Dec 01 17:56:21 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:56:21 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:56:21 user nova-compute[75745]:       <nova:name>tempest-TestVolumeBootPattern-server-322196136</nova:name>
Dec 01 17:56:21 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:56:20</nova:creationTime>
Dec 01 17:56:21 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:56:21 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:56:21 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:56:21 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:56:21 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:56:21 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:56:21 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:56:21 user nova-compute[75745]:       <nova:owner>
Dec 01 17:56:21 user nova-compute[75745]:         <nova:user uuid="d79b4d42093f4a12aae4fb90bbbcba39">tempest-TestVolumeBootPattern-1187866378-project-member</nova:user>
Dec 01 17:56:21 user nova-compute[75745]:         <nova:project uuid="e92d35468e65461d8ac34cb6c1d19b68">tempest-TestVolumeBootPattern-1187866378</nova:project>
Dec 01 17:56:21 user nova-compute[75745]:       </nova:owner>
Dec 01 17:56:21 user nova-compute[75745]:       <nova:ports>
Dec 01 17:56:21 user nova-compute[75745]:         <nova:port uuid="63b53252-4217-4127-b17d-a240d2b1a565">
Dec 01 17:56:21 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 01 17:56:21 user nova-compute[75745]:         </nova:port>
Dec 01 17:56:21 user nova-compute[75745]:       </nova:ports>
Dec 01 17:56:21 user nova-compute[75745]:     </nova:instance>
Dec 01 17:56:21 user nova-compute[75745]:   </metadata>
Dec 01 17:56:21 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:56:21 user nova-compute[75745]:     <system>
Dec 01 17:56:21 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:56:21 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:56:21 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:56:21 user nova-compute[75745]:       <entry name="serial">e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0</entry>
Dec 01 17:56:21 user nova-compute[75745]:       <entry name="uuid">e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0</entry>
Dec 01 17:56:21 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:56:21 user nova-compute[75745]:     </system>
Dec 01 17:56:21 user nova-compute[75745]:   </sysinfo>
Dec 01 17:56:21 user nova-compute[75745]:   <os>
Dec 01 17:56:21 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:56:21 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:56:21 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:56:21 user nova-compute[75745]:   </os>
Dec 01 17:56:21 user nova-compute[75745]:   <features>
Dec 01 17:56:21 user nova-compute[75745]:     <acpi/>
Dec 01 17:56:21 user nova-compute[75745]:     <apic/>
Dec 01 17:56:21 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:56:21 user nova-compute[75745]:   </features>
Dec 01 17:56:21 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:56:21 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:56:21 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:56:21 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:56:21 user nova-compute[75745]:   </clock>
Dec 01 17:56:21 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:56:21 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:56:21 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:56:21 user nova-compute[75745]:   </cpu>
Dec 01 17:56:21 user nova-compute[75745]:   <devices>
Dec 01 17:56:21 user nova-compute[75745]:     <disk type="block" device="disk">
Dec 01 17:56:21 user nova-compute[75745]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:56:21 user nova-compute[75745]:       <source dev="/dev/sdb"/>
Dec 01 17:56:21 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:56:21 user nova-compute[75745]:       <serial>f2678ee9-b674-4e35-a627-ff6605e0d657</serial>
Dec 01 17:56:21 user nova-compute[75745]:     </disk>
Dec 01 17:56:21 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:56:21 user nova-compute[75745]:       <mac address="fa:16:3e:31:eb:bd"/>
Dec 01 17:56:21 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:56:21 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:56:21 user nova-compute[75745]:       <target dev="tap63b53252-42"/>
Dec 01 17:56:21 user nova-compute[75745]:     </interface>
Dec 01 17:56:21 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:56:21 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0/console.log" append="off"/>
Dec 01 17:56:21 user nova-compute[75745]:     </serial>
Dec 01 17:56:21 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:56:21 user nova-compute[75745]:     <video>
Dec 01 17:56:21 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:56:21 user nova-compute[75745]:     </video>
Dec 01 17:56:21 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:56:21 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:56:21 user nova-compute[75745]:     </rng>
Dec 01 17:56:21 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:56:21 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:56:21 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:56:21 user nova-compute[75745]:     </memballoon>
Dec 01 17:56:21 user nova-compute[75745]:   </devices>
Dec 01 17:56:21 user nova-compute[75745]: </domain>
Dec 01 17:56:21 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:56:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:56:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-322196136',display_name='tempest-TestVolumeBootPattern-server-322196136',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-322196136',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaGASNmHMCwnU2klLf0QfxQKkLaqg8lTAnsQ0Y5f6gp+OHE5KzZXuaQ49yykKxI1uI1o6gFpR5UTiAPuJn79NKCW5llBvns9e77ft4Xdyu8bdbX9KVQYq2mh7DdUS5MFQ==',key_name='tempest-TestVolumeBootPattern-1177500877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e92d35468e65461d8ac34cb6c1d19b68',ramdisk_id='',reservation_id='r-z1un3bqc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1187866378',owner_user_name='tempest-TestVolumeBootPattern-1187866378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:56:11Z,user_data=None,user_id='d79b4d42093f4a12aae4fb90bbbcba39',uuid=e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63b53252-4217-4127-b17d-a240d2b1a565", "address": "fa:16:3e:31:eb:bd", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b53252-42", "ovs_interfaceid": "63b53252-4217-4127-b17d-a240d2b1a565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:56:21 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Converting VIF {"id": "63b53252-4217-4127-b17d-a240d2b1a565", "address": "fa:16:3e:31:eb:bd", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b53252-42", "ovs_interfaceid": "63b53252-4217-4127-b17d-a240d2b1a565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:56:21 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:eb:bd,bridge_name='br-int',has_traffic_filtering=True,id=63b53252-4217-4127-b17d-a240d2b1a565,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63b53252-42') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:56:21 user nova-compute[75745]: DEBUG os_vif [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:eb:bd,bridge_name='br-int',has_traffic_filtering=True,id=63b53252-4217-4127-b17d-a240d2b1a565,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63b53252-42') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:56:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:56:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:56:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:56:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:56:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '88cc403c-2aea-54ff-ad19-1ae59a650b71', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:56:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:56:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:56:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:56:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63b53252-42, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:56:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap63b53252-42, col_values=(('qos', UUID('c5444e03-205d-49e3-9049-291ae4d04339')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:56:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap63b53252-42, col_values=(('external_ids', {'iface-id': '63b53252-4217-4127-b17d-a240d2b1a565', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:eb:bd', 'vm-uuid': 'e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:56:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:56:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:56:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:56:21 user nova-compute[75745]: INFO os_vif [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:eb:bd,bridge_name='br-int',has_traffic_filtering=True,id=63b53252-4217-4127-b17d-a240d2b1a565,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63b53252-42')
Dec 01 17:56:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:56:21 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] No VIF found with MAC fa:16:3e:31:eb:bd, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:56:21 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:56:21 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:56:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:56:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:56:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:56:23 user nova-compute[75745]: DEBUG nova.compute.manager [req-2ce0e04c-0dbf-42fe-9a34-f10254a30f27 req-b73f01a0-b1ef-466e-b810-80525feac2d1 service nova] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Received event network-vif-plugged-63b53252-4217-4127-b17d-a240d2b1a565 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:56:23 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2ce0e04c-0dbf-42fe-9a34-f10254a30f27 req-b73f01a0-b1ef-466e-b810-80525feac2d1 service nova] Acquiring lock "e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:56:23 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2ce0e04c-0dbf-42fe-9a34-f10254a30f27 req-b73f01a0-b1ef-466e-b810-80525feac2d1 service nova] Lock "e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:56:23 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2ce0e04c-0dbf-42fe-9a34-f10254a30f27 req-b73f01a0-b1ef-466e-b810-80525feac2d1 service nova] Lock "e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:56:23 user nova-compute[75745]: DEBUG nova.compute.manager [req-2ce0e04c-0dbf-42fe-9a34-f10254a30f27 req-b73f01a0-b1ef-466e-b810-80525feac2d1 service nova] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] No waiting events found dispatching network-vif-plugged-63b53252-4217-4127-b17d-a240d2b1a565 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:56:23 user nova-compute[75745]: WARNING nova.compute.manager [req-2ce0e04c-0dbf-42fe-9a34-f10254a30f27 req-b73f01a0-b1ef-466e-b810-80525feac2d1 service nova] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Received unexpected event network-vif-plugged-63b53252-4217-4127-b17d-a240d2b1a565 for instance with vm_state building and task_state spawning.
Dec 01 17:56:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:56:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:56:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:56:23 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:56:25 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:56:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:56:25 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Instance spawned successfully.
Dec 01 17:56:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:56:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:56:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:56:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:56:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:56:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:56:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:56:25 user nova-compute[75745]: INFO nova.compute.manager [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Took 4.83 seconds to spawn the instance on the hypervisor.
Dec 01 17:56:25 user nova-compute[75745]: DEBUG nova.compute.manager [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:56:25 user nova-compute[75745]: INFO nova.compute.manager [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Took 14.59 seconds to build instance.
Dec 01 17:56:25 user nova-compute[75745]: DEBUG nova.compute.manager [req-a2feeab3-ea35-4dd3-bff1-1302ad746f35 req-a61ccb04-407a-4cc8-b9a0-60fa0cdb7f66 service nova] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Received event network-vif-plugged-63b53252-4217-4127-b17d-a240d2b1a565 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:56:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a2feeab3-ea35-4dd3-bff1-1302ad746f35 req-a61ccb04-407a-4cc8-b9a0-60fa0cdb7f66 service nova] Acquiring lock "e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:56:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a2feeab3-ea35-4dd3-bff1-1302ad746f35 req-a61ccb04-407a-4cc8-b9a0-60fa0cdb7f66 service nova] Lock "e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:56:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-a2feeab3-ea35-4dd3-bff1-1302ad746f35 req-a61ccb04-407a-4cc8-b9a0-60fa0cdb7f66 service nova] Lock "e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:56:25 user nova-compute[75745]: DEBUG nova.compute.manager [req-a2feeab3-ea35-4dd3-bff1-1302ad746f35 req-a61ccb04-407a-4cc8-b9a0-60fa0cdb7f66 service nova] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] No waiting events found dispatching network-vif-plugged-63b53252-4217-4127-b17d-a240d2b1a565 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:56:25 user nova-compute[75745]: WARNING nova.compute.manager [req-a2feeab3-ea35-4dd3-bff1-1302ad746f35 req-a61ccb04-407a-4cc8-b9a0-60fa0cdb7f66 service nova] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Received unexpected event network-vif-plugged-63b53252-4217-4127-b17d-a240d2b1a565 for instance with vm_state active and task_state None.
Dec 01 17:56:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-d6d4ec49-8fa6-4e16-be5d-09cd5db7b9e5 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.684s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:56:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:56:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:56:26 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:56:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:56:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:56:26 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:56:26 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:56:26 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:56:27 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:56:27 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:56:27 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=9048MB free_disk=25.073551177978516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:56:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:56:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:56:27 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:56:27 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:56:27 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:56:27 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:56:27 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:56:27 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:56:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.235s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:56:30 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:56:30 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:56:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:56:33 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:56:33 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:56:33 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Rebuilding the list of instances to heal {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 17:56:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:56:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:56:34 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:56:34 user nova-compute[75745]: DEBUG nova.objects.instance [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lazy-loading 'info_cache' on Instance uuid e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:56:34 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Updating instance_info_cache with network_info: [{"id": "63b53252-4217-4127-b17d-a240d2b1a565", "address": "fa:16:3e:31:eb:bd", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b53252-42", "ovs_interfaceid": "63b53252-4217-4127-b17d-a240d2b1a565", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:56:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:56:34 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:56:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:56:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:56:41 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:56:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:56:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:56:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:56:51 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:56:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:56:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:56:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:57:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:57:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:57:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:57:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:57:16 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:57:19 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:57:20 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:57:20 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:57:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:57:23 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:57:23 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:57:24 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:57:26 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:57:26 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:57:26 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Cleaning up deleted instances {{(pid=75745) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 01 17:57:26 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] There are 0 instances to clean {{(pid=75745) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 01 17:57:27 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:57:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:57:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:57:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:57:27 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:57:28 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:57:28 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:57:28 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:57:28 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=8977MB free_disk=25.07290267944336GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:57:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:57:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:57:28 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:57:28 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:57:28 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:57:28 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:57:28 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:57:28 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:57:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:57:30 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:57:31 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:57:31 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:57:34 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:57:34 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:57:34 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Rebuilding the list of instances to heal {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 17:57:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:57:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:57:34 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:57:34 user nova-compute[75745]: DEBUG nova.objects.instance [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lazy-loading 'info_cache' on Instance uuid e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:57:35 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Updating instance_info_cache with network_info: [{"id": "63b53252-4217-4127-b17d-a240d2b1a565", "address": "fa:16:3e:31:eb:bd", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b53252-42", "ovs_interfaceid": "63b53252-4217-4127-b17d-a240d2b1a565", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:57:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:57:35 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:57:36 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:57:41 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:57:44 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:57:44 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75745) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 01 17:57:46 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:57:51 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:57:56 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:58:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:58:01 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:58:02 user nova-compute[75745]: DEBUG nova.compute.manager [req-2236509d-30f4-4619-bf74-be91f8e11733 req-4fbbaf71-503b-4af6-bcdf-b851005d57e5 service nova] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Received event network-changed-63b53252-4217-4127-b17d-a240d2b1a565 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:58:02 user nova-compute[75745]: DEBUG nova.compute.manager [req-2236509d-30f4-4619-bf74-be91f8e11733 req-4fbbaf71-503b-4af6-bcdf-b851005d57e5 service nova] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Refreshing instance network info cache due to event network-changed-63b53252-4217-4127-b17d-a240d2b1a565. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:58:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2236509d-30f4-4619-bf74-be91f8e11733 req-4fbbaf71-503b-4af6-bcdf-b851005d57e5 service nova] Acquiring lock "refresh_cache-e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:58:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2236509d-30f4-4619-bf74-be91f8e11733 req-4fbbaf71-503b-4af6-bcdf-b851005d57e5 service nova] Acquired lock "refresh_cache-e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:58:02 user nova-compute[75745]: DEBUG nova.network.neutron [req-2236509d-30f4-4619-bf74-be91f8e11733 req-4fbbaf71-503b-4af6-bcdf-b851005d57e5 service nova] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Refreshing network info cache for port 63b53252-4217-4127-b17d-a240d2b1a565 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:58:02 user nova-compute[75745]: DEBUG nova.network.neutron [req-2236509d-30f4-4619-bf74-be91f8e11733 req-4fbbaf71-503b-4af6-bcdf-b851005d57e5 service nova] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Updated VIF entry in instance network info cache for port 63b53252-4217-4127-b17d-a240d2b1a565. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:58:02 user nova-compute[75745]: DEBUG nova.network.neutron [req-2236509d-30f4-4619-bf74-be91f8e11733 req-4fbbaf71-503b-4af6-bcdf-b851005d57e5 service nova] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Updating instance_info_cache with network_info: [{"id": "63b53252-4217-4127-b17d-a240d2b1a565", "address": "fa:16:3e:31:eb:bd", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b53252-42", "ovs_interfaceid": "63b53252-4217-4127-b17d-a240d2b1a565", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:58:02 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-2236509d-30f4-4619-bf74-be91f8e11733 req-4fbbaf71-503b-4af6-bcdf-b851005d57e5 service nova] Releasing lock "refresh_cache-e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:58:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:58:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:58:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:58:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "f1ddf6af-57d7-4a4a-a39c-b521279d4c77" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:58:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "f1ddf6af-57d7-4a4a-a39c-b521279d4c77" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:58:11 user nova-compute[75745]: DEBUG nova.compute.manager [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Starting instance... {{(pid=75745) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 17:58:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:58:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:58:11 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75745) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 17:58:11 user nova-compute[75745]: INFO nova.compute.claims [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Claim successful on node user
Dec 01 17:58:11 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:58:11 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:58:11 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:58:11 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.209s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:58:11 user nova-compute[75745]: DEBUG nova.compute.manager [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Start building networks asynchronously for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 17:58:11 user nova-compute[75745]: DEBUG nova.compute.manager [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Allocating IP information in the background. {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 17:58:11 user nova-compute[75745]: DEBUG nova.network.neutron [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] allocate_for_instance() {{(pid=75745) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 17:58:11 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 17:58:11 user nova-compute[75745]: DEBUG nova.compute.manager [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Start building block device mappings for instance. {{(pid=75745) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 17:58:11 user nova-compute[75745]: DEBUG nova.policy [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd79b4d42093f4a12aae4fb90bbbcba39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d35468e65461d8ac34cb6c1d19b68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75745) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 17:58:12 user nova-compute[75745]: INFO nova.virt.block_device [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Booting with volume b6f521d3-0989-4a48-95c8-1e12c2d608a7 at /dev/vda
Dec 01 17:58:12 user nova-compute[75745]: DEBUG os_brick.utils [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:58:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:58:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:58:12 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[c189b2e5-8134-4b02-a802-55b29834574e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:cfa0796beb4a\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:58:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:58:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:58:12 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0480c69-fbdb-4a4a-ba1a-9dbbb2969b6e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:58:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:58:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:58:12 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f922fde2-98f8-4225-957b-a258d6d4743a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:58:12 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b47a32f-ee05-4560-a50b-7dec66a4838a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:58:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Running cmd (subprocess): nvme version {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:58:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] 'nvme version' failed. Not Retrying. {{(pid=75745) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:58:12 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] nvme not present on system {{(pid=75745) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 17:58:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:58:12 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 17:58:12 user nova-compute[75745]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 17:58:12 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[f579cc5f-bd77-4bdd-8698-d4144640f48b]: (4, '') {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:58:12 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75745) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 17:58:12 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 17:58:12 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.lightos [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] LIGHTOS: no hostnqn found. {{(pid=75745) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 17:58:12 user nova-compute[75745]: DEBUG os_brick.utils [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:cfa0796beb4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:58:12 user nova-compute[75745]: DEBUG nova.virt.block_device [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Updating existing volume attachment record: 4f4af939-ce2a-492a-80a3-df0c6e730dc5 {{(pid=75745) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 17:58:12 user nova-compute[75745]: DEBUG nova.network.neutron [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Successfully created port: 940ba7be-507d-4521-8f5c-e581cbbaea75 {{(pid=75745) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 17:58:13 user nova-compute[75745]: DEBUG nova.network.neutron [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Successfully updated port: 940ba7be-507d-4521-8f5c-e581cbbaea75 {{(pid=75745) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 17:58:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "refresh_cache-f1ddf6af-57d7-4a4a-a39c-b521279d4c77" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:58:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquired lock "refresh_cache-f1ddf6af-57d7-4a4a-a39c-b521279d4c77" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:58:13 user nova-compute[75745]: DEBUG nova.network.neutron [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Building network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 17:58:13 user nova-compute[75745]: DEBUG nova.compute.manager [req-0ef9c571-f6b4-43c3-b3ed-253d7e45878e req-543488a0-5ca7-413a-a5f7-e0350423861d service nova] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Received event network-changed-940ba7be-507d-4521-8f5c-e581cbbaea75 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:58:13 user nova-compute[75745]: DEBUG nova.compute.manager [req-0ef9c571-f6b4-43c3-b3ed-253d7e45878e req-543488a0-5ca7-413a-a5f7-e0350423861d service nova] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Refreshing instance network info cache due to event network-changed-940ba7be-507d-4521-8f5c-e581cbbaea75. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 17:58:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0ef9c571-f6b4-43c3-b3ed-253d7e45878e req-543488a0-5ca7-413a-a5f7-e0350423861d service nova] Acquiring lock "refresh_cache-f1ddf6af-57d7-4a4a-a39c-b521279d4c77" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:58:13 user nova-compute[75745]: DEBUG nova.network.neutron [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Instance cache missing network info. {{(pid=75745) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 17:58:13 user nova-compute[75745]: DEBUG nova.network.neutron [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Updating instance_info_cache with network_info: [{"id": "940ba7be-507d-4521-8f5c-e581cbbaea75", "address": "fa:16:3e:93:60:3a", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap940ba7be-50", "ovs_interfaceid": "940ba7be-507d-4521-8f5c-e581cbbaea75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:58:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Releasing lock "refresh_cache-f1ddf6af-57d7-4a4a-a39c-b521279d4c77" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:58:13 user nova-compute[75745]: DEBUG nova.compute.manager [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Instance network_info: |[{"id": "940ba7be-507d-4521-8f5c-e581cbbaea75", "address": "fa:16:3e:93:60:3a", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap940ba7be-50", "ovs_interfaceid": "940ba7be-507d-4521-8f5c-e581cbbaea75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75745) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 17:58:13 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0ef9c571-f6b4-43c3-b3ed-253d7e45878e req-543488a0-5ca7-413a-a5f7-e0350423861d service nova] Acquired lock "refresh_cache-f1ddf6af-57d7-4a4a-a39c-b521279d4c77" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:58:13 user nova-compute[75745]: DEBUG nova.network.neutron [req-0ef9c571-f6b4-43c3-b3ed-253d7e45878e req-543488a0-5ca7-413a-a5f7-e0350423861d service nova] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Refreshing network info cache for port 940ba7be-507d-4521-8f5c-e581cbbaea75 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 17:58:14 user nova-compute[75745]: DEBUG nova.network.neutron [req-0ef9c571-f6b4-43c3-b3ed-253d7e45878e req-543488a0-5ca7-413a-a5f7-e0350423861d service nova] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Updated VIF entry in instance network info cache for port 940ba7be-507d-4521-8f5c-e581cbbaea75. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 17:58:14 user nova-compute[75745]: DEBUG nova.network.neutron [req-0ef9c571-f6b4-43c3-b3ed-253d7e45878e req-543488a0-5ca7-413a-a5f7-e0350423861d service nova] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Updating instance_info_cache with network_info: [{"id": "940ba7be-507d-4521-8f5c-e581cbbaea75", "address": "fa:16:3e:93:60:3a", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap940ba7be-50", "ovs_interfaceid": "940ba7be-507d-4521-8f5c-e581cbbaea75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:58:14 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-0ef9c571-f6b4-43c3-b3ed-253d7e45878e req-543488a0-5ca7-413a-a5f7-e0350423861d service nova] Releasing lock "refresh_cache-f1ddf6af-57d7-4a4a-a39c-b521279d4c77" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:58:16 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:58:20 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:58:20 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:58:20 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:58:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:58:20 user nova-compute[75745]: DEBUG nova.compute.manager [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Start spawning the instance on the hypervisor. {{(pid=75745) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 17:58:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Creating instance directory {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 17:58:20 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Creating image(s)
Dec 01 17:58:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Did not create local disks {{(pid=75745) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 17:58:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Ensure instance console log exists: /opt/stack/data/nova/instances/f1ddf6af-57d7-4a4a-a39c-b521279d4c77/console.log {{(pid=75745) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 17:58:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:58:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:58:20 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:58:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Start _get_guest_xml network_info=[{"id": "940ba7be-507d-4521-8f5c-e581cbbaea75", "address": "fa:16:3e:93:60:3a", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap940ba7be-50", "ovs_interfaceid": "940ba7be-507d-4521-8f5c-e581cbbaea75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'attachment_id': '4f4af939-ce2a-492a-80a3-df0c6e730dc5', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EDoUaZgK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f1ddf6af-57d7-4a4a-a39c-b521279d4c77', 'attached_at': '', 'detached_at': '', 'volume_id': 'b6f521d3-0989-4a48-95c8-1e12c2d608a7', 'serial': 'b6f521d3-0989-4a48-95c8-1e12c2d608a7'}, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 17:58:20 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:58:20 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:58:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 17:58:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] CPU controller missing on host. {{(pid=75745) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 17:58:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 17:58:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.host [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] CPU controller found on host. {{(pid=75745) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 17:58:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75745) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 17:58:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T17:01:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 17:58:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Flavor limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 17:58:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Image limits 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 17:58:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Flavor pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 17:58:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Image pref 0:0:0 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 17:58:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75745) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 17:58:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 17:58:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 17:58:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Got 1 possible topologies {{(pid=75745) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 17:58:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 17:58:20 user nova-compute[75745]: DEBUG nova.virt.hardware [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75745) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 17:58:20 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Calling os-brick to attach iSCSI Volume {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 17:58:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EDoUaZgK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 17:58:20 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:58:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:58:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:58:20 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 17:58:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 17:58:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 17:58:20 user nova-compute[75745]: INFO os_brick.initiator.connectors.iscsi [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 17:58:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7 -p 172.16.0.220:3260 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:58:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:58:20 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b296380-63e0-4869-8a1f-7b6ed02ee57c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:58:20 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 17:58:20 user nova-compute[75745]:  {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:58:20 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5730bf-ba6f-4ed7-bf73-595caa3cc425]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7] added\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7] added
Dec 01 17:58:21 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ca11f1-7075-43a4-b8d2-a8db8b53a3ca]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[048a2677-db93-47d9-9b3f-b50fcd88c760]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EDoUaZgK {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EDoUaZgK" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ba1600-22b6-45c2-b0c3-9c6c8747d876]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EDoUaZgK'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb710411-9943-4889-a156-9992c168d37e]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7f68d2-d6e9-4a0c-a013-e666ea2aff1a]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 (non-flash)
Dec 01 17:58:21 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 (non-flash)
Dec 01 17:58:21 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7 -p 172.16.0.220:3260 --login {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2543ff98-45e5-4caa-b268-3b15a72d3bfc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7, portal: 172.16.0.220,3260]
Dec 01 17:58:21 user nova-compute[75745]: Login to [iface: default, target: iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7, portal: 172.16.0.220,3260] successful.
Dec 01 17:58:21 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83a7e48-7a7c-44c7-ac4f-e5b624a1bfe8]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[a407ad2b-2a76-4b44-b6f0-79353ea8f434]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 (non-flash)
Dec 01 17:58:21 user nova-compute[75745]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7 (non-flash)
Dec 01 17:58:21 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 (non-flash)
Dec 01 17:58:21 user nova-compute[75745]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7 (non-flash)
Dec 01 17:58:21 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Connected to 172.16.0.220:3260 {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=75745) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75745) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00aac71-f2cf-4c4a-b3b1-b8078433261e]: (4, ('- - 0', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: None {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:58:21 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:58:22 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75745) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 17:58:22 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EDoUaZgK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75745) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 17:58:22 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 17:58:22 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23666373934653130', 'path': '/dev/sdc'} {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 17:58:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666373934653130', 'path': '/dev/sdc'} {{(pid=75745) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 17:58:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:58:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1072430498',display_name='tempest-TestVolumeBootPattern-server-1072430498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1072430498',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaGASNmHMCwnU2klLf0QfxQKkLaqg8lTAnsQ0Y5f6gp+OHE5KzZXuaQ49yykKxI1uI1o6gFpR5UTiAPuJn79NKCW5llBvns9e77ft4Xdyu8bdbX9KVQYq2mh7DdUS5MFQ==',key_name='tempest-TestVolumeBootPattern-1177500877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e92d35468e65461d8ac34cb6c1d19b68',ramdisk_id='',reservation_id='r-vf6wjqgv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1187866378',owner_user_name='tempest-TestVolumeBootPattern-1187866378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:58:12Z,user_data=None,user_id='d79b4d42093f4a12aae4fb90bbbcba39',uuid=f1ddf6af-57d7-4a4a-a39c-b521279d4c77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "940ba7be-507d-4521-8f5c-e581cbbaea75", "address": "fa:16:3e:93:60:3a", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap940ba7be-50", "ovs_interfaceid": "940ba7be-507d-4521-8f5c-e581cbbaea75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75745) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 17:58:22 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Converting VIF {"id": "940ba7be-507d-4521-8f5c-e581cbbaea75", "address": "fa:16:3e:93:60:3a", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap940ba7be-50", "ovs_interfaceid": "940ba7be-507d-4521-8f5c-e581cbbaea75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:58:22 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:60:3a,bridge_name='br-int',has_traffic_filtering=True,id=940ba7be-507d-4521-8f5c-e581cbbaea75,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap940ba7be-50') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:58:22 user nova-compute[75745]: DEBUG nova.objects.instance [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lazy-loading 'pci_devices' on Instance uuid f1ddf6af-57d7-4a4a-a39c-b521279d4c77 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:58:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] End _get_guest_xml xml=<domain type="kvm">
Dec 01 17:58:22 user nova-compute[75745]:   <uuid>f1ddf6af-57d7-4a4a-a39c-b521279d4c77</uuid>
Dec 01 17:58:22 user nova-compute[75745]:   <name>instance-00000034</name>
Dec 01 17:58:22 user nova-compute[75745]:   <memory>524288</memory>
Dec 01 17:58:22 user nova-compute[75745]:   <vcpu>1</vcpu>
Dec 01 17:58:22 user nova-compute[75745]:   <metadata>
Dec 01 17:58:22 user nova-compute[75745]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 17:58:22 user nova-compute[75745]:       <nova:package version="0.0.0"/>
Dec 01 17:58:22 user nova-compute[75745]:       <nova:name>tempest-TestVolumeBootPattern-server-1072430498</nova:name>
Dec 01 17:58:22 user nova-compute[75745]:       <nova:creationTime>2023-12-01 17:58:20</nova:creationTime>
Dec 01 17:58:22 user nova-compute[75745]:       <nova:flavor name="m1.tiny">
Dec 01 17:58:22 user nova-compute[75745]:         <nova:memory>512</nova:memory>
Dec 01 17:58:22 user nova-compute[75745]:         <nova:disk>1</nova:disk>
Dec 01 17:58:22 user nova-compute[75745]:         <nova:swap>0</nova:swap>
Dec 01 17:58:22 user nova-compute[75745]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 17:58:22 user nova-compute[75745]:         <nova:vcpus>1</nova:vcpus>
Dec 01 17:58:22 user nova-compute[75745]:       </nova:flavor>
Dec 01 17:58:22 user nova-compute[75745]:       <nova:owner>
Dec 01 17:58:22 user nova-compute[75745]:         <nova:user uuid="d79b4d42093f4a12aae4fb90bbbcba39">tempest-TestVolumeBootPattern-1187866378-project-member</nova:user>
Dec 01 17:58:22 user nova-compute[75745]:         <nova:project uuid="e92d35468e65461d8ac34cb6c1d19b68">tempest-TestVolumeBootPattern-1187866378</nova:project>
Dec 01 17:58:22 user nova-compute[75745]:       </nova:owner>
Dec 01 17:58:22 user nova-compute[75745]:       <nova:ports>
Dec 01 17:58:22 user nova-compute[75745]:         <nova:port uuid="940ba7be-507d-4521-8f5c-e581cbbaea75">
Dec 01 17:58:22 user nova-compute[75745]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 01 17:58:22 user nova-compute[75745]:         </nova:port>
Dec 01 17:58:22 user nova-compute[75745]:       </nova:ports>
Dec 01 17:58:22 user nova-compute[75745]:     </nova:instance>
Dec 01 17:58:22 user nova-compute[75745]:   </metadata>
Dec 01 17:58:22 user nova-compute[75745]:   <sysinfo type="smbios">
Dec 01 17:58:22 user nova-compute[75745]:     <system>
Dec 01 17:58:22 user nova-compute[75745]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 17:58:22 user nova-compute[75745]:       <entry name="product">OpenStack Nova</entry>
Dec 01 17:58:22 user nova-compute[75745]:       <entry name="version">0.0.0</entry>
Dec 01 17:58:22 user nova-compute[75745]:       <entry name="serial">f1ddf6af-57d7-4a4a-a39c-b521279d4c77</entry>
Dec 01 17:58:22 user nova-compute[75745]:       <entry name="uuid">f1ddf6af-57d7-4a4a-a39c-b521279d4c77</entry>
Dec 01 17:58:22 user nova-compute[75745]:       <entry name="family">Virtual Machine</entry>
Dec 01 17:58:22 user nova-compute[75745]:     </system>
Dec 01 17:58:22 user nova-compute[75745]:   </sysinfo>
Dec 01 17:58:22 user nova-compute[75745]:   <os>
Dec 01 17:58:22 user nova-compute[75745]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 17:58:22 user nova-compute[75745]:     <boot dev="hd"/>
Dec 01 17:58:22 user nova-compute[75745]:     <smbios mode="sysinfo"/>
Dec 01 17:58:22 user nova-compute[75745]:   </os>
Dec 01 17:58:22 user nova-compute[75745]:   <features>
Dec 01 17:58:22 user nova-compute[75745]:     <acpi/>
Dec 01 17:58:22 user nova-compute[75745]:     <apic/>
Dec 01 17:58:22 user nova-compute[75745]:     <vmcoreinfo/>
Dec 01 17:58:22 user nova-compute[75745]:   </features>
Dec 01 17:58:22 user nova-compute[75745]:   <clock offset="utc">
Dec 01 17:58:22 user nova-compute[75745]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 17:58:22 user nova-compute[75745]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 17:58:22 user nova-compute[75745]:     <timer name="hpet" present="no"/>
Dec 01 17:58:22 user nova-compute[75745]:   </clock>
Dec 01 17:58:22 user nova-compute[75745]:   <cpu mode="custom" match="exact">
Dec 01 17:58:22 user nova-compute[75745]:     <model>Nehalem</model>
Dec 01 17:58:22 user nova-compute[75745]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 17:58:22 user nova-compute[75745]:   </cpu>
Dec 01 17:58:22 user nova-compute[75745]:   <devices>
Dec 01 17:58:22 user nova-compute[75745]:     <disk type="block" device="disk">
Dec 01 17:58:22 user nova-compute[75745]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 17:58:22 user nova-compute[75745]:       <source dev="/dev/sdc"/>
Dec 01 17:58:22 user nova-compute[75745]:       <target dev="vda" bus="virtio"/>
Dec 01 17:58:22 user nova-compute[75745]:       <serial>b6f521d3-0989-4a48-95c8-1e12c2d608a7</serial>
Dec 01 17:58:22 user nova-compute[75745]:     </disk>
Dec 01 17:58:22 user nova-compute[75745]:     <interface type="ethernet">
Dec 01 17:58:22 user nova-compute[75745]:       <mac address="fa:16:3e:93:60:3a"/>
Dec 01 17:58:22 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:58:22 user nova-compute[75745]:       <mtu size="1442"/>
Dec 01 17:58:22 user nova-compute[75745]:       <target dev="tap940ba7be-50"/>
Dec 01 17:58:22 user nova-compute[75745]:     </interface>
Dec 01 17:58:22 user nova-compute[75745]:     <serial type="pty">
Dec 01 17:58:22 user nova-compute[75745]:       <log file="/opt/stack/data/nova/instances/f1ddf6af-57d7-4a4a-a39c-b521279d4c77/console.log" append="off"/>
Dec 01 17:58:22 user nova-compute[75745]:     </serial>
Dec 01 17:58:22 user nova-compute[75745]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 17:58:22 user nova-compute[75745]:     <video>
Dec 01 17:58:22 user nova-compute[75745]:       <model type="virtio"/>
Dec 01 17:58:22 user nova-compute[75745]:     </video>
Dec 01 17:58:22 user nova-compute[75745]:     <rng model="virtio">
Dec 01 17:58:22 user nova-compute[75745]:       <backend model="random">/dev/urandom</backend>
Dec 01 17:58:22 user nova-compute[75745]:     </rng>
Dec 01 17:58:22 user nova-compute[75745]:     <controller type="usb" index="0" model="none"/>
Dec 01 17:58:22 user nova-compute[75745]:     <memballoon model="virtio">
Dec 01 17:58:22 user nova-compute[75745]:       <stats period="10"/>
Dec 01 17:58:22 user nova-compute[75745]:     </memballoon>
Dec 01 17:58:22 user nova-compute[75745]:   </devices>
Dec 01 17:58:22 user nova-compute[75745]: </domain>
Dec 01 17:58:22 user nova-compute[75745]:  {{(pid=75745) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 17:58:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:58:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1072430498',display_name='tempest-TestVolumeBootPattern-server-1072430498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1072430498',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaGASNmHMCwnU2klLf0QfxQKkLaqg8lTAnsQ0Y5f6gp+OHE5KzZXuaQ49yykKxI1uI1o6gFpR5UTiAPuJn79NKCW5llBvns9e77ft4Xdyu8bdbX9KVQYq2mh7DdUS5MFQ==',key_name='tempest-TestVolumeBootPattern-1177500877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e92d35468e65461d8ac34cb6c1d19b68',ramdisk_id='',reservation_id='r-vf6wjqgv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1187866378',owner_user_name='tempest-TestVolumeBootPattern-1187866378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T17:58:12Z,user_data=None,user_id='d79b4d42093f4a12aae4fb90bbbcba39',uuid=f1ddf6af-57d7-4a4a-a39c-b521279d4c77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "940ba7be-507d-4521-8f5c-e581cbbaea75", "address": "fa:16:3e:93:60:3a", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap940ba7be-50", "ovs_interfaceid": "940ba7be-507d-4521-8f5c-e581cbbaea75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 17:58:22 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Converting VIF {"id": "940ba7be-507d-4521-8f5c-e581cbbaea75", "address": "fa:16:3e:93:60:3a", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap940ba7be-50", "ovs_interfaceid": "940ba7be-507d-4521-8f5c-e581cbbaea75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 17:58:22 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:60:3a,bridge_name='br-int',has_traffic_filtering=True,id=940ba7be-507d-4521-8f5c-e581cbbaea75,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap940ba7be-50') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 17:58:22 user nova-compute[75745]: DEBUG os_vif [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:60:3a,bridge_name='br-int',has_traffic_filtering=True,id=940ba7be-507d-4521-8f5c-e581cbbaea75,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap940ba7be-50') {{(pid=75745) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 17:58:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:58:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:58:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 17:58:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:58:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec97e7be-2a3a-5dc3-82ed-1340b06129ee', '_type': 'linux-noop'}}, row=False) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:58:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:58:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:58:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:58:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap940ba7be-50, may_exist=True, interface_attrs={}) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:58:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap940ba7be-50, col_values=(('qos', UUID('83ee3716-7e23-4108-96cc-ef821a799765')),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:58:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap940ba7be-50, col_values=(('external_ids', {'iface-id': '940ba7be-507d-4521-8f5c-e581cbbaea75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:60:3a', 'vm-uuid': 'f1ddf6af-57d7-4a4a-a39c-b521279d4c77'}),), if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 17:58:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:58:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:58:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:58:22 user nova-compute[75745]: INFO os_vif [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:60:3a,bridge_name='br-int',has_traffic_filtering=True,id=940ba7be-507d-4521-8f5c-e581cbbaea75,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap940ba7be-50')
Dec 01 17:58:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] No BDM found with device name vda, not building metadata. {{(pid=75745) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 17:58:22 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] No VIF found with MAC fa:16:3e:93:60:3a, not building metadata {{(pid=75745) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 17:58:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:58:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:58:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:58:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:58:23 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:58:23 user nova-compute[75745]: DEBUG nova.compute.manager [req-3f727ad2-ed6a-4570-887e-a1bf27c03253 req-4d498088-a168-4a8a-9dcd-adbed47a7600 service nova] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Received event network-vif-plugged-940ba7be-507d-4521-8f5c-e581cbbaea75 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:58:23 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3f727ad2-ed6a-4570-887e-a1bf27c03253 req-4d498088-a168-4a8a-9dcd-adbed47a7600 service nova] Acquiring lock "f1ddf6af-57d7-4a4a-a39c-b521279d4c77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:58:23 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3f727ad2-ed6a-4570-887e-a1bf27c03253 req-4d498088-a168-4a8a-9dcd-adbed47a7600 service nova] Lock "f1ddf6af-57d7-4a4a-a39c-b521279d4c77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:58:23 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-3f727ad2-ed6a-4570-887e-a1bf27c03253 req-4d498088-a168-4a8a-9dcd-adbed47a7600 service nova] Lock "f1ddf6af-57d7-4a4a-a39c-b521279d4c77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:58:23 user nova-compute[75745]: DEBUG nova.compute.manager [req-3f727ad2-ed6a-4570-887e-a1bf27c03253 req-4d498088-a168-4a8a-9dcd-adbed47a7600 service nova] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] No waiting events found dispatching network-vif-plugged-940ba7be-507d-4521-8f5c-e581cbbaea75 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:58:23 user nova-compute[75745]: WARNING nova.compute.manager [req-3f727ad2-ed6a-4570-887e-a1bf27c03253 req-4d498088-a168-4a8a-9dcd-adbed47a7600 service nova] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Received unexpected event network-vif-plugged-940ba7be-507d-4521-8f5c-e581cbbaea75 for instance with vm_state building and task_state spawning.
Dec 01 17:58:24 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:58:24 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:58:24 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:58:25 user nova-compute[75745]: DEBUG nova.compute.manager [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Instance event wait completed in 0 seconds for  {{(pid=75745) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 17:58:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Guest created on hypervisor {{(pid=75745) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 17:58:25 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Instance spawned successfully.
Dec 01 17:58:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 17:58:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Found default for hw_cdrom_bus of ide {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:58:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Found default for hw_disk_bus of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:58:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Found default for hw_input_bus of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:58:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Found default for hw_pointer_model of None {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:58:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Found default for hw_video_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:58:25 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Found default for hw_vif_model of virtio {{(pid=75745) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 17:58:25 user nova-compute[75745]: INFO nova.compute.manager [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Took 4.90 seconds to spawn the instance on the hypervisor.
Dec 01 17:58:25 user nova-compute[75745]: DEBUG nova.compute.manager [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Checking state {{(pid=75745) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 17:58:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:58:25 user nova-compute[75745]: INFO nova.compute.manager [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Took 14.29 seconds to build instance.
Dec 01 17:58:25 user nova-compute[75745]: DEBUG nova.compute.manager [req-335c1ffd-c12d-41f9-84bf-08c2c3292bdf req-7d561b25-9e6f-425e-9aa7-52d0f2f0b0c7 service nova] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Received event network-vif-plugged-940ba7be-507d-4521-8f5c-e581cbbaea75 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 17:58:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-335c1ffd-c12d-41f9-84bf-08c2c3292bdf req-7d561b25-9e6f-425e-9aa7-52d0f2f0b0c7 service nova] Acquiring lock "f1ddf6af-57d7-4a4a-a39c-b521279d4c77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:58:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-335c1ffd-c12d-41f9-84bf-08c2c3292bdf req-7d561b25-9e6f-425e-9aa7-52d0f2f0b0c7 service nova] Lock "f1ddf6af-57d7-4a4a-a39c-b521279d4c77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:58:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-335c1ffd-c12d-41f9-84bf-08c2c3292bdf req-7d561b25-9e6f-425e-9aa7-52d0f2f0b0c7 service nova] Lock "f1ddf6af-57d7-4a4a-a39c-b521279d4c77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:58:25 user nova-compute[75745]: DEBUG nova.compute.manager [req-335c1ffd-c12d-41f9-84bf-08c2c3292bdf req-7d561b25-9e6f-425e-9aa7-52d0f2f0b0c7 service nova] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] No waiting events found dispatching network-vif-plugged-940ba7be-507d-4521-8f5c-e581cbbaea75 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 17:58:25 user nova-compute[75745]: WARNING nova.compute.manager [req-335c1ffd-c12d-41f9-84bf-08c2c3292bdf req-7d561b25-9e6f-425e-9aa7-52d0f2f0b0c7 service nova] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Received unexpected event network-vif-plugged-940ba7be-507d-4521-8f5c-e581cbbaea75 for instance with vm_state active and task_state None.
Dec 01 17:58:25 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-6925e899-70df-4fc1-90b7-3fcb66590075 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "f1ddf6af-57d7-4a4a-a39c-b521279d4c77" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.437s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:58:27 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:58:27 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:58:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:58:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:58:27 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:58:27 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:58:27 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:58:28 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:58:28 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:58:28 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:58:28 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=8928MB free_disk=25.071151733398438GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:58:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:58:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:58:28 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:58:28 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance f1ddf6af-57d7-4a4a-a39c-b521279d4c77 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:58:28 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:58:28 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:58:28 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Refreshing inventories for resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 01 17:58:28 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Updating ProviderTree inventory for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 01 17:58:28 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Updating inventory in ProviderTree for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 01 17:58:28 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Refreshing aggregate associations for resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9, aggregates: None {{(pid=75745) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 01 17:58:28 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Refreshing trait associations for resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9, traits: COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=75745) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 01 17:58:28 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:58:28 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:58:28 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:58:28 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.456s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:58:31 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:58:31 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:58:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:58:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:58:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:58:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:58:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:58:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:58:35 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:58:35 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:58:35 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Rebuilding the list of instances to heal {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 17:58:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:58:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:58:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:58:35 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:58:35 user nova-compute[75745]: DEBUG nova.objects.instance [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lazy-loading 'info_cache' on Instance uuid e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 17:58:36 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Updating instance_info_cache with network_info: [{"id": "63b53252-4217-4127-b17d-a240d2b1a565", "address": "fa:16:3e:31:eb:bd", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b53252-42", "ovs_interfaceid": "63b53252-4217-4127-b17d-a240d2b1a565", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:58:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:58:36 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:58:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:58:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:58:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:58:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:58:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:58:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:58:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:58:52 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:58:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:58:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:59:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:59:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:59:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:59:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:59:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:59:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:59:07 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:59:12 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:59:17 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:59:17 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:59:17 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:59:17 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:59:17 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:59:17 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:59:21 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:59:22 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:59:22 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:59:22 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 17:59:24 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:59:24 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:59:25 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:59:27 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:59:29 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:59:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:59:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:59:29 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:59:29 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 17:59:30 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:59:30 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 17:59:30 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:59:30 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 17:59:30 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=8914MB free_disk=25.070472717285156GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 17:59:30 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 17:59:30 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 17:59:30 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:59:30 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance f1ddf6af-57d7-4a4a-a39c-b521279d4c77 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 17:59:30 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 17:59:30 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 17:59:30 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 17:59:30 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 17:59:30 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 17:59:30 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 17:59:31 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:59:31 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:59:32 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:59:36 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 17:59:36 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 17:59:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-f1ddf6af-57d7-4a4a-a39c-b521279d4c77" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 17:59:36 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-f1ddf6af-57d7-4a4a-a39c-b521279d4c77" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 17:59:36 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 17:59:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:59:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:59:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:59:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:59:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:59:37 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:59:37 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Updating instance_info_cache with network_info: [{"id": "940ba7be-507d-4521-8f5c-e581cbbaea75", "address": "fa:16:3e:93:60:3a", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap940ba7be-50", "ovs_interfaceid": "940ba7be-507d-4521-8f5c-e581cbbaea75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 17:59:37 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-f1ddf6af-57d7-4a4a-a39c-b521279d4c77" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 17:59:37 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 17:59:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:59:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:59:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:59:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:59:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:59:42 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:59:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:59:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:59:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:59:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:59:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:59:47 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:59:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:59:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 17:59:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 17:59:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:59:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 17:59:52 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 17:59:57 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:00:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 18:00:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:00:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 18:00:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 18:00:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 18:00:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 18:00:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:00:03 user nova-compute[75745]: DEBUG nova.compute.manager [req-fa8af028-5644-4ac0-b0b1-e5f266c5b573 req-8f04519c-fac7-4a7f-93bf-a3c7b45c2476 service nova] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Received event network-changed-940ba7be-507d-4521-8f5c-e581cbbaea75 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 18:00:03 user nova-compute[75745]: DEBUG nova.compute.manager [req-fa8af028-5644-4ac0-b0b1-e5f266c5b573 req-8f04519c-fac7-4a7f-93bf-a3c7b45c2476 service nova] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Refreshing instance network info cache due to event network-changed-940ba7be-507d-4521-8f5c-e581cbbaea75. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 18:00:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fa8af028-5644-4ac0-b0b1-e5f266c5b573 req-8f04519c-fac7-4a7f-93bf-a3c7b45c2476 service nova] Acquiring lock "refresh_cache-f1ddf6af-57d7-4a4a-a39c-b521279d4c77" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 18:00:03 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fa8af028-5644-4ac0-b0b1-e5f266c5b573 req-8f04519c-fac7-4a7f-93bf-a3c7b45c2476 service nova] Acquired lock "refresh_cache-f1ddf6af-57d7-4a4a-a39c-b521279d4c77" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 18:00:03 user nova-compute[75745]: DEBUG nova.network.neutron [req-fa8af028-5644-4ac0-b0b1-e5f266c5b573 req-8f04519c-fac7-4a7f-93bf-a3c7b45c2476 service nova] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Refreshing network info cache for port 940ba7be-507d-4521-8f5c-e581cbbaea75 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 18:00:04 user nova-compute[75745]: DEBUG nova.network.neutron [req-fa8af028-5644-4ac0-b0b1-e5f266c5b573 req-8f04519c-fac7-4a7f-93bf-a3c7b45c2476 service nova] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Updated VIF entry in instance network info cache for port 940ba7be-507d-4521-8f5c-e581cbbaea75. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 18:00:04 user nova-compute[75745]: DEBUG nova.network.neutron [req-fa8af028-5644-4ac0-b0b1-e5f266c5b573 req-8f04519c-fac7-4a7f-93bf-a3c7b45c2476 service nova] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Updating instance_info_cache with network_info: [{"id": "940ba7be-507d-4521-8f5c-e581cbbaea75", "address": "fa:16:3e:93:60:3a", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap940ba7be-50", "ovs_interfaceid": "940ba7be-507d-4521-8f5c-e581cbbaea75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 18:00:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fa8af028-5644-4ac0-b0b1-e5f266c5b573 req-8f04519c-fac7-4a7f-93bf-a3c7b45c2476 service nova] Releasing lock "refresh_cache-f1ddf6af-57d7-4a4a-a39c-b521279d4c77" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 18:00:04 user nova-compute[75745]: DEBUG nova.compute.manager [req-fa61a8ed-26ee-4e03-a323-b9cc05fd79bd req-f8fbfc27-9e80-4f42-9b49-6963b733c6c5 service nova] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Received event network-changed-940ba7be-507d-4521-8f5c-e581cbbaea75 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 18:00:04 user nova-compute[75745]: DEBUG nova.compute.manager [req-fa61a8ed-26ee-4e03-a323-b9cc05fd79bd req-f8fbfc27-9e80-4f42-9b49-6963b733c6c5 service nova] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Refreshing instance network info cache due to event network-changed-940ba7be-507d-4521-8f5c-e581cbbaea75. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 18:00:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fa61a8ed-26ee-4e03-a323-b9cc05fd79bd req-f8fbfc27-9e80-4f42-9b49-6963b733c6c5 service nova] Acquiring lock "refresh_cache-f1ddf6af-57d7-4a4a-a39c-b521279d4c77" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 18:00:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fa61a8ed-26ee-4e03-a323-b9cc05fd79bd req-f8fbfc27-9e80-4f42-9b49-6963b733c6c5 service nova] Acquired lock "refresh_cache-f1ddf6af-57d7-4a4a-a39c-b521279d4c77" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 18:00:04 user nova-compute[75745]: DEBUG nova.network.neutron [req-fa61a8ed-26ee-4e03-a323-b9cc05fd79bd req-f8fbfc27-9e80-4f42-9b49-6963b733c6c5 service nova] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Refreshing network info cache for port 940ba7be-507d-4521-8f5c-e581cbbaea75 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 18:00:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "f1ddf6af-57d7-4a4a-a39c-b521279d4c77" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 18:00:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "f1ddf6af-57d7-4a4a-a39c-b521279d4c77" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 18:00:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "f1ddf6af-57d7-4a4a-a39c-b521279d4c77-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 18:00:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "f1ddf6af-57d7-4a4a-a39c-b521279d4c77-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 18:00:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "f1ddf6af-57d7-4a4a-a39c-b521279d4c77-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 18:00:04 user nova-compute[75745]: INFO nova.compute.manager [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Terminating instance
Dec 01 18:00:04 user nova-compute[75745]: DEBUG nova.compute.manager [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 18:00:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:00:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG nova.network.neutron [req-fa61a8ed-26ee-4e03-a323-b9cc05fd79bd req-f8fbfc27-9e80-4f42-9b49-6963b733c6c5 service nova] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Updated VIF entry in instance network info cache for port 940ba7be-507d-4521-8f5c-e581cbbaea75. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG nova.network.neutron [req-fa61a8ed-26ee-4e03-a323-b9cc05fd79bd req-f8fbfc27-9e80-4f42-9b49-6963b733c6c5 service nova] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Updating instance_info_cache with network_info: [{"id": "940ba7be-507d-4521-8f5c-e581cbbaea75", "address": "fa:16:3e:93:60:3a", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap940ba7be-50", "ovs_interfaceid": "940ba7be-507d-4521-8f5c-e581cbbaea75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-fa61a8ed-26ee-4e03-a323-b9cc05fd79bd req-f8fbfc27-9e80-4f42-9b49-6963b733c6c5 service nova] Releasing lock "refresh_cache-f1ddf6af-57d7-4a4a-a39c-b521279d4c77" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 18:00:05 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Instance destroyed successfully.
Dec 01 18:00:05 user nova-compute[75745]: DEBUG nova.objects.instance [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lazy-loading 'resources' on Instance uuid f1ddf6af-57d7-4a4a-a39c-b521279d4c77 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:58:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1072430498',display_name='tempest-TestVolumeBootPattern-server-1072430498',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1072430498',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaGASNmHMCwnU2klLf0QfxQKkLaqg8lTAnsQ0Y5f6gp+OHE5KzZXuaQ49yykKxI1uI1o6gFpR5UTiAPuJn79NKCW5llBvns9e77ft4Xdyu8bdbX9KVQYq2mh7DdUS5MFQ==',key_name='tempest-TestVolumeBootPattern-1177500877',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:58:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e92d35468e65461d8ac34cb6c1d19b68',ramdisk_id='',reservation_id='r-vf6wjqgv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1187866378',owner_user_name='tempest-TestVolumeBootPattern-1187866378-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:58:26Z,user_data=None,user_id='d79b4d42093f4a12aae4fb90bbbcba39',uuid=f1ddf6af-57d7-4a4a-a39c-b521279d4c77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "940ba7be-507d-4521-8f5c-e581cbbaea75", "address": "fa:16:3e:93:60:3a", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap940ba7be-50", "ovs_interfaceid": "940ba7be-507d-4521-8f5c-e581cbbaea75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Converting VIF {"id": "940ba7be-507d-4521-8f5c-e581cbbaea75", "address": "fa:16:3e:93:60:3a", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap940ba7be-50", "ovs_interfaceid": "940ba7be-507d-4521-8f5c-e581cbbaea75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:60:3a,bridge_name='br-int',has_traffic_filtering=True,id=940ba7be-507d-4521-8f5c-e581cbbaea75,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap940ba7be-50') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG os_vif [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:60:3a,bridge_name='br-int',has_traffic_filtering=True,id=940ba7be-507d-4521-8f5c-e581cbbaea75,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap940ba7be-50') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap940ba7be-50, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=83ee3716-7e23-4108-96cc-ef821a799765) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:00:05 user nova-compute[75745]: INFO os_vif [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:60:3a,bridge_name='br-int',has_traffic_filtering=True,id=940ba7be-507d-4521-8f5c-e581cbbaea75,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap940ba7be-50')
Dec 01 18:00:05 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EDoUaZgK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 18:00:05 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 18:00:05 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[384a6296-6406-42f2-898d-5e71a389db44]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 18:00:05 user nova-compute[75745]: No targets found.
Dec 01 18:00:05 user nova-compute[75745]: iSNS:
Dec 01 18:00:05 user nova-compute[75745]: No targets found.
Dec 01 18:00:05 user nova-compute[75745]: STATIC:
Dec 01 18:00:05 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657
Dec 01 18:00:05 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 18:00:05 user nova-compute[75745]:                 Iface Name: default
Dec 01 18:00:05 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7
Dec 01 18:00:05 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 18:00:05 user nova-compute[75745]:                 Iface Name: default
Dec 01 18:00:05 user nova-compute[75745]: FIRMWARE:
Dec 01 18:00:05 user nova-compute[75745]: No targets found.
Dec 01 18:00:05 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 18:00:05 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 18:00:05 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[672aa3f0-25c9-4ac6-90ec-3bbb2ed41482]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[843584d4-bf98-47f1-a289-e8b81e07a192]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 (non-flash)
Dec 01 18:00:05 user nova-compute[75745]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7 (non-flash)
Dec 01 18:00:05 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 (non-flash)
Dec 01 18:00:05 user nova-compute[75745]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7 (non-flash)
Dec 01 18:00:05 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b81db910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7'): ({'sdc'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Removing single pathed devices sdc {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa80364-e986-4372-b8b4-7d0f8f96246a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5601135-4038-44ae-9d2b-792cef4ac497]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Flushing IO for device /dev/sdc {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f06d69a-8e37-4b42-9e4f-075fe8426a31]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f98ef90-c965-48c6-800d-1266866c0092]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] SCSI volumes sdc have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_4d58ede7',) {{(pid=86714) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[823c893d-8a60-462d-ba64-b479192756b1]: (4, None) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2100b4b3-0e61-4f4c-bec4-1cd021d5cc06]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7a2a80-36fa-494a-a062-cbd51c29ab79]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7, portal: 172.16.0.220,3260]
Dec 01 18:00:05 user nova-compute[75745]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7, portal: 172.16.0.220,3260] successful.
Dec 01 18:00:05 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f521d3-0989-4a48-95c8-1e12c2d608a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[41cf9e0d-ac8e-4716-a241-f773f57bf427]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] <== disconnect_volume: return (296ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 18:00:05 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Deleting instance files /opt/stack/data/nova/instances/f1ddf6af-57d7-4a4a-a39c-b521279d4c77_del
Dec 01 18:00:05 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Deletion of /opt/stack/data/nova/instances/f1ddf6af-57d7-4a4a-a39c-b521279d4c77_del complete
Dec 01 18:00:05 user nova-compute[75745]: INFO nova.compute.manager [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Took 1.17 seconds to destroy the instance on the hypervisor.
Dec 01 18:00:05 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 18:00:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:00:06 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 18:00:06 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Took 0.49 seconds to deallocate network for instance.
Dec 01 18:00:06 user nova-compute[75745]: DEBUG nova.compute.manager [req-54770181-bd01-4476-8488-6a53d83ebe90 req-7cd3b1d4-991f-4d3a-b958-e3d36a47c850 service nova] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Received event network-vif-deleted-940ba7be-507d-4521-8f5c-e581cbbaea75 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 18:00:06 user nova-compute[75745]: DEBUG nova.compute.manager [req-50792d9c-880e-4358-ae56-c4d24de79a91 req-8e66b490-a405-4d95-9da7-6339efc9ca75 service nova] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Received event network-vif-unplugged-940ba7be-507d-4521-8f5c-e581cbbaea75 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 18:00:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-50792d9c-880e-4358-ae56-c4d24de79a91 req-8e66b490-a405-4d95-9da7-6339efc9ca75 service nova] Acquiring lock "f1ddf6af-57d7-4a4a-a39c-b521279d4c77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 18:00:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-50792d9c-880e-4358-ae56-c4d24de79a91 req-8e66b490-a405-4d95-9da7-6339efc9ca75 service nova] Lock "f1ddf6af-57d7-4a4a-a39c-b521279d4c77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 18:00:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-50792d9c-880e-4358-ae56-c4d24de79a91 req-8e66b490-a405-4d95-9da7-6339efc9ca75 service nova] Lock "f1ddf6af-57d7-4a4a-a39c-b521279d4c77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 18:00:06 user nova-compute[75745]: DEBUG nova.compute.manager [req-50792d9c-880e-4358-ae56-c4d24de79a91 req-8e66b490-a405-4d95-9da7-6339efc9ca75 service nova] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] No waiting events found dispatching network-vif-unplugged-940ba7be-507d-4521-8f5c-e581cbbaea75 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 18:00:06 user nova-compute[75745]: DEBUG nova.compute.manager [req-50792d9c-880e-4358-ae56-c4d24de79a91 req-8e66b490-a405-4d95-9da7-6339efc9ca75 service nova] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Received event network-vif-unplugged-940ba7be-507d-4521-8f5c-e581cbbaea75 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 18:00:06 user nova-compute[75745]: DEBUG nova.compute.manager [req-50792d9c-880e-4358-ae56-c4d24de79a91 req-8e66b490-a405-4d95-9da7-6339efc9ca75 service nova] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Received event network-vif-plugged-940ba7be-507d-4521-8f5c-e581cbbaea75 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 18:00:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-50792d9c-880e-4358-ae56-c4d24de79a91 req-8e66b490-a405-4d95-9da7-6339efc9ca75 service nova] Acquiring lock "f1ddf6af-57d7-4a4a-a39c-b521279d4c77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 18:00:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-50792d9c-880e-4358-ae56-c4d24de79a91 req-8e66b490-a405-4d95-9da7-6339efc9ca75 service nova] Lock "f1ddf6af-57d7-4a4a-a39c-b521279d4c77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 18:00:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-50792d9c-880e-4358-ae56-c4d24de79a91 req-8e66b490-a405-4d95-9da7-6339efc9ca75 service nova] Lock "f1ddf6af-57d7-4a4a-a39c-b521279d4c77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 18:00:06 user nova-compute[75745]: DEBUG nova.compute.manager [req-50792d9c-880e-4358-ae56-c4d24de79a91 req-8e66b490-a405-4d95-9da7-6339efc9ca75 service nova] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] No waiting events found dispatching network-vif-plugged-940ba7be-507d-4521-8f5c-e581cbbaea75 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 18:00:06 user nova-compute[75745]: WARNING nova.compute.manager [req-50792d9c-880e-4358-ae56-c4d24de79a91 req-8e66b490-a405-4d95-9da7-6339efc9ca75 service nova] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Received unexpected event network-vif-plugged-940ba7be-507d-4521-8f5c-e581cbbaea75 for instance with vm_state active and task_state deleting.
Dec 01 18:00:07 user nova-compute[75745]: INFO nova.compute.manager [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: f1ddf6af-57d7-4a4a-a39c-b521279d4c77] Took 0.78 seconds to detach 1 volumes for instance.
Dec 01 18:00:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 18:00:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 18:00:07 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 18:00:07 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 18:00:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.305s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 18:00:07 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Deleted allocations for instance f1ddf6af-57d7-4a4a-a39c-b521279d4c77
Dec 01 18:00:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-093bcaee-8784-43b1-a227-6494bb3068e3 tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "f1ddf6af-57d7-4a4a-a39c-b521279d4c77" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.994s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 18:00:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:00:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:00:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:00:22 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:00:23 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:00:23 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 18:00:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:00:25 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:00:26 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:00:27 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:00:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 18:00:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:00:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 18:00:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 18:00:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 18:00:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 18:00:30 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:00:30 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 18:00:30 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 18:00:30 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 18:00:30 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 18:00:30 user nova-compute[75745]: DEBUG nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75745) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 18:00:31 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 18:00:31 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 18:00:31 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=9001MB free_disk=25.069564819335938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 18:00:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 18:00:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 18:00:31 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Instance e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75745) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 18:00:31 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 18:00:31 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 18:00:31 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 18:00:31 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 18:00:31 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 18:00:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 18:00:32 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:00:32 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:00:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 18:00:38 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:00:38 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 18:00:38 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Rebuilding the list of instances to heal {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 18:00:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "refresh_cache-e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 18:00:38 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquired lock "refresh_cache-e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 18:00:38 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Forcefully refreshing network info cache for instance {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 18:00:38 user nova-compute[75745]: DEBUG nova.objects.instance [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lazy-loading 'info_cache' on Instance uuid e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 18:00:39 user nova-compute[75745]: DEBUG nova.network.neutron [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Updating instance_info_cache with network_info: [{"id": "63b53252-4217-4127-b17d-a240d2b1a565", "address": "fa:16:3e:31:eb:bd", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b53252-42", "ovs_interfaceid": "63b53252-4217-4127-b17d-a240d2b1a565", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 18:00:39 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Releasing lock "refresh_cache-e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 18:00:39 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Updated the network info_cache for instance {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 18:00:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:00:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 18:00:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 18:00:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:00:57 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:01:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:01:04 user nova-compute[75745]: DEBUG nova.compute.manager [req-5bdd94c2-37b0-47d2-a75f-9d206fe3ed9e req-c1f1228e-7428-40c5-a929-82e8b5b14bb9 service nova] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Received event network-changed-63b53252-4217-4127-b17d-a240d2b1a565 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 18:01:04 user nova-compute[75745]: DEBUG nova.compute.manager [req-5bdd94c2-37b0-47d2-a75f-9d206fe3ed9e req-c1f1228e-7428-40c5-a929-82e8b5b14bb9 service nova] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Refreshing instance network info cache due to event network-changed-63b53252-4217-4127-b17d-a240d2b1a565. {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 18:01:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5bdd94c2-37b0-47d2-a75f-9d206fe3ed9e req-c1f1228e-7428-40c5-a929-82e8b5b14bb9 service nova] Acquiring lock "refresh_cache-e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 18:01:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5bdd94c2-37b0-47d2-a75f-9d206fe3ed9e req-c1f1228e-7428-40c5-a929-82e8b5b14bb9 service nova] Acquired lock "refresh_cache-e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 18:01:04 user nova-compute[75745]: DEBUG nova.network.neutron [req-5bdd94c2-37b0-47d2-a75f-9d206fe3ed9e req-c1f1228e-7428-40c5-a929-82e8b5b14bb9 service nova] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Refreshing network info cache for port 63b53252-4217-4127-b17d-a240d2b1a565 {{(pid=75745) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 18:01:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 18:01:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 18:01:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 18:01:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 18:01:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 18:01:04 user nova-compute[75745]: INFO nova.compute.manager [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Terminating instance
Dec 01 18:01:04 user nova-compute[75745]: DEBUG nova.compute.manager [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Start destroying the instance on the hypervisor. {{(pid=75745) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 18:01:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:01:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:01:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:01:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:01:04 user nova-compute[75745]: DEBUG nova.network.neutron [req-5bdd94c2-37b0-47d2-a75f-9d206fe3ed9e req-c1f1228e-7428-40c5-a929-82e8b5b14bb9 service nova] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Updated VIF entry in instance network info cache for port 63b53252-4217-4127-b17d-a240d2b1a565. {{(pid=75745) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 18:01:04 user nova-compute[75745]: DEBUG nova.network.neutron [req-5bdd94c2-37b0-47d2-a75f-9d206fe3ed9e req-c1f1228e-7428-40c5-a929-82e8b5b14bb9 service nova] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Updating instance_info_cache with network_info: [{"id": "63b53252-4217-4127-b17d-a240d2b1a565", "address": "fa:16:3e:31:eb:bd", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b53252-42", "ovs_interfaceid": "63b53252-4217-4127-b17d-a240d2b1a565", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 18:01:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-5bdd94c2-37b0-47d2-a75f-9d206fe3ed9e req-c1f1228e-7428-40c5-a929-82e8b5b14bb9 service nova] Releasing lock "refresh_cache-e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0" {{(pid=75745) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 18:01:04 user nova-compute[75745]: DEBUG nova.compute.manager [req-d6499a7d-2510-482d-b339-2869556b5814 req-59175dec-1d04-40f0-b060-c6f73a0c60a8 service nova] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Received event network-vif-unplugged-63b53252-4217-4127-b17d-a240d2b1a565 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 18:01:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d6499a7d-2510-482d-b339-2869556b5814 req-59175dec-1d04-40f0-b060-c6f73a0c60a8 service nova] Acquiring lock "e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 18:01:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d6499a7d-2510-482d-b339-2869556b5814 req-59175dec-1d04-40f0-b060-c6f73a0c60a8 service nova] Lock "e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 18:01:04 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-d6499a7d-2510-482d-b339-2869556b5814 req-59175dec-1d04-40f0-b060-c6f73a0c60a8 service nova] Lock "e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 18:01:04 user nova-compute[75745]: DEBUG nova.compute.manager [req-d6499a7d-2510-482d-b339-2869556b5814 req-59175dec-1d04-40f0-b060-c6f73a0c60a8 service nova] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] No waiting events found dispatching network-vif-unplugged-63b53252-4217-4127-b17d-a240d2b1a565 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 18:01:04 user nova-compute[75745]: DEBUG nova.compute.manager [req-d6499a7d-2510-482d-b339-2869556b5814 req-59175dec-1d04-40f0-b060-c6f73a0c60a8 service nova] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Received event network-vif-unplugged-63b53252-4217-4127-b17d-a240d2b1a565 for instance with task_state deleting. {{(pid=75745) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 18:01:04 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:01:05 user nova-compute[75745]: INFO nova.virt.libvirt.driver [-] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Instance destroyed successfully.
Dec 01 18:01:05 user nova-compute[75745]: DEBUG nova.objects.instance [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lazy-loading 'resources' on Instance uuid e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0 {{(pid=75745) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG nova.virt.libvirt.vif [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T17:56:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-322196136',display_name='tempest-TestVolumeBootPattern-server-322196136',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-322196136',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaGASNmHMCwnU2klLf0QfxQKkLaqg8lTAnsQ0Y5f6gp+OHE5KzZXuaQ49yykKxI1uI1o6gFpR5UTiAPuJn79NKCW5llBvns9e77ft4Xdyu8bdbX9KVQYq2mh7DdUS5MFQ==',key_name='tempest-TestVolumeBootPattern-1177500877',keypairs=<?>,launch_index=0,launched_at=2023-12-01T17:56:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e92d35468e65461d8ac34cb6c1d19b68',ramdisk_id='',reservation_id='r-z1un3bqc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1187866378',owner_user_name='tempest-TestVolumeBootPattern-1187866378-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T17:56:25Z,user_data=None,user_id='d79b4d42093f4a12aae4fb90bbbcba39',uuid=e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63b53252-4217-4127-b17d-a240d2b1a565", "address": "fa:16:3e:31:eb:bd", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b53252-42", "ovs_interfaceid": "63b53252-4217-4127-b17d-a240d2b1a565", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Converting VIF {"id": "63b53252-4217-4127-b17d-a240d2b1a565", "address": "fa:16:3e:31:eb:bd", "network": {"id": "ada9975d-b0b6-4c20-9333-7ad1b38ae044", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1794508413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e92d35468e65461d8ac34cb6c1d19b68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b53252-42", "ovs_interfaceid": "63b53252-4217-4127-b17d-a240d2b1a565", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG nova.network.os_vif_util [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:eb:bd,bridge_name='br-int',has_traffic_filtering=True,id=63b53252-4217-4127-b17d-a240d2b1a565,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63b53252-42') {{(pid=75745) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG os_vif [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:eb:bd,bridge_name='br-int',has_traffic_filtering=True,id=63b53252-4217-4127-b17d-a240d2b1a565,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63b53252-42') {{(pid=75745) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63b53252-42, bridge=br-int, if_exists=True) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c5444e03-205d-49e3-9049-291ae4d04339) {{(pid=75745) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 18:01:05 user nova-compute[75745]: INFO os_vif [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:eb:bd,bridge_name='br-int',has_traffic_filtering=True,id=63b53252-4217-4127-b17d-a240d2b1a565,network=Network(ada9975d-b0b6-4c20-9333-7ad1b38ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63b53252-42')
Dec 01 18:01:05 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] calling os-brick to detach iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f24b850b4c0>, {'target_iqn': 'iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gaGDeKsc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 18:01:05 user nova-compute[75745]: WARNING os_brick.initiator.connectors.base [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 18:01:05 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a3d967-979d-4af2-86d7-d3343dcf1935]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 18:01:05 user nova-compute[75745]: No targets found.
Dec 01 18:01:05 user nova-compute[75745]: iSNS:
Dec 01 18:01:05 user nova-compute[75745]: No targets found.
Dec 01 18:01:05 user nova-compute[75745]: STATIC:
Dec 01 18:01:05 user nova-compute[75745]: Target: iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657
Dec 01 18:01:05 user nova-compute[75745]:         Portal: 172.16.0.220:3260,-1
Dec 01 18:01:05 user nova-compute[75745]:                 Iface Name: default
Dec 01 18:01:05 user nova-compute[75745]: FIRMWARE:
Dec 01 18:01:05 user nova-compute[75745]: No targets found.
Dec 01 18:01:05 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 18:01:05 user nova-compute[75745]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 18:01:05 user nova-compute[75745]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75745) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657', 0)] {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2f5718-ab68-4b72-90a3-4a828dab3b1c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3a5392-9756-4bab-a2a2-e49cf75e85a9]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 (non-flash)\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 (non-flash)
Dec 01 18:01:05 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 (non-flash)
Dec 01 18:01:05 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24b819bb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657'): ({'sdb'}, set())}) {{(pid=75745) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Removing single pathed devices sdb {{(pid=75745) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ff665c-80ea-4492-8adc-a2e069091dd8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3d6de3-77d0-46b4-8fc3-8f825e9dd91b]: (4, ('ok\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Flushing IO for device /dev/sdb {{(pid=75745) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[332a19df-4d39-4e0b-8610-bf41b5110873]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75745) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[205ac2b8-bc3c-498e-96af-fa5f772bd516]: (4, ('1', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG os_brick.initiator.linuxscsi [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] SCSI volumes sdb have been removed. {{(pid=75745) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23761646330656532', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6631cb11', '/dev/disk/by-id/scsi-1SCST_BIO6631cb11-7adc0ee246ec68f0') {{(pid=86714) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3574cfc-0d4a-4973-9f3f-0242702819f0]: (4, None) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657')] {{(pid=75745) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[92dac809-90e2-4c6d-9e83-b94575edef35]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --logout {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[db256464-cc84-40af-a34c-293a01a4c19f]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657, portal: 172.16.0.220,3260]
Dec 01 18:01:05 user nova-compute[75745]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657, portal: 172.16.0.220,3260] successful.
Dec 01 18:01:05 user nova-compute[75745]:  stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --op delete {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2678ee9-b674-4e35-a627-ff6605e0d657 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86714) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG oslo.privsep.daemon [-] privsep: reply[14517862-ab96-48e2-aa10-d62bbf0f0ea1]: (4, ('', '')) {{(pid=86714) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75745) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.base [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] <== disconnect_volume: return (291ms) None {{(pid=75745) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Disconnected iSCSI Volume {{(pid=75745) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 18:01:05 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Deleting instance files /opt/stack/data/nova/instances/e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0_del
Dec 01 18:01:05 user nova-compute[75745]: INFO nova.virt.libvirt.driver [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Deletion of /opt/stack/data/nova/instances/e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0_del complete
Dec 01 18:01:05 user nova-compute[75745]: INFO nova.compute.manager [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Took 1.18 seconds to destroy the instance on the hypervisor.
Dec 01 18:01:05 user nova-compute[75745]: DEBUG oslo.service.loopingcall [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75745) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG nova.compute.manager [-] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Deallocating network for instance {{(pid=75745) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 18:01:05 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] deallocate_for_instance() {{(pid=75745) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 18:01:06 user nova-compute[75745]: DEBUG nova.network.neutron [-] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Updating instance_info_cache with network_info: [] {{(pid=75745) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 18:01:06 user nova-compute[75745]: INFO nova.compute.manager [-] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Took 0.42 seconds to deallocate network for instance.
Dec 01 18:01:06 user nova-compute[75745]: DEBUG nova.compute.manager [req-168286f3-9443-4a57-835b-0c60f5c8749d req-a3f3c495-aed8-4b73-a6f2-68c479457f88 service nova] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Received event network-vif-deleted-63b53252-4217-4127-b17d-a240d2b1a565 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 18:01:06 user nova-compute[75745]: INFO nova.compute.manager [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Took 0.76 seconds to detach 1 volumes for instance.
Dec 01 18:01:06 user nova-compute[75745]: DEBUG nova.compute.manager [req-dd255549-3a3d-4e23-a173-9a8ad7760bf5 req-799a2ae7-bfe4-4513-8552-f45e7db1ccee service nova] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Received event network-vif-plugged-63b53252-4217-4127-b17d-a240d2b1a565 {{(pid=75745) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 18:01:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-dd255549-3a3d-4e23-a173-9a8ad7760bf5 req-799a2ae7-bfe4-4513-8552-f45e7db1ccee service nova] Acquiring lock "e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 18:01:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-dd255549-3a3d-4e23-a173-9a8ad7760bf5 req-799a2ae7-bfe4-4513-8552-f45e7db1ccee service nova] Lock "e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 18:01:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [req-dd255549-3a3d-4e23-a173-9a8ad7760bf5 req-799a2ae7-bfe4-4513-8552-f45e7db1ccee service nova] Lock "e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 18:01:06 user nova-compute[75745]: DEBUG nova.compute.manager [req-dd255549-3a3d-4e23-a173-9a8ad7760bf5 req-799a2ae7-bfe4-4513-8552-f45e7db1ccee service nova] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] No waiting events found dispatching network-vif-plugged-63b53252-4217-4127-b17d-a240d2b1a565 {{(pid=75745) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 18:01:06 user nova-compute[75745]: WARNING nova.compute.manager [req-dd255549-3a3d-4e23-a173-9a8ad7760bf5 req-799a2ae7-bfe4-4513-8552-f45e7db1ccee service nova] [instance: e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0] Received unexpected event network-vif-plugged-63b53252-4217-4127-b17d-a240d2b1a565 for instance with vm_state active and task_state deleting.
Dec 01 18:01:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 18:01:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 18:01:06 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 18:01:06 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 18:01:06 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.110s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 18:01:07 user nova-compute[75745]: INFO nova.scheduler.client.report [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Deleted allocations for instance e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0
Dec 01 18:01:07 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-3c5ba484-b674-465d-a780-95b437af1b0c tempest-TestVolumeBootPattern-1187866378 tempest-TestVolumeBootPattern-1187866378-project-member] Lock "e65ff5dd-5ad8-4b67-9471-a76c5a5b68f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.654s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 18:01:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:01:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 18:01:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 18:01:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:01:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 18:01:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 18:01:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 18:01:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:01:22 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:01:23 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:01:23 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 18:01:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:01:25 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:01:27 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:01:28 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:01:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 18:01:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:01:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 18:01:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 18:01:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 18:01:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:01:30 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:01:30 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 18:01:30 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 18:01:30 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 18:01:30 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 18:01:31 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 18:01:31 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 18:01:31 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=9108MB free_disk=25.06869125366211GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 18:01:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 18:01:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 18:01:31 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 18:01:31 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 18:01:31 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 18:01:31 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 18:01:31 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 18:01:31 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 18:01:33 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:01:33 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:01:33 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:01:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 18:01:39 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:01:39 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 18:01:39 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Rebuilding the list of instances to heal {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 18:01:39 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Didn't find any instances for network info cache update. {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 18:01:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 18:01:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:01:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 18:01:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 18:01:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 18:01:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:01:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 18:01:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:01:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:01:59 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:02:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:02:02 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:02:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:02:06 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:02:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:02:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 18:02:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:02:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 18:02:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 18:02:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 18:02:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:02:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:02:23 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:02:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 18:02:25 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:02:25 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 18:02:26 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:02:27 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:02:27 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:02:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 18:02:30 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:02:32 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:02:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 18:02:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 18:02:32 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 18:02:32 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 18:02:33 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 18:02:33 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 18:02:33 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=9166MB free_disk=25.066787719726562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 18:02:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 18:02:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 18:02:33 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 18:02:33 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 18:02:33 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 18:02:33 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 18:02:33 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 18:02:33 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.119s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 18:02:34 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:02:34 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:02:35 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:02:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 18:02:37 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:02:37 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Cleaning up deleted instances {{(pid=75745) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 01 18:02:37 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] There are 0 instances to clean {{(pid=75745) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 01 18:02:39 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:02:39 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 18:02:39 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Rebuilding the list of instances to heal {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 18:02:39 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Didn't find any instances for network info cache update. {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 18:02:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 18:02:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:02:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 18:02:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 18:02:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 18:02:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:02:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:02:49 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:02:49 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75745) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 01 18:02:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 18:02:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:02:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 18:02:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 18:02:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 18:02:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:02:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 18:02:59 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:03:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 18:03:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 18:03:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:03:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 18:03:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 18:03:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 18:03:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:03:10 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:03:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:03:15 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:03:20 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:03:23 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:03:25 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:03:27 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:03:27 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75745) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 18:03:28 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:03:29 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:03:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 18:03:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 18:03:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75745) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 18:03:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 18:03:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75745) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 18:03:30 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:03:30 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:03:34 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:03:34 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:03:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 18:03:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 18:03:34 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 18:03:34 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75745) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 18:03:35 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 18:03:35 user nova-compute[75745]: WARNING nova.virt.libvirt.driver [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 18:03:35 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Hypervisor/Node resource view: name=user free_ram=9274MB free_disk=25.05868911743164GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75745) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 18:03:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 18:03:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 18:03:35 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 18:03:35 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 18:03:35 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75745) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 18:03:35 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Refreshing inventories for resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 01 18:03:35 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Updating ProviderTree inventory for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 01 18:03:35 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Updating inventory in ProviderTree for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 01 18:03:35 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Refreshing aggregate associations for resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9, aggregates: None {{(pid=75745) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 01 18:03:35 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Refreshing trait associations for resource provider 33987d7e-4951-418c-ad82-d4ed37170ed9, traits: COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=75745) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 01 18:03:35 user nova-compute[75745]: DEBUG nova.compute.provider_tree [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed in ProviderTree for provider: 33987d7e-4951-418c-ad82-d4ed37170ed9 {{(pid=75745) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 18:03:35 user nova-compute[75745]: DEBUG nova.scheduler.client.report [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Inventory has not changed for provider 33987d7e-4951-418c-ad82-d4ed37170ed9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75745) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 18:03:35 user nova-compute[75745]: DEBUG nova.compute.resource_tracker [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Compute_service record updated for user:user {{(pid=75745) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 18:03:35 user nova-compute[75745]: DEBUG oslo_concurrency.lockutils [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.306s {{(pid=75745) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 18:03:36 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:03:39 user nova-compute[75745]: DEBUG oslo_service.periodic_task [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75745) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 18:03:39 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Starting heal instance info cache {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 18:03:39 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Rebuilding the list of instances to heal {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 18:03:39 user nova-compute[75745]: DEBUG nova.compute.manager [None req-00a32dbd-61f4-4224-a798-0c4563ae2ad1 None None] Didn't find any instances for network info cache update. {{(pid=75745) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 18:03:40 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:03:45 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:03:50 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 18:03:55 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:04:00 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:04:05 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 18:04:10 user nova-compute[75745]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75745) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}